python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1898338 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2884880'] with mtr_portfolio_ids : ['23082895'] and first list_photo_ids : [] new path : /proc/1898338/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.2537145614624023 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri May 16 22:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7037 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-16 22:20:32.362648: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-16 22:20:32.387109: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-16 22:20:32.388542: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f72d8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-16 22:20:32.388597: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-16 22:20:32.391172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-16 22:20:32.498127: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xdc41b10 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-16 22:20:32.498194: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-16 22:20:32.499542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 22:20:32.499965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 22:20:32.503074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 22:20:32.506071: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 22:20:32.506670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 22:20:32.509379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 22:20:32.510551: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 22:20:32.515249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 22:20:32.517212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 22:20:32.517349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 22:20:32.518428: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 22:20:32.518455: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 22:20:32.518470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 22:20:32.520465: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6472 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-16 22:20:32.848478: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 22:20:32.848552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 22:20:32.848568: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 22:20:32.848582: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 22:20:32.848596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 22:20:32.848609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 22:20:32.848623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 22:20:32.848636: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 22:20:32.849646: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 22:20:32.850647: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 22:20:32.850679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 22:20:32.850697: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 22:20:32.850713: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 22:20:32.850729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 22:20:32.850745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 22:20:32.850766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 22:20:32.850781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 22:20:32.851861: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 22:20:32.851888: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 22:20:32.851897: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 22:20:32.851904: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 22:20:32.852967: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6472 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-16 22:20:42.188315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 22:20:42.409927: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 22:20:43.801151: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.801754: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.802332: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.802878: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.803442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.804031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.804562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.804593: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.805111: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.805126: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.812244: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.812272: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.812824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.812841: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.824974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.825019: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.825580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.825597: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.866904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.866949: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.867470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.867485: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.873243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.873266: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.873779: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.873794: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 22:20:43.922612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.923164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.924980: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.925499: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.984607: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.985198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.987476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:43.988044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.025620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.026159: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.027624: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.028145: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.033481: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.034000: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.035586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.036114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.045359: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.045903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.047392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.047911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.083413: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.083992: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.084504: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.085014: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.088453: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.088972: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.107999: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.108523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.109035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.109545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.125306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.125843: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.126353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.126863: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.131043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.131559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.140920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.141438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.156147: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.156664: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.160668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.161185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.161695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.162206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.162937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.163500: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.177364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.177928: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.178472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.179003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.179521: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.180031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.180540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.181051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.193842: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.194397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.200717: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.201239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.249269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.250217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.251327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.252337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.275187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.276276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.296985: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.297704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.298332: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.299274: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.303616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.304184: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.304741: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.305289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.306459: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.306485: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-16 22:20:44.319704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.320250: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.329405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.329968: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.330526: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.331066: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.331619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 22:20:44.332146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 1899037 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5844 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7037 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002501249313354492 nb_pixel_total : 104505 time to create 1 rle with old method : 0.12492060661315918 length of segment : 436 time for calcul the mask position with numpy : 0.024970293045043945 nb_pixel_total : 486864 time to create 1 rle with new method : 0.04941391944885254 length of segment : 759 time for calcul the mask position with numpy : 0.0007045269012451172 nb_pixel_total : 33180 time to create 1 rle with old method : 0.03699970245361328 length of segment : 235 time for calcul the mask position with numpy : 0.00034809112548828125 nb_pixel_total : 23292 time to create 1 rle with old method : 0.026107311248779297 length of segment : 203 time for calcul the mask position with numpy : 0.000507354736328125 nb_pixel_total : 33597 time to create 1 rle with old method : 0.03736472129821777 length of segment : 169 time for calcul the mask position with numpy : 0.0001990795135498047 nb_pixel_total : 9842 time to create 1 rle with old method : 0.011597156524658203 length of segment : 128 time for calcul the mask position with numpy : 0.0005245208740234375 nb_pixel_total : 14280 time to create 1 rle with old method : 0.016373634338378906 length of segment : 303 time for calcul the mask position with numpy : 0.0010933876037597656 nb_pixel_total : 81753 time to create 1 rle with old method : 0.09039998054504395 length of segment : 365 time for calcul the mask position with numpy : 0.0002968311309814453 nb_pixel_total : 19010 time to create 1 rle with old method : 0.02200460433959961 length of segment : 139 time for calcul the mask position with numpy : 0.0021750926971435547 nb_pixel_total : 152570 time to create 1 rle with new method : 0.0059163570404052734 length of segment : 464 time for calcul the mask position with numpy : 0.0008769035339355469 nb_pixel_total : 57529 time to create 1 rle with old method : 0.06429314613342285 length of segment : 404 time for calcul the mask position with numpy : 0.0026657581329345703 nb_pixel_total : 213664 time to create 1 rle with new method : 0.006897449493408203 length of segment : 718 time for calcul the mask position with numpy : 0.00023627281188964844 nb_pixel_total : 11402 time to create 1 rle with old method : 0.013238906860351562 length of segment : 108 time for calcul the mask position with numpy : 0.0007648468017578125 nb_pixel_total : 31128 time to create 1 rle with old method : 0.03467845916748047 length of segment : 279 time for calcul the mask position with numpy : 0.0009784698486328125 nb_pixel_total : 68546 time to create 1 rle with old method : 0.0749199390411377 length of segment : 419 time for calcul the mask position with numpy : 0.0002713203430175781 nb_pixel_total : 16184 time to create 1 rle with old method : 0.01817464828491211 length of segment : 152 time for calcul the mask position with numpy : 0.0014638900756835938 nb_pixel_total : 86328 time to create 1 rle with old method : 0.09443044662475586 length of segment : 341 time for calcul the mask position with numpy : 0.0006165504455566406 nb_pixel_total : 36525 time to create 1 rle with old method : 0.04127645492553711 length of segment : 187 time for calcul the mask position with numpy : 0.005270242691040039 nb_pixel_total : 288121 time to create 1 rle with new method : 0.025167226791381836 length of segment : 744 time for calcul the mask position with numpy : 0.0034444332122802734 nb_pixel_total : 166357 time to create 1 rle with new method : 0.014775276184082031 length of segment : 549 time for calcul the mask position with numpy : 0.0015621185302734375 nb_pixel_total : 87843 time to create 1 rle with old method : 0.09639573097229004 length of segment : 235 time for calcul the mask position with numpy : 0.0005869865417480469 nb_pixel_total : 18569 time to create 1 rle with old method : 0.02025294303894043 length of segment : 295 time for calcul the mask position with numpy : 0.0012671947479248047 nb_pixel_total : 69324 time to create 1 rle with old method : 0.07938122749328613 length of segment : 306 time for calcul the mask position with numpy : 0.0015003681182861328 nb_pixel_total : 74860 time to create 1 rle with old method : 0.08712887763977051 length of segment : 299 time for calcul the mask position with numpy : 0.0011086463928222656 nb_pixel_total : 46879 time to create 1 rle with old method : 0.05594825744628906 length of segment : 370 time for calcul the mask position with numpy : 0.0006153583526611328 nb_pixel_total : 27465 time to create 1 rle with old method : 0.029846668243408203 length of segment : 256 time for calcul the mask position with numpy : 0.0011768341064453125 nb_pixel_total : 60438 time to create 1 rle with old method : 0.06948423385620117 length of segment : 468 time for calcul the mask position with numpy : 0.0037140846252441406 nb_pixel_total : 175269 time to create 1 rle with new method : 0.010720968246459961 length of segment : 486 time for calcul the mask position with numpy : 0.0007212162017822266 nb_pixel_total : 26675 time to create 1 rle with old method : 0.0398557186126709 length of segment : 312 time for calcul the mask position with numpy : 0.0007350444793701172 nb_pixel_total : 11323 time to create 1 rle with old method : 0.013976335525512695 length of segment : 129 time for calcul the mask position with numpy : 0.0035758018493652344 nb_pixel_total : 56324 time to create 1 rle with old method : 0.07251334190368652 length of segment : 414 time for calcul the mask position with numpy : 0.003361225128173828 nb_pixel_total : 37082 time to create 1 rle with old method : 0.09741806983947754 length of segment : 281 time for calcul the mask position with numpy : 0.0038750171661376953 nb_pixel_total : 61274 time to create 1 rle with old method : 0.08992218971252441 length of segment : 374 time for calcul the mask position with numpy : 0.0014798641204833984 nb_pixel_total : 23390 time to create 1 rle with old method : 0.08296489715576172 length of segment : 100 time for calcul the mask position with numpy : 0.001753091812133789 nb_pixel_total : 18385 time to create 1 rle with old method : 0.03624153137207031 length of segment : 192 time for calcul the mask position with numpy : 0.0077970027923583984 nb_pixel_total : 107415 time to create 1 rle with old method : 0.15609169006347656 length of segment : 379 time for calcul the mask position with numpy : 0.0011534690856933594 nb_pixel_total : 17886 time to create 1 rle with old method : 0.021035194396972656 length of segment : 260 time for calcul the mask position with numpy : 0.0010318756103515625 nb_pixel_total : 16976 time to create 1 rle with old method : 0.031114578247070312 length of segment : 221 time for calcul the mask position with numpy : 0.012459278106689453 nb_pixel_total : 348243 time to create 1 rle with new method : 0.027712345123291016 length of segment : 733 time for calcul the mask position with numpy : 0.0010895729064941406 nb_pixel_total : 28589 time to create 1 rle with old method : 0.03245067596435547 length of segment : 274 time for calcul the mask position with numpy : 0.0010721683502197266 nb_pixel_total : 40225 time to create 1 rle with old method : 0.046727657318115234 length of segment : 298 time for calcul the mask position with numpy : 0.0012319087982177734 nb_pixel_total : 29031 time to create 1 rle with old method : 0.033751726150512695 length of segment : 288 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 13810 time to create 1 rle with old method : 0.01628875732421875 length of segment : 80 time for calcul the mask position with numpy : 0.0017268657684326172 nb_pixel_total : 64284 time to create 1 rle with old method : 0.08168959617614746 length of segment : 405 time for calcul the mask position with numpy : 0.0023407936096191406 nb_pixel_total : 62867 time to create 1 rle with old method : 0.07660293579101562 length of segment : 165 time for calcul the mask position with numpy : 0.0006434917449951172 nb_pixel_total : 13640 time to create 1 rle with old method : 0.01748490333557129 length of segment : 198 time for calcul the mask position with numpy : 0.0013005733489990234 nb_pixel_total : 19242 time to create 1 rle with old method : 0.03145575523376465 length of segment : 357 time for calcul the mask position with numpy : 0.0021486282348632812 nb_pixel_total : 110712 time to create 1 rle with old method : 0.123260498046875 length of segment : 523 time for calcul the mask position with numpy : 0.0004742145538330078 nb_pixel_total : 17774 time to create 1 rle with old method : 0.02011585235595703 length of segment : 154 time for calcul the mask position with numpy : 0.0002472400665283203 nb_pixel_total : 11407 time to create 1 rle with old method : 0.013342857360839844 length of segment : 108 time for calcul the mask position with numpy : 0.0021407604217529297 nb_pixel_total : 64519 time to create 1 rle with old method : 0.07016873359680176 length of segment : 394 time for calcul the mask position with numpy : 0.0004360675811767578 nb_pixel_total : 18999 time to create 1 rle with old method : 0.021090030670166016 length of segment : 267 time for calcul the mask position with numpy : 0.001638174057006836 nb_pixel_total : 42825 time to create 1 rle with old method : 0.04713320732116699 length of segment : 313 time for calcul the mask position with numpy : 0.001817941665649414 nb_pixel_total : 91112 time to create 1 rle with old method : 0.10075902938842773 length of segment : 626 time for calcul the mask position with numpy : 0.00064849853515625 nb_pixel_total : 14683 time to create 1 rle with old method : 0.016626834869384766 length of segment : 85 time for calcul the mask position with numpy : 0.0014688968658447266 nb_pixel_total : 37940 time to create 1 rle with old method : 0.04120588302612305 length of segment : 213 time for calcul the mask position with numpy : 0.0011949539184570312 nb_pixel_total : 24864 time to create 1 rle with old method : 0.026926517486572266 length of segment : 353 time for calcul the mask position with numpy : 0.0016808509826660156 nb_pixel_total : 64644 time to create 1 rle with old method : 0.0712897777557373 length of segment : 517 time for calcul the mask position with numpy : 0.0021207332611083984 nb_pixel_total : 77199 time to create 1 rle with old method : 0.08496379852294922 length of segment : 478 time for calcul the mask position with numpy : 0.0014390945434570312 nb_pixel_total : 47090 time to create 1 rle with old method : 0.05266547203063965 length of segment : 317 time for calcul the mask position with numpy : 0.003267526626586914 nb_pixel_total : 103935 time to create 1 rle with old method : 0.11655378341674805 length of segment : 390 time for calcul the mask position with numpy : 0.0037779808044433594 nb_pixel_total : 160515 time to create 1 rle with new method : 0.008456707000732422 length of segment : 471 time for calcul the mask position with numpy : 0.009427070617675781 nb_pixel_total : 444130 time to create 1 rle with new method : 0.035002708435058594 length of segment : 779 time for calcul the mask position with numpy : 0.004519939422607422 nb_pixel_total : 203138 time to create 1 rle with new method : 0.009346485137939453 length of segment : 724 time for calcul the mask position with numpy : 0.002053499221801758 nb_pixel_total : 99616 time to create 1 rle with old method : 0.11534547805786133 length of segment : 390 time for calcul the mask position with numpy : 0.002976655960083008 nb_pixel_total : 108529 time to create 1 rle with old method : 0.1603987216949463 length of segment : 471 time for calcul the mask position with numpy : 0.003993034362792969 nb_pixel_total : 135619 time to create 1 rle with old method : 0.17167258262634277 length of segment : 606 time for calcul the mask position with numpy : 0.003000020980834961 nb_pixel_total : 50406 time to create 1 rle with old method : 0.05626106262207031 length of segment : 479 time for calcul the mask position with numpy : 0.00039696693420410156 nb_pixel_total : 17248 time to create 1 rle with old method : 0.01937413215637207 length of segment : 203 time for calcul the mask position with numpy : 0.010434865951538086 nb_pixel_total : 332740 time to create 1 rle with new method : 0.03386497497558594 length of segment : 882 time for calcul the mask position with numpy : 0.0017731189727783203 nb_pixel_total : 78869 time to create 1 rle with old method : 0.08811044692993164 length of segment : 402 time for calcul the mask position with numpy : 0.0004374980926513672 nb_pixel_total : 13161 time to create 1 rle with old method : 0.0220487117767334 length of segment : 131 time for calcul the mask position with numpy : 0.001127004623413086 nb_pixel_total : 20092 time to create 1 rle with old method : 0.0327916145324707 length of segment : 210 time for calcul the mask position with numpy : 0.0009987354278564453 nb_pixel_total : 24297 time to create 1 rle with old method : 0.02797102928161621 length of segment : 178 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 12964 time to create 1 rle with old method : 0.014697074890136719 length of segment : 115 time for calcul the mask position with numpy : 0.0019829273223876953 nb_pixel_total : 64190 time to create 1 rle with old method : 0.07117462158203125 length of segment : 213 time for calcul the mask position with numpy : 0.0009045600891113281 nb_pixel_total : 17511 time to create 1 rle with old method : 0.019647836685180664 length of segment : 212 time for calcul the mask position with numpy : 0.0010471343994140625 nb_pixel_total : 19279 time to create 1 rle with old method : 0.021797895431518555 length of segment : 195 time for calcul the mask position with numpy : 0.0007596015930175781 nb_pixel_total : 23561 time to create 1 rle with old method : 0.02681422233581543 length of segment : 158 time for calcul the mask position with numpy : 0.0031642913818359375 nb_pixel_total : 73941 time to create 1 rle with old method : 0.08465385437011719 length of segment : 572 time for calcul the mask position with numpy : 0.0005168914794921875 nb_pixel_total : 11288 time to create 1 rle with old method : 0.012708187103271484 length of segment : 78 time for calcul the mask position with numpy : 0.0005328655242919922 nb_pixel_total : 12734 time to create 1 rle with old method : 0.015094757080078125 length of segment : 105 time for calcul the mask position with numpy : 0.0004105567932128906 nb_pixel_total : 11237 time to create 1 rle with old method : 0.012777090072631836 length of segment : 114 time for calcul the mask position with numpy : 0.004728078842163086 nb_pixel_total : 151533 time to create 1 rle with new method : 0.007465362548828125 length of segment : 407 time for calcul the mask position with numpy : 0.0003821849822998047 nb_pixel_total : 8318 time to create 1 rle with old method : 0.00963449478149414 length of segment : 94 time for calcul the mask position with numpy : 0.0008361339569091797 nb_pixel_total : 24595 time to create 1 rle with old method : 0.027143478393554688 length of segment : 239 time for calcul the mask position with numpy : 0.00031495094299316406 nb_pixel_total : 17096 time to create 1 rle with old method : 0.018271684646606445 length of segment : 226 time for calcul the mask position with numpy : 0.0037384033203125 nb_pixel_total : 90422 time to create 1 rle with old method : 0.09721016883850098 length of segment : 435 time for calcul the mask position with numpy : 0.0007233619689941406 nb_pixel_total : 25262 time to create 1 rle with old method : 0.02691936492919922 length of segment : 168 time for calcul the mask position with numpy : 0.0016217231750488281 nb_pixel_total : 51438 time to create 1 rle with old method : 0.05561399459838867 length of segment : 412 time for calcul the mask position with numpy : 0.0010790824890136719 nb_pixel_total : 29965 time to create 1 rle with old method : 0.0335845947265625 length of segment : 238 time for calcul the mask position with numpy : 0.00189208984375 nb_pixel_total : 74959 time to create 1 rle with old method : 0.08357524871826172 length of segment : 425 time for calcul the mask position with numpy : 0.00040435791015625 nb_pixel_total : 12837 time to create 1 rle with old method : 0.014676094055175781 length of segment : 161 time for calcul the mask position with numpy : 0.0006945133209228516 nb_pixel_total : 17273 time to create 1 rle with old method : 0.019455671310424805 length of segment : 189 time for calcul the mask position with numpy : 0.0031223297119140625 nb_pixel_total : 75928 time to create 1 rle with old method : 0.08634185791015625 length of segment : 430 time for calcul the mask position with numpy : 0.00038886070251464844 nb_pixel_total : 10397 time to create 1 rle with old method : 0.011851787567138672 length of segment : 124 time for calcul the mask position with numpy : 0.004534006118774414 nb_pixel_total : 188317 time to create 1 rle with new method : 0.008796930313110352 length of segment : 537 time for calcul the mask position with numpy : 0.00035572052001953125 nb_pixel_total : 13742 time to create 1 rle with old method : 0.015883922576904297 length of segment : 95 time for calcul the mask position with numpy : 0.0004131793975830078 nb_pixel_total : 12072 time to create 1 rle with old method : 0.01381063461303711 length of segment : 142 time for calcul the mask position with numpy : 0.0005977153778076172 nb_pixel_total : 19665 time to create 1 rle with old method : 0.022459983825683594 length of segment : 138 time for calcul the mask position with numpy : 0.001737833023071289 nb_pixel_total : 54838 time to create 1 rle with old method : 0.06277298927307129 length of segment : 217 time for calcul the mask position with numpy : 0.001138448715209961 nb_pixel_total : 50563 time to create 1 rle with old method : 0.05486702919006348 length of segment : 364 time for calcul the mask position with numpy : 0.0006880760192871094 nb_pixel_total : 33887 time to create 1 rle with old method : 0.03710746765136719 length of segment : 260 time for calcul the mask position with numpy : 0.00046896934509277344 nb_pixel_total : 12247 time to create 1 rle with old method : 0.01419210433959961 length of segment : 174 time for calcul the mask position with numpy : 0.0008108615875244141 nb_pixel_total : 29420 time to create 1 rle with old method : 0.033873558044433594 length of segment : 234 time for calcul the mask position with numpy : 0.0007083415985107422 nb_pixel_total : 36511 time to create 1 rle with old method : 0.038693904876708984 length of segment : 348 time for calcul the mask position with numpy : 0.0012750625610351562 nb_pixel_total : 48299 time to create 1 rle with old method : 0.05245161056518555 length of segment : 326 time for calcul the mask position with numpy : 0.00032830238342285156 nb_pixel_total : 7729 time to create 1 rle with old method : 0.0088958740234375 length of segment : 88 time for calcul the mask position with numpy : 0.0013735294342041016 nb_pixel_total : 39855 time to create 1 rle with old method : 0.04327726364135742 length of segment : 338 time for calcul the mask position with numpy : 0.0007982254028320312 nb_pixel_total : 22687 time to create 1 rle with old method : 0.024189472198486328 length of segment : 152 time for calcul the mask position with numpy : 0.0009634494781494141 nb_pixel_total : 28412 time to create 1 rle with old method : 0.03142881393432617 length of segment : 151 time for calcul the mask position with numpy : 0.0007658004760742188 nb_pixel_total : 31478 time to create 1 rle with old method : 0.03519320487976074 length of segment : 222 time for calcul the mask position with numpy : 0.0011792182922363281 nb_pixel_total : 28665 time to create 1 rle with old method : 0.03053760528564453 length of segment : 228 time for calcul the mask position with numpy : 0.001026153564453125 nb_pixel_total : 16000 time to create 1 rle with old method : 0.01778411865234375 length of segment : 265 time for calcul the mask position with numpy : 0.0009944438934326172 nb_pixel_total : 23269 time to create 1 rle with old method : 0.02535724639892578 length of segment : 187 time for calcul the mask position with numpy : 0.0006210803985595703 nb_pixel_total : 14307 time to create 1 rle with old method : 0.01526498794555664 length of segment : 200 time for calcul the mask position with numpy : 0.006017446517944336 nb_pixel_total : 171689 time to create 1 rle with new method : 0.009983539581298828 length of segment : 516 time for calcul the mask position with numpy : 0.0005650520324707031 nb_pixel_total : 9632 time to create 1 rle with old method : 0.010364294052124023 length of segment : 151 time for calcul the mask position with numpy : 0.0011053085327148438 nb_pixel_total : 28408 time to create 1 rle with old method : 0.03043055534362793 length of segment : 234 time for calcul the mask position with numpy : 0.0008041858673095703 nb_pixel_total : 17117 time to create 1 rle with old method : 0.018250465393066406 length of segment : 180 time for calcul the mask position with numpy : 0.0017614364624023438 nb_pixel_total : 57415 time to create 1 rle with old method : 0.06680083274841309 length of segment : 503 time for calcul the mask position with numpy : 0.0005812644958496094 nb_pixel_total : 22431 time to create 1 rle with old method : 0.024082183837890625 length of segment : 173 time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 17304 time to create 1 rle with old method : 0.01940298080444336 length of segment : 139 time for calcul the mask position with numpy : 0.0013685226440429688 nb_pixel_total : 63250 time to create 1 rle with old method : 0.06731796264648438 length of segment : 355 time for calcul the mask position with numpy : 0.0002484321594238281 nb_pixel_total : 11326 time to create 1 rle with old method : 0.012334346771240234 length of segment : 107 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 25573 time to create 1 rle with old method : 0.027719497680664062 length of segment : 144 time for calcul the mask position with numpy : 0.0010535717010498047 nb_pixel_total : 62656 time to create 1 rle with old method : 0.06603455543518066 length of segment : 331 time for calcul the mask position with numpy : 0.0005621910095214844 nb_pixel_total : 30544 time to create 1 rle with old method : 0.033910512924194336 length of segment : 228 time for calcul the mask position with numpy : 0.0012288093566894531 nb_pixel_total : 85021 time to create 1 rle with old method : 0.09331321716308594 length of segment : 271 time for calcul the mask position with numpy : 0.0007088184356689453 nb_pixel_total : 38893 time to create 1 rle with old method : 0.04439187049865723 length of segment : 226 time spent for convertir_results : 11.54806399345398 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 130 chid ids of type : 3594 Number RLEs to save : 39475 save missing photos in datou_result : time spend for datou_step_exec : 63.58188724517822 time spend to save output : 2.217460870742798 total time spend for step 1 : 65.79934811592102 step2:crop_condition Fri May 16 22:21:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 130 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 75 About to insert : list_path_to_insert length 75 new photo from crops ! About to upload 75 photos upload in portfolio : 3736932 init cache_photo without model_param we have 75 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747426912_1898338 we have uploaded 75 photos in the portfolio 3736932 time of upload the photos Elapsed time : 15.852401494979858 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747426937_1898338 we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.76995587348938 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747426943_1898338 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7208104133605957 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747426957_1898338 we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.044657945632935 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747426967_1898338 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.46087098121643066 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747426969_1898338 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5518531799316406 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359027357, 1359027352, 1359027343, 1359027337, 1359027332, 1359027328, 1359027185, 1359027181, 1359027177] Looping around the photos to save general results len do output : 130 /1359065197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359065347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027357', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027352', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027343', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027337', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027332', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027328', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027185', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027181', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027177', None, None, None, None, None, '2884880') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 399 time used for this insertion : 0.029323339462280273 save_final save missing photos in datou_result : time spend for datou_step_exec : 73.99085927009583 time spend to save output : 0.03297257423400879 total time spend for step 2 : 74.02383184432983 step3:rle_unique_nms_with_priority Fri May 16 22:22:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 130 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 9.726632595062256 time for calcul the mask position with numpy : 0.6952469348907471 nb_pixel_total : 5606833 time to create 1 rle with new method : 0.9080615043640137 time for calcul the mask position with numpy : 0.022626876831054688 nb_pixel_total : 86328 time to create 1 rle with old method : 0.09344625473022461 time for calcul the mask position with numpy : 0.022505760192871094 nb_pixel_total : 16184 time to create 1 rle with old method : 0.01889967918395996 time for calcul the mask position with numpy : 0.031141042709350586 nb_pixel_total : 68546 time to create 1 rle with old method : 0.07813000679016113 time for calcul the mask position with numpy : 0.02597951889038086 nb_pixel_total : 31128 time to create 1 rle with old method : 0.044294118881225586 time for calcul the mask position with numpy : 0.02586674690246582 nb_pixel_total : 11402 time to create 1 rle with old method : 0.018440961837768555 time for calcul the mask position with numpy : 0.026105403900146484 nb_pixel_total : 213664 time to create 1 rle with new method : 1.2540044784545898 time for calcul the mask position with numpy : 0.020880937576293945 nb_pixel_total : 57529 time to create 1 rle with old method : 0.06154227256774902 time for calcul the mask position with numpy : 0.021965742111206055 nb_pixel_total : 152570 time to create 1 rle with new method : 0.8436658382415771 time for calcul the mask position with numpy : 0.020813703536987305 nb_pixel_total : 19010 time to create 1 rle with old method : 0.020323753356933594 time for calcul the mask position with numpy : 0.021454334259033203 nb_pixel_total : 81753 time to create 1 rle with old method : 0.08884096145629883 time for calcul the mask position with numpy : 0.02131509780883789 nb_pixel_total : 14280 time to create 1 rle with old method : 0.015166521072387695 time for calcul the mask position with numpy : 0.021526098251342773 nb_pixel_total : 9842 time to create 1 rle with old method : 0.010707855224609375 time for calcul the mask position with numpy : 0.0208432674407959 nb_pixel_total : 33330 time to create 1 rle with old method : 0.036411285400390625 time for calcul the mask position with numpy : 0.021596908569335938 nb_pixel_total : 23292 time to create 1 rle with old method : 0.025573015213012695 time for calcul the mask position with numpy : 0.02115797996520996 nb_pixel_total : 33180 time to create 1 rle with old method : 0.03662419319152832 time for calcul the mask position with numpy : 0.024591445922851562 nb_pixel_total : 486864 time to create 1 rle with new method : 0.534940242767334 time for calcul the mask position with numpy : 0.02102804183959961 nb_pixel_total : 104505 time to create 1 rle with old method : 0.1203911304473877 create new chi : 5.393385410308838 time to delete rle : 0.02149367332458496 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 13389 TO DO : save crop sub photo not yet done ! save time : 0.7740156650543213 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 7.512295961380005 time for calcul the mask position with numpy : 0.45903658866882324 nb_pixel_total : 5656722 time to create 1 rle with new method : 0.8812346458435059 time for calcul the mask position with numpy : 0.0334169864654541 nb_pixel_total : 107415 time to create 1 rle with old method : 0.11613106727600098 time for calcul the mask position with numpy : 0.031740665435791016 nb_pixel_total : 18385 time to create 1 rle with old method : 0.019389629364013672 time for calcul the mask position with numpy : 0.03447127342224121 nb_pixel_total : 23390 time to create 1 rle with old method : 0.025562047958374023 time for calcul the mask position with numpy : 0.03464627265930176 nb_pixel_total : 61274 time to create 1 rle with old method : 0.06642436981201172 time for calcul the mask position with numpy : 0.03366446495056152 nb_pixel_total : 37082 time to create 1 rle with old method : 0.03908109664916992 time for calcul the mask position with numpy : 0.03325963020324707 nb_pixel_total : 56324 time to create 1 rle with old method : 0.060457468032836914 time for calcul the mask position with numpy : 0.03248333930969238 nb_pixel_total : 11323 time to create 1 rle with old method : 0.01208639144897461 time for calcul the mask position with numpy : 0.03151130676269531 nb_pixel_total : 26675 time to create 1 rle with old method : 0.027260780334472656 time for calcul the mask position with numpy : 0.032553672790527344 nb_pixel_total : 175269 time to create 1 rle with new method : 0.5962209701538086 time for calcul the mask position with numpy : 0.03119182586669922 nb_pixel_total : 60438 time to create 1 rle with old method : 0.062322378158569336 time for calcul the mask position with numpy : 0.03184056282043457 nb_pixel_total : 27465 time to create 1 rle with old method : 0.029512882232666016 time for calcul the mask position with numpy : 0.030271291732788086 nb_pixel_total : 46879 time to create 1 rle with old method : 0.0499720573425293 time for calcul the mask position with numpy : 0.023134231567382812 nb_pixel_total : 74860 time to create 1 rle with old method : 0.08158707618713379 time for calcul the mask position with numpy : 0.023268699645996094 nb_pixel_total : 69324 time to create 1 rle with old method : 0.07610154151916504 time for calcul the mask position with numpy : 0.02086925506591797 nb_pixel_total : 18569 time to create 1 rle with old method : 0.020365476608276367 time for calcul the mask position with numpy : 0.021324872970581055 nb_pixel_total : 87843 time to create 1 rle with old method : 0.09560751914978027 time for calcul the mask position with numpy : 0.022522926330566406 nb_pixel_total : 166357 time to create 1 rle with new method : 0.768639087677002 time for calcul the mask position with numpy : 0.023038148880004883 nb_pixel_total : 288121 time to create 1 rle with new method : 0.4921393394470215 time for calcul the mask position with numpy : 0.030256986618041992 nb_pixel_total : 36525 time to create 1 rle with old method : 0.03802919387817383 create new chi : 4.671297788619995 time to delete rle : 0.002002716064453125 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14912 TO DO : save crop sub photo not yet done ! save time : 0.864452600479126 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 8.492800235748291 time for calcul the mask position with numpy : 1.2805769443511963 nb_pixel_total : 5960643 time to create 1 rle with new method : 0.6219944953918457 time for calcul the mask position with numpy : 0.0206451416015625 nb_pixel_total : 24864 time to create 1 rle with old method : 0.02675485610961914 time for calcul the mask position with numpy : 0.020987749099731445 nb_pixel_total : 37940 time to create 1 rle with old method : 0.04128909111022949 time for calcul the mask position with numpy : 0.021167993545532227 nb_pixel_total : 14683 time to create 1 rle with old method : 0.016492605209350586 time for calcul the mask position with numpy : 0.02231121063232422 nb_pixel_total : 91112 time to create 1 rle with old method : 0.0963289737701416 time for calcul the mask position with numpy : 0.021037578582763672 nb_pixel_total : 42825 time to create 1 rle with old method : 0.04459404945373535 time for calcul the mask position with numpy : 0.02066802978515625 nb_pixel_total : 18999 time to create 1 rle with old method : 0.023066997528076172 time for calcul the mask position with numpy : 0.02107405662536621 nb_pixel_total : 64519 time to create 1 rle with old method : 0.06749534606933594 time for calcul the mask position with numpy : 0.020499467849731445 nb_pixel_total : 11407 time to create 1 rle with old method : 0.012102127075195312 time for calcul the mask position with numpy : 0.020652294158935547 nb_pixel_total : 17774 time to create 1 rle with old method : 0.018529176712036133 time for calcul the mask position with numpy : 0.020773649215698242 nb_pixel_total : 110681 time to create 1 rle with old method : 0.11909937858581543 time for calcul the mask position with numpy : 0.020006179809570312 nb_pixel_total : 19242 time to create 1 rle with old method : 0.02031087875366211 time for calcul the mask position with numpy : 0.020566225051879883 nb_pixel_total : 13640 time to create 1 rle with old method : 0.014523506164550781 time for calcul the mask position with numpy : 0.02933478355407715 nb_pixel_total : 62867 time to create 1 rle with old method : 0.06577920913696289 time for calcul the mask position with numpy : 0.03211379051208496 nb_pixel_total : 64284 time to create 1 rle with old method : 0.06725001335144043 time for calcul the mask position with numpy : 0.03258800506591797 nb_pixel_total : 13810 time to create 1 rle with old method : 0.014716148376464844 time for calcul the mask position with numpy : 0.03275942802429199 nb_pixel_total : 29031 time to create 1 rle with old method : 0.030859947204589844 time for calcul the mask position with numpy : 0.027038097381591797 nb_pixel_total : 40225 time to create 1 rle with old method : 0.042476654052734375 time for calcul the mask position with numpy : 0.02099299430847168 nb_pixel_total : 28589 time to create 1 rle with old method : 0.03035426139831543 time for calcul the mask position with numpy : 0.023586750030517578 nb_pixel_total : 348243 time to create 1 rle with new method : 0.5305728912353516 time for calcul the mask position with numpy : 0.02157115936279297 nb_pixel_total : 16976 time to create 1 rle with old method : 0.018316030502319336 time for calcul the mask position with numpy : 0.020700693130493164 nb_pixel_total : 17886 time to create 1 rle with old method : 0.01944255828857422 create new chi : 3.7742910385131836 time to delete rle : 0.002111673355102539 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 14774 TO DO : save crop sub photo not yet done ! save time : 0.8429832458496094 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 9.03218150138855 time for calcul the mask position with numpy : 0.4637184143066406 nb_pixel_total : 5215960 time to create 1 rle with new method : 0.811622142791748 time for calcul the mask position with numpy : 0.0199887752532959 nb_pixel_total : 8657 time to create 1 rle with old method : 0.009570121765136719 time for calcul the mask position with numpy : 0.021359682083129883 nb_pixel_total : 78869 time to create 1 rle with old method : 0.09241724014282227 time for calcul the mask position with numpy : 0.02332139015197754 nb_pixel_total : 332740 time to create 1 rle with new method : 0.7048158645629883 time for calcul the mask position with numpy : 0.022081375122070312 nb_pixel_total : 17200 time to create 1 rle with old method : 0.01876378059387207 time for calcul the mask position with numpy : 0.021589040756225586 nb_pixel_total : 50406 time to create 1 rle with old method : 0.054442644119262695 time for calcul the mask position with numpy : 0.021378755569458008 nb_pixel_total : 135619 time to create 1 rle with old method : 0.14882349967956543 time for calcul the mask position with numpy : 0.022343158721923828 nb_pixel_total : 108529 time to create 1 rle with old method : 0.11376953125 time for calcul the mask position with numpy : 0.019907474517822266 nb_pixel_total : 2194 time to create 1 rle with old method : 0.002652406692504883 time for calcul the mask position with numpy : 0.02084207534790039 nb_pixel_total : 203138 time to create 1 rle with new method : 0.894148588180542 time for calcul the mask position with numpy : 0.023813962936401367 nb_pixel_total : 443545 time to create 1 rle with new method : 0.785137414932251 time for calcul the mask position with numpy : 0.024260997772216797 nb_pixel_total : 160515 time to create 1 rle with new method : 0.7640590667724609 time for calcul the mask position with numpy : 0.02163529396057129 nb_pixel_total : 103935 time to create 1 rle with old method : 0.1102149486541748 time for calcul the mask position with numpy : 0.021473169326782227 nb_pixel_total : 47090 time to create 1 rle with old method : 0.05040788650512695 time for calcul the mask position with numpy : 0.02046346664428711 nb_pixel_total : 77199 time to create 1 rle with old method : 0.08236575126647949 time for calcul the mask position with numpy : 0.0214235782623291 nb_pixel_total : 64644 time to create 1 rle with old method : 0.07006454467773438 create new chi : 5.632680654525757 time to delete rle : 0.0022852420806884766 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 15983 TO DO : save crop sub photo not yet done ! save time : 0.9243736267089844 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 6.608426332473755 time for calcul the mask position with numpy : 0.5727460384368896 nb_pixel_total : 6467182 time to create 1 rle with new method : 0.6287722587585449 time for calcul the mask position with numpy : 0.03117203712463379 nb_pixel_total : 90422 time to create 1 rle with old method : 0.09649324417114258 time for calcul the mask position with numpy : 0.020021438598632812 nb_pixel_total : 17096 time to create 1 rle with old method : 0.018011808395385742 time for calcul the mask position with numpy : 0.02057504653930664 nb_pixel_total : 24595 time to create 1 rle with old method : 0.026141881942749023 time for calcul the mask position with numpy : 0.022054195404052734 nb_pixel_total : 8318 time to create 1 rle with old method : 0.009130001068115234 time for calcul the mask position with numpy : 0.02252197265625 nb_pixel_total : 151533 time to create 1 rle with new method : 0.5982117652893066 time for calcul the mask position with numpy : 0.028158187866210938 nb_pixel_total : 11237 time to create 1 rle with old method : 0.011810302734375 time for calcul the mask position with numpy : 0.020146846771240234 nb_pixel_total : 12734 time to create 1 rle with old method : 0.013135671615600586 time for calcul the mask position with numpy : 0.02038264274597168 nb_pixel_total : 11288 time to create 1 rle with old method : 0.012166023254394531 time for calcul the mask position with numpy : 0.020818233489990234 nb_pixel_total : 73941 time to create 1 rle with old method : 0.07880163192749023 time for calcul the mask position with numpy : 0.020325422286987305 nb_pixel_total : 23561 time to create 1 rle with old method : 0.024319887161254883 time for calcul the mask position with numpy : 0.01890873908996582 nb_pixel_total : 19279 time to create 1 rle with old method : 0.0199124813079834 time for calcul the mask position with numpy : 0.01994919776916504 nb_pixel_total : 17511 time to create 1 rle with old method : 0.018207788467407227 time for calcul the mask position with numpy : 0.020319700241088867 nb_pixel_total : 64190 time to create 1 rle with old method : 0.07009100914001465 time for calcul the mask position with numpy : 0.02423858642578125 nb_pixel_total : 12964 time to create 1 rle with old method : 0.014418363571166992 time for calcul the mask position with numpy : 0.022694110870361328 nb_pixel_total : 24297 time to create 1 rle with old method : 0.026729583740234375 time for calcul the mask position with numpy : 0.02167201042175293 nb_pixel_total : 20092 time to create 1 rle with old method : 0.022009849548339844 create new chi : 2.677622079849243 time to delete rle : 0.0013189315795898438 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 9262 TO DO : save crop sub photo not yet done ! save time : 0.5559561252593994 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 5.851466417312622 time for calcul the mask position with numpy : 1.1971156597137451 nb_pixel_total : 6544479 time to create 1 rle with new method : 0.7451353073120117 time for calcul the mask position with numpy : 0.03525042533874512 nb_pixel_total : 12072 time to create 1 rle with old method : 0.013918399810791016 time for calcul the mask position with numpy : 0.02922511100769043 nb_pixel_total : 13742 time to create 1 rle with old method : 0.01568317413330078 time for calcul the mask position with numpy : 0.03573870658874512 nb_pixel_total : 188317 time to create 1 rle with new method : 0.5095365047454834 time for calcul the mask position with numpy : 0.036221981048583984 nb_pixel_total : 10397 time to create 1 rle with old method : 0.01190185546875 time for calcul the mask position with numpy : 0.037673234939575195 nb_pixel_total : 75928 time to create 1 rle with old method : 0.08429288864135742 time for calcul the mask position with numpy : 0.03555488586425781 nb_pixel_total : 17273 time to create 1 rle with old method : 0.01913595199584961 time for calcul the mask position with numpy : 0.0339813232421875 nb_pixel_total : 6408 time to create 1 rle with old method : 0.007283687591552734 time for calcul the mask position with numpy : 0.032928466796875 nb_pixel_total : 74959 time to create 1 rle with old method : 0.08310294151306152 time for calcul the mask position with numpy : 0.03269076347351074 nb_pixel_total : 29965 time to create 1 rle with old method : 0.040265798568725586 time for calcul the mask position with numpy : 0.034133195877075195 nb_pixel_total : 51438 time to create 1 rle with old method : 0.057692527770996094 time for calcul the mask position with numpy : 0.027371883392333984 nb_pixel_total : 25262 time to create 1 rle with old method : 0.027985811233520508 create new chi : 3.2476534843444824 time to delete rle : 0.0020537376403808594 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7858 TO DO : save crop sub photo not yet done ! save time : 0.48486924171447754 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.380831241607666 time for calcul the mask position with numpy : 0.3549776077270508 nb_pixel_total : 6757081 time to create 1 rle with new method : 0.7741050720214844 time for calcul the mask position with numpy : 0.03237605094909668 nb_pixel_total : 7729 time to create 1 rle with old method : 0.008335351943969727 time for calcul the mask position with numpy : 0.020228862762451172 nb_pixel_total : 48299 time to create 1 rle with old method : 0.051590681076049805 time for calcul the mask position with numpy : 0.021589040756225586 nb_pixel_total : 36511 time to create 1 rle with old method : 0.06014609336853027 time for calcul the mask position with numpy : 0.022577524185180664 nb_pixel_total : 29420 time to create 1 rle with old method : 0.03149127960205078 time for calcul the mask position with numpy : 0.020415782928466797 nb_pixel_total : 12247 time to create 1 rle with old method : 0.013116121292114258 time for calcul the mask position with numpy : 0.022024869918823242 nb_pixel_total : 33887 time to create 1 rle with old method : 0.05413627624511719 time for calcul the mask position with numpy : 0.025643587112426758 nb_pixel_total : 50563 time to create 1 rle with old method : 0.06233382225036621 time for calcul the mask position with numpy : 0.0211942195892334 nb_pixel_total : 54838 time to create 1 rle with old method : 0.0605623722076416 time for calcul the mask position with numpy : 0.021060943603515625 nb_pixel_total : 19665 time to create 1 rle with old method : 0.02206707000732422 create new chi : 1.737546443939209 time to delete rle : 0.001012563705444336 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 6458 TO DO : save crop sub photo not yet done ! save time : 0.394650936126709 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 5.610244989395142 time for calcul the mask position with numpy : 0.6147074699401855 nb_pixel_total : 6538875 time to create 1 rle with new method : 0.717193603515625 time for calcul the mask position with numpy : 0.03438997268676758 nb_pixel_total : 22431 time to create 1 rle with old method : 0.023660898208618164 time for calcul the mask position with numpy : 0.03297996520996094 nb_pixel_total : 57415 time to create 1 rle with old method : 0.06010842323303223 time for calcul the mask position with numpy : 0.03397393226623535 nb_pixel_total : 17117 time to create 1 rle with old method : 0.018515348434448242 time for calcul the mask position with numpy : 0.0220949649810791 nb_pixel_total : 28408 time to create 1 rle with old method : 0.04113364219665527 time for calcul the mask position with numpy : 0.023598909378051758 nb_pixel_total : 9632 time to create 1 rle with old method : 0.0160214900970459 time for calcul the mask position with numpy : 0.022878170013427734 nb_pixel_total : 171689 time to create 1 rle with new method : 0.5723700523376465 time for calcul the mask position with numpy : 0.021222829818725586 nb_pixel_total : 14307 time to create 1 rle with old method : 0.020288705825805664 time for calcul the mask position with numpy : 0.0233154296875 nb_pixel_total : 23269 time to create 1 rle with old method : 0.037714481353759766 time for calcul the mask position with numpy : 0.02254319190979004 nb_pixel_total : 16000 time to create 1 rle with old method : 0.01724720001220703 time for calcul the mask position with numpy : 0.02092456817626953 nb_pixel_total : 28665 time to create 1 rle with old method : 0.030174732208251953 time for calcul the mask position with numpy : 0.020791053771972656 nb_pixel_total : 31478 time to create 1 rle with old method : 0.03350400924682617 time for calcul the mask position with numpy : 0.02032184600830078 nb_pixel_total : 28412 time to create 1 rle with old method : 0.030278682708740234 time for calcul the mask position with numpy : 0.020483732223510742 nb_pixel_total : 22687 time to create 1 rle with old method : 0.023888826370239258 time for calcul the mask position with numpy : 0.021079301834106445 nb_pixel_total : 39855 time to create 1 rle with old method : 0.04304146766662598 create new chi : 2.699714422225952 time to delete rle : 0.0014636516571044922 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9160 TO DO : save crop sub photo not yet done ! save time : 0.5524623394012451 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 4.340033292770386 time for calcul the mask position with numpy : 1.6529817581176758 nb_pixel_total : 6715673 time to create 1 rle with new method : 0.7139484882354736 time for calcul the mask position with numpy : 0.01999497413635254 nb_pixel_total : 38893 time to create 1 rle with old method : 0.04039120674133301 time for calcul the mask position with numpy : 0.02069997787475586 nb_pixel_total : 85021 time to create 1 rle with old method : 0.08732295036315918 time for calcul the mask position with numpy : 0.020082950592041016 nb_pixel_total : 30544 time to create 1 rle with old method : 0.031432151794433594 time for calcul the mask position with numpy : 0.020817279815673828 nb_pixel_total : 62656 time to create 1 rle with old method : 0.0643777847290039 time for calcul the mask position with numpy : 0.030831098556518555 nb_pixel_total : 25573 time to create 1 rle with old method : 0.03169369697570801 time for calcul the mask position with numpy : 0.034111976623535156 nb_pixel_total : 11326 time to create 1 rle with old method : 0.01241159439086914 time for calcul the mask position with numpy : 0.03483223915100098 nb_pixel_total : 63250 time to create 1 rle with old method : 0.06761789321899414 time for calcul the mask position with numpy : 0.03338956832885742 nb_pixel_total : 17304 time to create 1 rle with old method : 0.01842784881591797 create new chi : 2.9743778705596924 time to delete rle : 0.0009927749633789062 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 5748 TO DO : save crop sub photo not yet done ! save time : 0.3846144676208496 map_output_result : {1359027357: (0.0, 'Should be the crop_list due to order', 0), 1359027352: (0.0, 'Should be the crop_list due to order', 0), 1359027343: (0.0, 'Should be the crop_list due to order', 0), 1359027337: (0.0, 'Should be the crop_list due to order', 0), 1359027332: (0.0, 'Should be the crop_list due to order', 0), 1359027328: (0.0, 'Should be the crop_list due to order', 0), 1359027185: (0.0, 'Should be the crop_list due to order', 0), 1359027181: (0.0, 'Should be the crop_list due to order', 0), 1359027177: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359027357, 1359027352, 1359027343, 1359027337, 1359027332, 1359027328, 1359027185, 1359027181, 1359027177] Looping around the photos to save general results len do output : 9 /1359027357.Didn't retrieve data . /1359027352.Didn't retrieve data . /1359027343.Didn't retrieve data . /1359027337.Didn't retrieve data . /1359027332.Didn't retrieve data . /1359027328.Didn't retrieve data . /1359027185.Didn't retrieve data . /1359027181.Didn't retrieve data . /1359027177.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027357', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027352', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027343', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027337', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027332', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027328', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027185', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027181', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027177', None, None, None, None, None, '2884880') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014030218124389648 save_final save missing photos in datou_result : time spend for datou_step_exec : 102.28866243362427 time spend to save output : 0.014454364776611328 total time spend for step 3 : 102.30311679840088 step4:ventilate_hashtags_in_portfolio Fri May 16 22:24:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23082895 get user id for portfolio 23082895 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23082895 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','autre','pehd','environnement','carton','background','papier','metal','pet_fonce','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23082895 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','autre','pehd','environnement','carton','background','papier','metal','pet_fonce','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23082895 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','autre','pehd','environnement','carton','background','papier','metal','pet_fonce','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23083675,23083676,23083677,23083678,23083679,23083680,23083681,23083682,23083683,23083684,23083685?tags=flou,autre,pehd,environnement,carton,background,papier,metal,pet_fonce,pet_clair,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359027357, 1359027352, 1359027343, 1359027337, 1359027332, 1359027328, 1359027185, 1359027181, 1359027177] Looping around the photos to save general results len do output : 1 /23082895. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027357', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027352', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027343', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027337', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027332', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027328', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027185', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027181', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027177', None, None, None, None, None, '2884880') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014299631118774414 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.605668544769287 time spend to save output : 0.01453852653503418 total time spend for step 4 : 1.6202070713043213 step5:final Fri May 16 22:24:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359027357: ('0.12590134047446142',), 1359027352: ('0.12590134047446142',), 1359027343: ('0.12590134047446142',), 1359027337: ('0.12590134047446142',), 1359027332: ('0.12590134047446142',), 1359027328: ('0.12590134047446142',), 1359027185: ('0.12590134047446142',), 1359027181: ('0.12590134047446142',), 1359027177: ('0.12590134047446142',)} new output for save of step final : {1359027357: ('0.12590134047446142',), 1359027352: ('0.12590134047446142',), 1359027343: ('0.12590134047446142',), 1359027337: ('0.12590134047446142',), 1359027332: ('0.12590134047446142',), 1359027328: ('0.12590134047446142',), 1359027185: ('0.12590134047446142',), 1359027181: ('0.12590134047446142',), 1359027177: ('0.12590134047446142',)} [1359027357, 1359027352, 1359027343, 1359027337, 1359027332, 1359027328, 1359027185, 1359027181, 1359027177] Looping around the photos to save general results len do output : 9 /1359027357.Didn't retrieve data . /1359027352.Didn't retrieve data . /1359027343.Didn't retrieve data . /1359027337.Didn't retrieve data . /1359027332.Didn't retrieve data . /1359027328.Didn't retrieve data . /1359027185.Didn't retrieve data . /1359027181.Didn't retrieve data . /1359027177.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027357', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027352', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027343', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027337', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027332', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027328', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027185', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027181', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027177', None, None, None, None, None, '2884880') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.012515544891357422 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10917234420776367 time spend to save output : 0.012987613677978516 total time spend for step 5 : 0.12215995788574219 step6:blur_detection Fri May 16 22:24:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765.jpg resize: (2160, 3264) 1359027357 3.0850900207847847 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919.jpg resize: (2160, 3264) 1359027352 -1.9452738361698674 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8.jpg resize: (2160, 3264) 1359027343 -1.086746884327174 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe.jpg resize: (2160, 3264) 1359027337 -0.14713987127909825 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af.jpg resize: (2160, 3264) 1359027332 -2.2578109912941264 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b.jpg resize: (2160, 3264) 1359027328 -0.6929400066330748 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648.jpg resize: (2160, 3264) 1359027185 1.0543584712421978 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2.jpg resize: (2160, 3264) 1359027181 -1.6560928389645027 treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00.jpg resize: (2160, 3264) 1359027177 -1.2158106455798787 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249648_0.png resize: (274, 140) 1359065197 -2.976881349369627 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249642_0.png resize: (436, 342) 1359065198 -0.7351081479568589 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249647_0.png resize: (128, 107) 1359065199 -1.1101117010554256 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249654_0.png resize: (108, 126) 1359065200 0.4151858541247056 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249643_0.png resize: (759, 1161) 1359065201 0.875343880863619 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249646_0.png resize: (169, 283) 1359065202 1.5704814895055677 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249644_0.png resize: (233, 261) 1359065203 -0.3433189338242611 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249657_0.png resize: (152, 154) 1359065204 -0.5010754529597898 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249650_0.png resize: (139, 158) 1359065205 1.5202295770730367 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249655_0.png resize: (278, 240) 1359065206 -1.2738902634044829 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249652_0.png resize: (402, 169) 1359065207 -0.8070507045690237 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249645_0.png resize: (196, 140) 1359065208 0.4058566214020656 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249671_0.png resize: (129, 123) 1359065209 -1.473373174410007 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249666_0.png resize: (306, 272) 1359065211 -2.3235215693866653 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249674_0.png resize: (371, 255) 1359065212 -2.0952180405652308 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249663_0.png resize: (295, 116) 1359065213 -1.3495887683431724 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249672_0.png resize: (414, 240) 1359065214 -1.7769178718024587 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249667_0.png resize: (250, 159) 1359065215 -1.0940808612600936 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249661_0.png resize: (500, 499) 1359065216 -1.115647865120191 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249675_0.png resize: (98, 320) 1359065217 -0.9311231446048097 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249698_0.png resize: (352, 99) 1359065219 -0.7564912122904363 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249693_0.png resize: (208, 152) 1359065220 -2.7711420517379004 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249681_0.png resize: (236, 161) 1359065221 -1.496267658668164 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249679_0.png resize: (218, 120) 1359065222 -1.1943012791994458 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249683_0.png resize: (213, 201) 1359065224 -1.1494293523767978 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249695_0.png resize: (407, 375) 1359065225 -1.7952640971645877 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249690_0.png resize: (153, 133) 1359065226 1.9568885765729758 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249687_0.png resize: (198, 96) 1359065227 -0.37478927826752145 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249688_0.png resize: (261, 160) 1359065228 -1.2956325191438358 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249678_0.png resize: (258, 95) 1359065229 -1.1526678290017727 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249699_0.png resize: (517, 185) 1359065230 -1.7779129894362244 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249700_0.png resize: (474, 283) 1359065231 -1.7123849935711337 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249707_0.png resize: (471, 341) 1359065232 -1.030359481752594 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249705_0.png resize: (691, 415) 1359065233 -0.10111747401319922 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249701_0.png resize: (282, 246) 1359065234 -0.691543140756482 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249702_0.png resize: (342, 526) 1359065235 -1.1431196330305862 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249708_0.png resize: (465, 420) 1359065236 -0.681497286556066 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249729_0.png resize: (398, 350) 1359065237 -1.5718694967812759 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249714_0.png resize: (210, 169) 1359065238 -1.8782925907848815 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249723_0.png resize: (79, 246) 1359065239 -2.2353422427827883 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249720_0.png resize: (155, 191) 1359065240 -0.5297504927003924 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249718_0.png resize: (212, 134) 1359065241 -0.3229775356430238 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249727_0.png resize: (219, 144) 1359065242 -0.7293229941795629 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249722_0.png resize: (78, 196) 1359065243 -1.1269499765644773 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249724_0.png resize: (114, 128) 1359065244 -0.025720065388369656 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249715_0.png resize: (178, 219) 1359065245 -1.4537464681709993 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249726_0.png resize: (94, 135) 1359065246 -2.9694532958303577 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249731_0.png resize: (394, 243) 1359065247 -1.763316653434652 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249733_0.png resize: (376, 301) 1359065248 -1.8645994777482036 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249734_0.png resize: (161, 143) 1359065249 -2.1417664236773724 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249730_0.png resize: (162, 219) 1359065250 -1.310201781399687 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249735_0.png resize: (189, 134) 1359065251 -0.33590786569000197 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249736_0.png resize: (422, 380) 1359065252 -2.2228729625744306 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249740_0.png resize: (142, 106) 1359065253 0.7713360812567029 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249742_0.png resize: (217, 522) 1359065254 -1.6453973130004018 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249741_0.png resize: (137, 165) 1359065256 1.4227389883463064 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249746_0.png resize: (234, 241) 1359065257 -0.34830805099031154 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249745_0.png resize: (145, 130) 1359065258 -1.308690223766035 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249744_0.png resize: (248, 171) 1359065259 0.30083124372395764 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249751_0.png resize: (152, 198) 1359065260 -0.8753395545488432 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249750_0.png resize: (338, 275) 1359065261 -1.6439930426810636 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249761_0.png resize: (178, 150) 1359065262 -1.389255988116256 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249759_0.png resize: (143, 174) 1359065263 -1.7389764548495272 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249757_0.png resize: (200, 101) 1359065264 -0.552442003191767 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249755_0.png resize: (235, 186) 1359065265 -1.6302209894790336 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249753_0.png resize: (222, 234) 1359065266 -1.249783711745295 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249763_0.png resize: (172, 165) 1359065267 -1.0568654908869066 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249756_0.png resize: (162, 285) 1359065268 -0.7833087891316102 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249760_0.png resize: (232, 169) 1359065269 -1.2967688903050651 treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249768_0.png resize: (327, 285) 1359065270 -0.7515200846821553 treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249770_0.png resize: (266, 373) 1359065271 1.15953990353102 treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249765_0.png resize: (345, 272) 1359065272 0.592471939873939 treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249769_0.png resize: (218, 211) 1359065273 -0.2264313799043737 treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249766_0.png resize: (107, 154) 1359065274 -0.9667546370974717 treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249764_0.png resize: (137, 183) 1359065275 -0.7109195897989086 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249651_0.png resize: (458, 546) 1359065282 -0.3278350394102109 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249677_0.png resize: (348, 425) 1359065283 -1.4886447247120163 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249660_0.png resize: (565, 806) 1359065284 -1.1345728599210838 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249659_0.png resize: (183, 249) 1359065285 -1.0996400478131143 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249676_0.png resize: (192, 145) 1359065286 -0.7312794894596132 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249686_0.png resize: (165, 528) 1359065287 -0.9649976870912121 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249696_0.png resize: (85, 246) 1359065288 -0.9882909195528193 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249684_0.png resize: (80, 229) 1359065289 -0.9319900506234727 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249691_0.png resize: (108, 141) 1359065290 -0.02094239341547224 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249692_0.png resize: (372, 448) 1359065291 -1.6207484834480583 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249709_0.png resize: (479, 303) 1359065292 -1.5487900453048635 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249713_0.png resize: (131, 195) 1359065293 -1.501098868231748 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249704_0.png resize: (773, 900) 1359065294 -0.872041905232375 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249711_0.png resize: (811, 660) 1359065295 -0.45004532418942733 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249716_0.png resize: (114, 157) 1359065296 -0.5334594174311621 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249719_0.png resize: (190, 164) 1359065297 -1.4223653964047522 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249739_0.png resize: (95, 194) 1359065298 0.15728316739328316 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249732_0.png resize: (231, 280) 1359065299 -0.8352879372651413 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249749_0.png resize: (87, 129) 1359065300 -1.7974673118070943 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249752_0.png resize: (150, 267) 1359065301 -1.491141190403538 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249762_0.png resize: (278, 292) 1359065302 -2.6440475888049253 treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249767_0.png resize: (140, 244) 1359065303 -0.96014849037813 treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249771_0.png resize: (219, 230) 1359065304 -0.4655839936330875 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249728_0.png resize: (171, 140) 1359065305 -3.0849266114764595 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249658_0.png resize: (339, 335) 1359065314 -0.949374341336501 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249653_0.png resize: (515, 548) 1359065316 -1.8721002206574067 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249656_0.png resize: (417, 241) 1359065317 0.5072950449847026 treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249649_0.png resize: (284, 364) 1359065318 -1.6784597594548472 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249664_0.png resize: (300, 323) 1359065319 -2.1761950855018517 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249669_0.png resize: (486, 497) 1359065320 -1.3223425021984427 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249668_0.png resize: (467, 173) 1359065322 -3.549128158469043 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249662_0.png resize: (219, 511) 1359065323 -4.303048070140759 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249670_0.png resize: (286, 124) 1359065324 -1.8048274673657916 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249665_0.png resize: (287, 378) 1359065325 -3.2116748279307554 treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249673_0.png resize: (281, 202) 1359065326 -1.8873001989894 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249685_0.png resize: (386, 252) 1359065327 -1.413231520354221 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249697_0.png resize: (213, 230) 1359065328 -2.0491196965393126 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249680_0.png resize: (710, 635) 1359065329 -1.6730494116254984 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249682_0.png resize: (282, 192) 1359065330 -2.1722365280468274 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249689_0.png resize: (521, 356) 1359065331 -0.38234062943401986 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249703_0.png resize: (470, 459) 1359065332 -1.7340348934898546 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249706_0.png resize: (343, 497) 1359065333 -0.8853521902401198 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249710_0.png resize: (203, 131) 1359065334 -1.0305219305207316 treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249712_0.png resize: (399, 255) 1359065335 -0.921274399826449 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249725_0.png resize: (391, 569) 1359065336 -0.7060361842702538 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249721_0.png resize: (388, 449) 1359065337 -1.2226177517716605 treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249717_0.png resize: (212, 375) 1359065338 -0.4839730524891681 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249738_0.png resize: (537, 443) 1359065339 0.7564724276770689 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249747_0.png resize: (343, 149) 1359065340 -1.3084406664135615 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249748_0.png resize: (320, 211) 1359065341 -0.6401306526591622 treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249743_0.png resize: (339, 240) 1359065342 -1.9113316222287275 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249758_0.png resize: (489, 573) 1359065343 -1.5135047868973712 treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249754_0.png resize: (187, 274) 1359065344 -1.505919410307135 treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249737_0.png resize: (124, 96) 1359065345 0.7711166099995059 treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249694_0.png resize: (313, 193) 1359065347 -0.8146485441705321 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 139 time used for this insertion : 0.019985198974609375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 139 time used for this insertion : 0.030050277709960938 save missing photos in datou_result : time spend for datou_step_exec : 32.39051818847656 time spend to save output : 0.061916351318359375 total time spend for step 6 : 32.45243453979492 step7:brightness Fri May 16 22:25:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765.jpg treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919.jpg treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8.jpg treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe.jpg treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af.jpg treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b.jpg treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648.jpg treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2.jpg treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00.jpg treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249648_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249642_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249647_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249654_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249643_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249646_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249644_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249657_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249650_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249655_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249652_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249645_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249671_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249666_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249674_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249663_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249672_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249667_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249661_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249675_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249698_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249693_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249681_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249679_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249683_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249695_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249690_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249687_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249688_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249678_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249699_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249700_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249707_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249705_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249701_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249702_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249708_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249729_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249714_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249723_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249720_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249718_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249727_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249722_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249724_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249715_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249726_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249731_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249733_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249734_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249730_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249735_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249736_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249740_0.png treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249742_0.png treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249741_0.png treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249746_0.png treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249745_0.png treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249744_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249751_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249750_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249761_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249759_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249757_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249755_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249753_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249763_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249756_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249760_0.png treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249768_0.png treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249770_0.png treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249765_0.png treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249769_0.png treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249766_0.png treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249764_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249651_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249677_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249660_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249659_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249676_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249686_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249696_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249684_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249691_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249692_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249709_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249713_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249704_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249711_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249716_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249719_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249739_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249732_0.png treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249749_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249752_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249762_0.png treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249767_0.png treat image : temp/1747426828_1898338_1359027177_7e7021a579d1428aadb3c00aace6ec00_rle_crop_3802249771_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249728_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249658_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249653_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249656_0.png treat image : temp/1747426828_1898338_1359027357_712d6c95ae6dddfa919c52c97d3c2765_rle_crop_3802249649_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249664_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249669_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249668_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249662_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249670_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249665_0.png treat image : temp/1747426828_1898338_1359027352_9cd880f4a321f71a93fa8fc2983b3919_rle_crop_3802249673_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249685_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249697_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249680_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249682_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249689_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249703_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249706_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249710_0.png treat image : temp/1747426828_1898338_1359027337_381450fd3cab80ed1efdcc3a9ab461fe_rle_crop_3802249712_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249725_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249721_0.png treat image : temp/1747426828_1898338_1359027332_c0073d54f1125c0578e5cb4fb49e53af_rle_crop_3802249717_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249738_0.png treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249747_0.png treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249748_0.png treat image : temp/1747426828_1898338_1359027185_e2adc9f646fb6bc349adff04ca058648_rle_crop_3802249743_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249758_0.png treat image : temp/1747426828_1898338_1359027181_f5cfb56f0eb247529401e057b10854f2_rle_crop_3802249754_0.png treat image : temp/1747426828_1898338_1359027328_a1d22f8897cd221660e283fbcc7a658b_rle_crop_3802249737_0.png treat image : temp/1747426828_1898338_1359027343_f69c87accb49b43e6eadff6ef1d61fc8_rle_crop_3802249694_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 139 time used for this insertion : 0.017816543579101562 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 139 time used for this insertion : 0.02811431884765625 save missing photos in datou_result : time spend for datou_step_exec : 8.778329133987427 time spend to save output : 0.05184769630432129 total time spend for step 7 : 8.830176830291748 step8:velours_tree Fri May 16 22:25:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.16629362106323242 time spend to save output : 3.814697265625e-05 total time spend for step 8 : 0.16633176803588867 step9:send_mail_cod Fri May 16 22:25:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23082895_16-05-2025_22_25_15.pdf 23083675 imagette230836751747427115 23083676 change filename to text .imagette230836761747427115 23083677 change filename to text .imagette230836771747427115 23083679 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230836791747427115 23083680 imagette230836801747427116 23083681 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230836811747427116 23083682 change filename to text .imagette230836821747427118 23083683 imagette230836831747427118 23083684 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230836841747427118 23083685 imagette230836851747427119 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23082895 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23083675,23083676,23083677,23083678,23083679,23083680,23083681,23083682,23083683,23083684,23083685?tags=flou,autre,pehd,environnement,carton,background,papier,metal,pet_fonce,pet_clair,mal_croppe args[1359027357] : ((1359027357, 3.0850900207847847, 492688767), (1359027357, -0.20616016259159653, 496442774), '0.12590134047446142') We are sending mail with results at report@fotonower.com args[1359027352] : ((1359027352, -1.9452738361698674, 492688767), (1359027352, -0.1489529680762686, 496442774), '0.12590134047446142') We are sending mail with results at report@fotonower.com args[1359027343] : ((1359027343, -1.086746884327174, 492688767), (1359027343, 0.07250614643871763, 2107752395), '0.12590134047446142') We are sending mail with results at report@fotonower.com args[1359027337] : ((1359027337, -0.14713987127909825, 492688767), (1359027337, -0.04359429709224295, 2107752395), '0.12590134047446142') We are sending mail with results at report@fotonower.com args[1359027332] : ((1359027332, -2.2578109912941264, 492609224), (1359027332, 0.1055408444741707, 2107752395), '0.12590134047446142') We are sending mail with results at report@fotonower.com args[1359027328] : ((1359027328, -0.6929400066330748, 492688767), (1359027328, -0.12457095825469165, 496442774), '0.12590134047446142') We are sending mail with results at report@fotonower.com args[1359027185] : ((1359027185, 1.0543584712421978, 492688767), (1359027185, 0.2595654454663301, 2107752395), '0.12590134047446142') We are sending mail with results at report@fotonower.com args[1359027181] : ((1359027181, -1.6560928389645027, 492688767), (1359027181, 0.008298735701798107, 2107752395), '0.12590134047446142') We are sending mail with results at report@fotonower.com args[1359027177] : ((1359027177, -1.2158106455798787, 492688767), (1359027177, 0.3618546089395548, 2107752395), '0.12590134047446142') We are sending mail with results at report@fotonower.com refus_total : 0.12590134047446142 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23082895 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23082895_16-05-2025_22_25_15.pdf results_Auto_P23082895_16-05-2025_22_25_15.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23082895_16-05-2025_22_25_15.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23082895','results_Auto_P23082895_16-05-2025_22_25_15.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23082895_16-05-2025_22_25_15.pdf','pdf','','0.66','0.12590134047446142') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23082895

https://www.fotonower.com/image?json=false&list_photos_id=1359027357
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.0850900207847847)
https://www.fotonower.com/image?json=false&list_photos_id=1359027352
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027343
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027337
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027332
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027328
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027185
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0543584712421978)
https://www.fotonower.com/image?json=false&list_photos_id=1359027181
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027177
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.59%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/23083676?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/23083677?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23083679?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23083681?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23083682?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23083684?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23082895_16-05-2025_22_25_15.pdf.

Lien vers velours :https://www.fotonower.com/velours/23083675,23083676,23083677,23083678,23083679,23083680,23083681,23083682,23083683,23083684,23083685?tags=flou,autre,pehd,environnement,carton,background,papier,metal,pet_fonce,pet_clair,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 16 May 2025 20:25:22 GMT Content-Length: 0 Connection: close X-Message-Id: jhhq2hyZTgGN7vE2PT255g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359027357, 1359027352, 1359027343, 1359027337, 1359027332, 1359027328, 1359027185, 1359027181, 1359027177] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027357', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027352', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027343', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027337', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027332', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027328', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027185', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027181', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027177', None, None, None, None, None, '2884880') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01512455940246582 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.677778720855713 time spend to save output : 0.015318155288696289 total time spend for step 9 : 7.693096876144409 step10:split_time_score Fri May 16 22:25:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16052025 23082895 Nombre de photos uploadées : 9 / 23040 (0%) 16052025 23082895 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 16052025 23082895 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 8.821487426757812e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005533695220947266 elapsed_time : insert_dashboard_record_day_entry 0.02304553985595703 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14479838468426087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23051725_16-05-2025_08_40_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23051725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23051725 AND mptpi.`type`=3594 To do Qualite : 0.13390745090474465 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23054180_16-05-2025_09_19_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23054180 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23054180 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23055818 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23054189 order by id desc limit 1 Qualite : 0.15347928196928026 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23054191_16-05-2025_09_14_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23054191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23054191 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23063142 order by id desc limit 1 Qualite : 0.09279373231738683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23063143_16-05-2025_13_36_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23063143 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23063143 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077270 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077275 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077279 order by id desc limit 1 Qualite : 0.16052945457433812 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23077284_16-05-2025_19_09_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077284 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23077284 AND mptpi.`type`=3594 To do Qualite : 0.10575585925999524 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23077287_16-05-2025_19_14_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077287 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23077287 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23082890 order by id desc limit 1 Qualite : 0.12590134047446142 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23082895_16-05-2025_22_25_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23082895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23082895 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23082899 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359027357, 1359027352, 1359027343, 1359027337, 1359027332, 1359027328, 1359027185, 1359027181, 1359027177] Looping around the photos to save general results len do output : 1 /23082895Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027357', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027352', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027343', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027337', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027332', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027328', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027185', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027181', None, None, None, None, None, '2884880') ('3318', None, None, None, None, None, None, None, '2884880') ('3318', '23082895', '1359027177', None, None, None, None, None, '2884880') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013536214828491211 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.589609384536743 time spend to save output : 0.013777732849121094 total time spend for step 10 : 8.603387117385864 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 125.94user 129.79system 5:06.41elapsed 83%CPU (0avgtext+0avgdata 4892732maxresident)k 559128inputs+77736outputs (4692major+12345051minor)pagefaults 0swaps