python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2364654 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3659209'] with mtr_portfolio_ids : ['26492294'] and first list_photo_ids : [] new path : /proc/2364654/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.926839828491211 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Sep 3 15:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10601 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-03 15:40:34.765347: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-03 15:40:34.792885: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-03 15:40:34.794944: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd71c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-03 15:40:34.794977: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-03 15:40:34.799529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-03 15:40:34.951764: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x149f3d50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-03 15:40:34.951833: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-03 15:40:34.953144: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-03 15:40:34.953637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 15:40:34.956957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 15:40:34.960143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-03 15:40:34.960688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-03 15:40:34.963234: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-03 15:40:34.964482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-03 15:40:34.969520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 15:40:34.971112: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-03 15:40:34.971194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 15:40:34.972099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-03 15:40:34.972117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-03 15:40:34.972126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-03 15:40:34.973893: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9532 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-03 15:40:35.374085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-03 15:40:35.374201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 15:40:35.374235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 15:40:35.374262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-03 15:40:35.374291: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-03 15:40:35.374319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-03 15:40:35.374345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-03 15:40:35.374374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 15:40:35.376149: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-03 15:40:35.378153: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-03 15:40:35.378254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 15:40:35.378284: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 15:40:35.378313: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-03 15:40:35.378342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-03 15:40:35.378370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-03 15:40:35.378397: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-03 15:40:35.378425: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 15:40:35.380231: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-03 15:40:35.380281: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-03 15:40:35.380297: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-03 15:40:35.380311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-03 15:40:35.381746: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9532 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-03 15:40:46.667383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 15:40:46.995902: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 15:40:49.096359: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.114117: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.114665: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.115211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.115764: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.116284: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.116839: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.116876: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.117424: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.117439: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.123519: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.123541: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.124076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.124091: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.134030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.134068: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.134609: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.134624: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.160153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.160182: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.160737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.160753: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.166057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.166078: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.166612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.166626: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-03 15:40:49.199658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.200254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.201892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.202438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.238303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.238876: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.240903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.241453: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.266157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.266712: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.268196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.268831: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.275819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.276403: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.278023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.278565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.284647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.285201: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.286720: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.287265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.316363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.316924: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.317469: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.318016: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.322091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.322659: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.338981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.339545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.340093: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.340665: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.354030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.354615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.355173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.355725: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.361160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.361738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.366306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.366859: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.378982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.379580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.383805: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.384409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.384983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.385538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.386814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.387376: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.397878: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.398434: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.399043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.399626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.400176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.400738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.401282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.401824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.412813: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.413425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.419778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.420334: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.480091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.480161: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-03 15:40:49.481115: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.482058: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.489391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.490351: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.491257: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.492180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.500811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.501660: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.530622: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.531391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.532117: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.532860: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.536866: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.537407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.537939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.538483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.539873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.549630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.550173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.559174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.559722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.560270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.560831: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.561383: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-03 15:40:49.561922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 Detection mask done ! Trying to reset tf kernel 2365215 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9405 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10601 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.005517244338989258 nb_pixel_total : 160194 time to create 1 rle with new method : 0.007981061935424805 length of segment : 499 time for calcul the mask position with numpy : 0.002652406692504883 nb_pixel_total : 139641 time to create 1 rle with old method : 0.15704035758972168 length of segment : 609 time for calcul the mask position with numpy : 0.0010294914245605469 nb_pixel_total : 34933 time to create 1 rle with old method : 0.04041695594787598 length of segment : 159 time for calcul the mask position with numpy : 0.0005609989166259766 nb_pixel_total : 32933 time to create 1 rle with old method : 0.039244651794433594 length of segment : 250 time for calcul the mask position with numpy : 0.0026416778564453125 nb_pixel_total : 122382 time to create 1 rle with old method : 0.13828301429748535 length of segment : 954 time for calcul the mask position with numpy : 0.0005819797515869141 nb_pixel_total : 19306 time to create 1 rle with old method : 0.022171497344970703 length of segment : 326 time for calcul the mask position with numpy : 0.0004451274871826172 nb_pixel_total : 11015 time to create 1 rle with old method : 0.012532234191894531 length of segment : 121 time for calcul the mask position with numpy : 0.0012362003326416016 nb_pixel_total : 61472 time to create 1 rle with old method : 0.09552550315856934 length of segment : 336 time for calcul the mask position with numpy : 0.0027191638946533203 nb_pixel_total : 99623 time to create 1 rle with old method : 0.11665916442871094 length of segment : 344 time for calcul the mask position with numpy : 0.02547764778137207 nb_pixel_total : 632123 time to create 1 rle with new method : 0.09298086166381836 length of segment : 1224 time for calcul the mask position with numpy : 0.003728628158569336 nb_pixel_total : 141241 time to create 1 rle with old method : 0.1602625846862793 length of segment : 400 time for calcul the mask position with numpy : 0.0007903575897216797 nb_pixel_total : 42763 time to create 1 rle with old method : 0.04651379585266113 length of segment : 316 time for calcul the mask position with numpy : 0.0002231597900390625 nb_pixel_total : 10779 time to create 1 rle with old method : 0.012902259826660156 length of segment : 118 time for calcul the mask position with numpy : 0.0018978118896484375 nb_pixel_total : 54913 time to create 1 rle with old method : 0.06048393249511719 length of segment : 316 time for calcul the mask position with numpy : 0.0014541149139404297 nb_pixel_total : 111071 time to create 1 rle with old method : 0.1269848346710205 length of segment : 406 time for calcul the mask position with numpy : 0.0014202594757080078 nb_pixel_total : 83564 time to create 1 rle with old method : 0.0941457748413086 length of segment : 423 time for calcul the mask position with numpy : 0.0002415180206298828 nb_pixel_total : 9588 time to create 1 rle with old method : 0.011199712753295898 length of segment : 113 time for calcul the mask position with numpy : 0.001180410385131836 nb_pixel_total : 50121 time to create 1 rle with old method : 0.058898210525512695 length of segment : 279 time for calcul the mask position with numpy : 0.004122257232666016 nb_pixel_total : 207127 time to create 1 rle with new method : 0.01265096664428711 length of segment : 637 time for calcul the mask position with numpy : 0.0008502006530761719 nb_pixel_total : 51443 time to create 1 rle with old method : 0.05932474136352539 length of segment : 200 time for calcul the mask position with numpy : 0.0009317398071289062 nb_pixel_total : 47637 time to create 1 rle with old method : 0.05486702919006348 length of segment : 286 time for calcul the mask position with numpy : 0.0006036758422851562 nb_pixel_total : 36400 time to create 1 rle with old method : 0.04491162300109863 length of segment : 420 time for calcul the mask position with numpy : 0.0027637481689453125 nb_pixel_total : 196694 time to create 1 rle with new method : 0.007249593734741211 length of segment : 525 time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 15437 time to create 1 rle with old method : 0.017956972122192383 length of segment : 142 time for calcul the mask position with numpy : 0.002088308334350586 nb_pixel_total : 99970 time to create 1 rle with old method : 0.11725211143493652 length of segment : 459 time for calcul the mask position with numpy : 0.0008482933044433594 nb_pixel_total : 36934 time to create 1 rle with old method : 0.04111289978027344 length of segment : 301 time for calcul the mask position with numpy : 0.0006375312805175781 nb_pixel_total : 32627 time to create 1 rle with old method : 0.035764455795288086 length of segment : 377 time for calcul the mask position with numpy : 0.0005650520324707031 nb_pixel_total : 20163 time to create 1 rle with old method : 0.022184133529663086 length of segment : 173 time for calcul the mask position with numpy : 0.0008866786956787109 nb_pixel_total : 67722 time to create 1 rle with old method : 0.07760357856750488 length of segment : 312 time for calcul the mask position with numpy : 0.0012907981872558594 nb_pixel_total : 73960 time to create 1 rle with old method : 0.08298993110656738 length of segment : 302 time for calcul the mask position with numpy : 0.001127481460571289 nb_pixel_total : 24963 time to create 1 rle with old method : 0.028475522994995117 length of segment : 456 time for calcul the mask position with numpy : 0.00084686279296875 nb_pixel_total : 16157 time to create 1 rle with old method : 0.017863750457763672 length of segment : 193 time for calcul the mask position with numpy : 0.0008332729339599609 nb_pixel_total : 23738 time to create 1 rle with old method : 0.029044389724731445 length of segment : 114 time for calcul the mask position with numpy : 0.0014562606811523438 nb_pixel_total : 121193 time to create 1 rle with old method : 0.13613653182983398 length of segment : 316 time for calcul the mask position with numpy : 0.0006194114685058594 nb_pixel_total : 17995 time to create 1 rle with old method : 0.020000457763671875 length of segment : 152 time for calcul the mask position with numpy : 0.002383708953857422 nb_pixel_total : 71251 time to create 1 rle with old method : 0.07781052589416504 length of segment : 402 time for calcul the mask position with numpy : 0.00033473968505859375 nb_pixel_total : 8837 time to create 1 rle with old method : 0.010266780853271484 length of segment : 119 time for calcul the mask position with numpy : 0.0013234615325927734 nb_pixel_total : 42966 time to create 1 rle with old method : 0.05091667175292969 length of segment : 305 time for calcul the mask position with numpy : 0.0010685920715332031 nb_pixel_total : 23779 time to create 1 rle with old method : 0.025722742080688477 length of segment : 367 time for calcul the mask position with numpy : 0.003024578094482422 nb_pixel_total : 128754 time to create 1 rle with old method : 0.14528322219848633 length of segment : 352 time for calcul the mask position with numpy : 0.002057313919067383 nb_pixel_total : 61391 time to create 1 rle with old method : 0.06751275062561035 length of segment : 319 time for calcul the mask position with numpy : 0.0018024444580078125 nb_pixel_total : 70146 time to create 1 rle with old method : 0.0769968032836914 length of segment : 432 time for calcul the mask position with numpy : 0.0009758472442626953 nb_pixel_total : 30469 time to create 1 rle with old method : 0.034357547760009766 length of segment : 209 time for calcul the mask position with numpy : 0.0012505054473876953 nb_pixel_total : 35612 time to create 1 rle with old method : 0.0392606258392334 length of segment : 231 time for calcul the mask position with numpy : 0.0006308555603027344 nb_pixel_total : 18126 time to create 1 rle with old method : 0.020982742309570312 length of segment : 147 time for calcul the mask position with numpy : 0.0006237030029296875 nb_pixel_total : 15166 time to create 1 rle with old method : 0.01768779754638672 length of segment : 147 time for calcul the mask position with numpy : 0.001085042953491211 nb_pixel_total : 43268 time to create 1 rle with old method : 0.04992055892944336 length of segment : 171 time for calcul the mask position with numpy : 0.0010237693786621094 nb_pixel_total : 21719 time to create 1 rle with old method : 0.02478790283203125 length of segment : 216 time for calcul the mask position with numpy : 0.003542661666870117 nb_pixel_total : 106282 time to create 1 rle with old method : 0.11701345443725586 length of segment : 645 time for calcul the mask position with numpy : 0.0011074542999267578 nb_pixel_total : 39588 time to create 1 rle with old method : 0.04420208930969238 length of segment : 176 time for calcul the mask position with numpy : 0.001392364501953125 nb_pixel_total : 44976 time to create 1 rle with old method : 0.048651695251464844 length of segment : 402 time for calcul the mask position with numpy : 0.0017960071563720703 nb_pixel_total : 79592 time to create 1 rle with old method : 0.08801412582397461 length of segment : 379 time for calcul the mask position with numpy : 0.005975008010864258 nb_pixel_total : 192727 time to create 1 rle with new method : 0.01818537712097168 length of segment : 680 time for calcul the mask position with numpy : 0.0005764961242675781 nb_pixel_total : 19809 time to create 1 rle with old method : 0.022783756256103516 length of segment : 93 time for calcul the mask position with numpy : 0.0015785694122314453 nb_pixel_total : 55722 time to create 1 rle with old method : 0.07698440551757812 length of segment : 283 time for calcul the mask position with numpy : 0.0010030269622802734 nb_pixel_total : 28755 time to create 1 rle with old method : 0.03448796272277832 length of segment : 253 time for calcul the mask position with numpy : 0.0010159015655517578 nb_pixel_total : 28860 time to create 1 rle with old method : 0.03430318832397461 length of segment : 225 time for calcul the mask position with numpy : 0.002096414566040039 nb_pixel_total : 57508 time to create 1 rle with old method : 0.07052874565124512 length of segment : 416 time for calcul the mask position with numpy : 0.005987882614135742 nb_pixel_total : 179074 time to create 1 rle with new method : 0.014098167419433594 length of segment : 913 time for calcul the mask position with numpy : 0.002230405807495117 nb_pixel_total : 73601 time to create 1 rle with old method : 0.08689403533935547 length of segment : 479 time for calcul the mask position with numpy : 0.00575566291809082 nb_pixel_total : 154995 time to create 1 rle with new method : 0.008829355239868164 length of segment : 584 time for calcul the mask position with numpy : 0.003559112548828125 nb_pixel_total : 112563 time to create 1 rle with old method : 0.12665486335754395 length of segment : 335 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 20666 time to create 1 rle with old method : 0.02765631675720215 length of segment : 210 time for calcul the mask position with numpy : 0.002228260040283203 nb_pixel_total : 132467 time to create 1 rle with old method : 0.15027880668640137 length of segment : 326 time for calcul the mask position with numpy : 0.001691579818725586 nb_pixel_total : 51454 time to create 1 rle with old method : 0.05925440788269043 length of segment : 316 time for calcul the mask position with numpy : 0.0051403045654296875 nb_pixel_total : 142395 time to create 1 rle with old method : 0.1592254638671875 length of segment : 514 time for calcul the mask position with numpy : 0.14320039749145508 nb_pixel_total : 1016888 time to create 1 rle with new method : 0.08838987350463867 length of segment : 1530 time for calcul the mask position with numpy : 0.0013537406921386719 nb_pixel_total : 98473 time to create 1 rle with old method : 0.10805225372314453 length of segment : 504 time for calcul the mask position with numpy : 0.0004239082336425781 nb_pixel_total : 9268 time to create 1 rle with old method : 0.010610580444335938 length of segment : 98 time for calcul the mask position with numpy : 0.0019392967224121094 nb_pixel_total : 56625 time to create 1 rle with old method : 0.06958770751953125 length of segment : 293 time for calcul the mask position with numpy : 0.0011603832244873047 nb_pixel_total : 21688 time to create 1 rle with old method : 0.024298906326293945 length of segment : 316 time for calcul the mask position with numpy : 0.0005636215209960938 nb_pixel_total : 16490 time to create 1 rle with old method : 0.018466949462890625 length of segment : 135 time for calcul the mask position with numpy : 0.0005047321319580078 nb_pixel_total : 11530 time to create 1 rle with old method : 0.01288914680480957 length of segment : 155 time for calcul the mask position with numpy : 0.0010437965393066406 nb_pixel_total : 25732 time to create 1 rle with old method : 0.028683900833129883 length of segment : 265 time for calcul the mask position with numpy : 0.00028824806213378906 nb_pixel_total : 10073 time to create 1 rle with old method : 0.011061668395996094 length of segment : 111 time for calcul the mask position with numpy : 0.003810405731201172 nb_pixel_total : 113758 time to create 1 rle with old method : 0.12395596504211426 length of segment : 308 time for calcul the mask position with numpy : 0.002766132354736328 nb_pixel_total : 102986 time to create 1 rle with old method : 0.11715292930603027 length of segment : 265 time for calcul the mask position with numpy : 0.0005724430084228516 nb_pixel_total : 17631 time to create 1 rle with old method : 0.01949930191040039 length of segment : 157 time for calcul the mask position with numpy : 0.0019903182983398438 nb_pixel_total : 57336 time to create 1 rle with old method : 0.06293272972106934 length of segment : 513 time for calcul the mask position with numpy : 0.0009694099426269531 nb_pixel_total : 31592 time to create 1 rle with old method : 0.03440999984741211 length of segment : 189 time for calcul the mask position with numpy : 0.0040128231048583984 nb_pixel_total : 108296 time to create 1 rle with old method : 0.11776185035705566 length of segment : 727 time for calcul the mask position with numpy : 0.003162860870361328 nb_pixel_total : 121849 time to create 1 rle with old method : 0.13241052627563477 length of segment : 492 time for calcul the mask position with numpy : 0.0010149478912353516 nb_pixel_total : 37509 time to create 1 rle with old method : 0.04353523254394531 length of segment : 230 time for calcul the mask position with numpy : 0.0011248588562011719 nb_pixel_total : 48057 time to create 1 rle with old method : 0.05875134468078613 length of segment : 179 time for calcul the mask position with numpy : 0.0008609294891357422 nb_pixel_total : 41865 time to create 1 rle with old method : 0.0457763671875 length of segment : 278 time for calcul the mask position with numpy : 0.0005006790161132812 nb_pixel_total : 19976 time to create 1 rle with old method : 0.025139570236206055 length of segment : 153 time for calcul the mask position with numpy : 0.002021312713623047 nb_pixel_total : 90824 time to create 1 rle with old method : 0.10867500305175781 length of segment : 485 time for calcul the mask position with numpy : 0.0023195743560791016 nb_pixel_total : 163332 time to create 1 rle with new method : 0.0045435428619384766 length of segment : 485 time for calcul the mask position with numpy : 0.002526521682739258 nb_pixel_total : 118965 time to create 1 rle with old method : 0.1299576759338379 length of segment : 464 time for calcul the mask position with numpy : 0.0010352134704589844 nb_pixel_total : 46417 time to create 1 rle with old method : 0.051412343978881836 length of segment : 324 time for calcul the mask position with numpy : 0.0008456707000732422 nb_pixel_total : 44353 time to create 1 rle with old method : 0.050246238708496094 length of segment : 317 time for calcul the mask position with numpy : 0.00038909912109375 nb_pixel_total : 9367 time to create 1 rle with old method : 0.011422395706176758 length of segment : 119 time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 18747 time to create 1 rle with old method : 0.0207211971282959 length of segment : 144 time for calcul the mask position with numpy : 0.004604339599609375 nb_pixel_total : 223477 time to create 1 rle with new method : 0.008913755416870117 length of segment : 566 time for calcul the mask position with numpy : 0.0023593902587890625 nb_pixel_total : 109617 time to create 1 rle with old method : 0.12592744827270508 length of segment : 318 time for calcul the mask position with numpy : 0.0014872550964355469 nb_pixel_total : 59436 time to create 1 rle with old method : 0.06607770919799805 length of segment : 315 time for calcul the mask position with numpy : 0.005189418792724609 nb_pixel_total : 160573 time to create 1 rle with new method : 0.010043621063232422 length of segment : 527 time for calcul the mask position with numpy : 0.001157999038696289 nb_pixel_total : 44555 time to create 1 rle with old method : 0.04949212074279785 length of segment : 294 time for calcul the mask position with numpy : 0.00031447410583496094 nb_pixel_total : 14059 time to create 1 rle with old method : 0.01546931266784668 length of segment : 146 time for calcul the mask position with numpy : 0.0015599727630615234 nb_pixel_total : 44775 time to create 1 rle with old method : 0.0487980842590332 length of segment : 481 time for calcul the mask position with numpy : 0.0009679794311523438 nb_pixel_total : 42851 time to create 1 rle with old method : 0.04759478569030762 length of segment : 303 time for calcul the mask position with numpy : 0.0011560916900634766 nb_pixel_total : 57181 time to create 1 rle with old method : 0.06363201141357422 length of segment : 304 time for calcul the mask position with numpy : 0.0011446475982666016 nb_pixel_total : 61210 time to create 1 rle with old method : 0.06678533554077148 length of segment : 337 time for calcul the mask position with numpy : 0.0010704994201660156 nb_pixel_total : 15264 time to create 1 rle with old method : 0.017538785934448242 length of segment : 237 time for calcul the mask position with numpy : 0.0011713504791259766 nb_pixel_total : 39025 time to create 1 rle with old method : 0.04541921615600586 length of segment : 350 time for calcul the mask position with numpy : 0.0014913082122802734 nb_pixel_total : 52991 time to create 1 rle with old method : 0.05842185020446777 length of segment : 298 time for calcul the mask position with numpy : 0.0010788440704345703 nb_pixel_total : 57185 time to create 1 rle with old method : 0.06329178810119629 length of segment : 244 time for calcul the mask position with numpy : 0.003967761993408203 nb_pixel_total : 208052 time to create 1 rle with new method : 0.007100105285644531 length of segment : 673 time for calcul the mask position with numpy : 0.0005860328674316406 nb_pixel_total : 25372 time to create 1 rle with old method : 0.028107404708862305 length of segment : 151 time for calcul the mask position with numpy : 0.0021479129791259766 nb_pixel_total : 88842 time to create 1 rle with old method : 0.09684228897094727 length of segment : 507 time for calcul the mask position with numpy : 0.014160871505737305 nb_pixel_total : 304116 time to create 1 rle with new method : 0.05297422409057617 length of segment : 2135 time for calcul the mask position with numpy : 0.0011525154113769531 nb_pixel_total : 27490 time to create 1 rle with old method : 0.031141996383666992 length of segment : 190 time for calcul the mask position with numpy : 0.003785371780395508 nb_pixel_total : 150865 time to create 1 rle with new method : 0.0050258636474609375 length of segment : 324 time for calcul the mask position with numpy : 0.0009229183197021484 nb_pixel_total : 33291 time to create 1 rle with old method : 0.036869049072265625 length of segment : 194 time for calcul the mask position with numpy : 0.0007374286651611328 nb_pixel_total : 18567 time to create 1 rle with old method : 0.026255369186401367 length of segment : 142 time for calcul the mask position with numpy : 0.0006961822509765625 nb_pixel_total : 15421 time to create 1 rle with old method : 0.017519712448120117 length of segment : 218 time for calcul the mask position with numpy : 0.0007746219635009766 nb_pixel_total : 27944 time to create 1 rle with old method : 0.03159070014953613 length of segment : 190 time for calcul the mask position with numpy : 0.0011305809020996094 nb_pixel_total : 32358 time to create 1 rle with old method : 0.036048173904418945 length of segment : 231 time for calcul the mask position with numpy : 0.0006318092346191406 nb_pixel_total : 16889 time to create 1 rle with old method : 0.01953744888305664 length of segment : 164 time for calcul the mask position with numpy : 0.000652313232421875 nb_pixel_total : 16878 time to create 1 rle with old method : 0.019284725189208984 length of segment : 161 time for calcul the mask position with numpy : 0.0006945133209228516 nb_pixel_total : 21825 time to create 1 rle with old method : 0.024790287017822266 length of segment : 229 time for calcul the mask position with numpy : 0.004041433334350586 nb_pixel_total : 125190 time to create 1 rle with old method : 0.16432476043701172 length of segment : 471 time for calcul the mask position with numpy : 0.0011050701141357422 nb_pixel_total : 32197 time to create 1 rle with old method : 0.03712105751037598 length of segment : 193 time for calcul the mask position with numpy : 0.003771066665649414 nb_pixel_total : 118114 time to create 1 rle with old method : 0.13718748092651367 length of segment : 553 time for calcul the mask position with numpy : 0.0012638568878173828 nb_pixel_total : 22434 time to create 1 rle with old method : 0.0243988037109375 length of segment : 253 time for calcul the mask position with numpy : 0.0021958351135253906 nb_pixel_total : 72482 time to create 1 rle with old method : 0.07937359809875488 length of segment : 542 time for calcul the mask position with numpy : 0.0006375312805175781 nb_pixel_total : 16895 time to create 1 rle with old method : 0.019347190856933594 length of segment : 132 time for calcul the mask position with numpy : 0.002170562744140625 nb_pixel_total : 59035 time to create 1 rle with old method : 0.06588363647460938 length of segment : 260 time for calcul the mask position with numpy : 0.0006668567657470703 nb_pixel_total : 9062 time to create 1 rle with old method : 0.010188102722167969 length of segment : 109 time for calcul the mask position with numpy : 0.0007841587066650391 nb_pixel_total : 19546 time to create 1 rle with old method : 0.022469520568847656 length of segment : 144 time for calcul the mask position with numpy : 0.0013189315795898438 nb_pixel_total : 32949 time to create 1 rle with old method : 0.03767538070678711 length of segment : 164 time for calcul the mask position with numpy : 0.0027387142181396484 nb_pixel_total : 61118 time to create 1 rle with old method : 0.07259082794189453 length of segment : 278 time for calcul the mask position with numpy : 0.0041315555572509766 nb_pixel_total : 99716 time to create 1 rle with old method : 0.11213088035583496 length of segment : 426 time for calcul the mask position with numpy : 0.005864381790161133 nb_pixel_total : 105904 time to create 1 rle with old method : 0.1155996322631836 length of segment : 500 time for calcul the mask position with numpy : 0.0015060901641845703 nb_pixel_total : 41099 time to create 1 rle with old method : 0.04520869255065918 length of segment : 237 time for calcul the mask position with numpy : 0.0027434825897216797 nb_pixel_total : 101420 time to create 1 rle with old method : 0.1115579605102539 length of segment : 444 time for calcul the mask position with numpy : 0.0014522075653076172 nb_pixel_total : 41460 time to create 1 rle with old method : 0.0482478141784668 length of segment : 265 time for calcul the mask position with numpy : 0.009946584701538086 nb_pixel_total : 346152 time to create 1 rle with new method : 0.13315129280090332 length of segment : 741 time for calcul the mask position with numpy : 0.0016090869903564453 nb_pixel_total : 46405 time to create 1 rle with old method : 0.0523073673248291 length of segment : 238 time for calcul the mask position with numpy : 0.0005109310150146484 nb_pixel_total : 17308 time to create 1 rle with old method : 0.019403696060180664 length of segment : 140 time for calcul the mask position with numpy : 0.0013034343719482422 nb_pixel_total : 35515 time to create 1 rle with old method : 0.04073977470397949 length of segment : 361 time for calcul the mask position with numpy : 0.0016796588897705078 nb_pixel_total : 54293 time to create 1 rle with old method : 0.0590972900390625 length of segment : 348 time for calcul the mask position with numpy : 0.0015254020690917969 nb_pixel_total : 51450 time to create 1 rle with old method : 0.06244683265686035 length of segment : 219 time for calcul the mask position with numpy : 0.0014505386352539062 nb_pixel_total : 44365 time to create 1 rle with old method : 0.048229217529296875 length of segment : 291 time for calcul the mask position with numpy : 0.0020041465759277344 nb_pixel_total : 55830 time to create 1 rle with old method : 0.06092429161071777 length of segment : 492 time for calcul the mask position with numpy : 0.004608631134033203 nb_pixel_total : 202374 time to create 1 rle with new method : 0.006439685821533203 length of segment : 622 time for calcul the mask position with numpy : 0.0014963150024414062 nb_pixel_total : 50013 time to create 1 rle with old method : 0.056104421615600586 length of segment : 282 time for calcul the mask position with numpy : 0.0011968612670898438 nb_pixel_total : 36721 time to create 1 rle with old method : 0.04178810119628906 length of segment : 311 time for calcul the mask position with numpy : 0.0011479854583740234 nb_pixel_total : 59564 time to create 1 rle with old method : 0.06482982635498047 length of segment : 408 time spent for convertir_results : 17.710519313812256 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 149 chid ids of type : 3594 Number RLEs to save : 52093 save missing photos in datou_result : time spend for datou_step_exec : 93.05413937568665 time spend to save output : 2.8305130004882812 total time spend for step 1 : 95.88465237617493 step2:crop_condition Wed Sep 3 15:42:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 149 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 102 About to insert : list_path_to_insert length 102 new photo from crops ! About to upload 102 photos upload in portfolio : 3736932 init cache_photo without model_param we have 102 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756906963_2364654 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 102 photos in the portfolio 3736932 time of upload the photos Elapsed time : 27.105704069137573 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756906992_2364654 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2901849746704102 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756907009_2364654 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.816635370254517 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756907021_2364654 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.448850393295288 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756907024_2364654 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6695752143859863 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1381125730, 1381125685, 1381125655, 1381125619, 1381125539, 1381124882, 1381124823, 1381124766, 1381124700, 1381124579, 1381123908] Looping around the photos to save general results len do output : 149 /1381132791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381132999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381133000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381133001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381133009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125730', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125685', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125655', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125619', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125539', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124882', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124823', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124766', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124700', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124579', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381123908', None, None, None, None, None, '3659209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 458 time used for this insertion : 0.03082752227783203 save_final save missing photos in datou_result : time spend for datou_step_exec : 97.15934324264526 time spend to save output : 0.03497505187988281 total time spend for step 2 : 97.19431829452515 step3:rle_unique_nms_with_priority Wed Sep 3 15:43:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 149 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 9.693103075027466 time for calcul the mask position with numpy : 0.31624698638916016 nb_pixel_total : 6010275 time to create 1 rle with new method : 0.6665639877319336 time for calcul the mask position with numpy : 0.024901151657104492 nb_pixel_total : 196694 time to create 1 rle with new method : 0.49054551124572754 time for calcul the mask position with numpy : 0.025588274002075195 nb_pixel_total : 14871 time to create 1 rle with old method : 0.018512248992919922 time for calcul the mask position with numpy : 0.02473592758178711 nb_pixel_total : 47626 time to create 1 rle with old method : 0.051299333572387695 time for calcul the mask position with numpy : 0.026291608810424805 nb_pixel_total : 51443 time to create 1 rle with old method : 0.05732250213623047 time for calcul the mask position with numpy : 0.02563023567199707 nb_pixel_total : 207105 time to create 1 rle with new method : 0.525341272354126 time for calcul the mask position with numpy : 0.02508234977722168 nb_pixel_total : 50121 time to create 1 rle with old method : 0.056932687759399414 time for calcul the mask position with numpy : 0.024826526641845703 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0012624263763427734 time for calcul the mask position with numpy : 0.02455282211303711 nb_pixel_total : 83564 time to create 1 rle with old method : 0.09044265747070312 time for calcul the mask position with numpy : 0.02577495574951172 nb_pixel_total : 111071 time to create 1 rle with old method : 0.11927986145019531 time for calcul the mask position with numpy : 0.024944305419921875 nb_pixel_total : 54913 time to create 1 rle with old method : 0.05987238883972168 time for calcul the mask position with numpy : 0.02393484115600586 nb_pixel_total : 10779 time to create 1 rle with old method : 0.011688709259033203 time for calcul the mask position with numpy : 0.024719953536987305 nb_pixel_total : 42763 time to create 1 rle with old method : 0.04554438591003418 time for calcul the mask position with numpy : 0.02395176887512207 nb_pixel_total : 141241 time to create 1 rle with old method : 0.15330100059509277 time for calcul the mask position with numpy : 0.027924537658691406 nb_pixel_total : 589360 time to create 1 rle with new method : 0.5709660053253174 time for calcul the mask position with numpy : 0.028348207473754883 nb_pixel_total : 99623 time to create 1 rle with old method : 0.10709023475646973 time for calcul the mask position with numpy : 0.025247812271118164 nb_pixel_total : 61472 time to create 1 rle with old method : 0.06736111640930176 time for calcul the mask position with numpy : 0.024845361709594727 nb_pixel_total : 11015 time to create 1 rle with old method : 0.013486146926879883 time for calcul the mask position with numpy : 0.02369403839111328 nb_pixel_total : 19306 time to create 1 rle with old method : 0.020726680755615234 time for calcul the mask position with numpy : 0.02464604377746582 nb_pixel_total : 122382 time to create 1 rle with old method : 0.13063812255859375 time for calcul the mask position with numpy : 0.024890899658203125 nb_pixel_total : 32933 time to create 1 rle with old method : 0.035146474838256836 time for calcul the mask position with numpy : 0.024030685424804688 nb_pixel_total : 34933 time to create 1 rle with old method : 0.03843092918395996 time for calcul the mask position with numpy : 0.02513432502746582 nb_pixel_total : 139641 time to create 1 rle with old method : 0.14960479736328125 time for calcul the mask position with numpy : 0.02525615692138672 nb_pixel_total : 160194 time to create 1 rle with new method : 0.6034080982208252 create new chi : 5.124240875244141 time to delete rle : 0.02584362030029297 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 19760 TO DO : save crop sub photo not yet done ! save time : 1.1234676837921143 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 5.790939569473267 time for calcul the mask position with numpy : 0.5341305732727051 nb_pixel_total : 7663453 time to create 1 rle with new method : 0.5238499641418457 time for calcul the mask position with numpy : 0.023880720138549805 nb_pixel_total : 8837 time to create 1 rle with old method : 0.00947427749633789 time for calcul the mask position with numpy : 0.023341894149780273 nb_pixel_total : 71251 time to create 1 rle with old method : 0.07640933990478516 time for calcul the mask position with numpy : 0.023431062698364258 nb_pixel_total : 17995 time to create 1 rle with old method : 0.019313335418701172 time for calcul the mask position with numpy : 0.025638818740844727 nb_pixel_total : 121193 time to create 1 rle with old method : 0.13509225845336914 time for calcul the mask position with numpy : 0.024764299392700195 nb_pixel_total : 23738 time to create 1 rle with old method : 0.02623605728149414 time for calcul the mask position with numpy : 0.02605128288269043 nb_pixel_total : 16157 time to create 1 rle with old method : 0.017827749252319336 time for calcul the mask position with numpy : 0.026065349578857422 nb_pixel_total : 24963 time to create 1 rle with old method : 0.027716875076293945 time for calcul the mask position with numpy : 0.024625301361083984 nb_pixel_total : 73960 time to create 1 rle with old method : 0.08222270011901855 time for calcul the mask position with numpy : 0.025258779525756836 nb_pixel_total : 67722 time to create 1 rle with old method : 0.0744476318359375 time for calcul the mask position with numpy : 0.024873733520507812 nb_pixel_total : 20163 time to create 1 rle with old method : 0.023107528686523438 time for calcul the mask position with numpy : 0.024878740310668945 nb_pixel_total : 32627 time to create 1 rle with old method : 0.03978443145751953 time for calcul the mask position with numpy : 0.024898052215576172 nb_pixel_total : 36934 time to create 1 rle with old method : 0.04063820838928223 time for calcul the mask position with numpy : 0.025388717651367188 nb_pixel_total : 99970 time to create 1 rle with old method : 0.10980892181396484 time for calcul the mask position with numpy : 0.024247169494628906 nb_pixel_total : 15437 time to create 1 rle with old method : 0.016525983810424805 create new chi : 2.1474790573120117 time to delete rle : 0.0012633800506591797 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9796 TO DO : save crop sub photo not yet done ! save time : 0.6010587215423584 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.9972763061523438 time for calcul the mask position with numpy : 0.6591854095458984 nb_pixel_total : 7901283 time to create 1 rle with new method : 0.8015146255493164 time for calcul the mask position with numpy : 0.024431228637695312 nb_pixel_total : 35612 time to create 1 rle with old method : 0.03935074806213379 time for calcul the mask position with numpy : 0.024333715438842773 nb_pixel_total : 30469 time to create 1 rle with old method : 0.03310418128967285 time for calcul the mask position with numpy : 0.02509450912475586 nb_pixel_total : 70146 time to create 1 rle with old method : 0.07558012008666992 time for calcul the mask position with numpy : 0.025141239166259766 nb_pixel_total : 61391 time to create 1 rle with old method : 0.07088017463684082 time for calcul the mask position with numpy : 0.025721311569213867 nb_pixel_total : 128754 time to create 1 rle with old method : 0.14176154136657715 time for calcul the mask position with numpy : 0.024847984313964844 nb_pixel_total : 23779 time to create 1 rle with old method : 0.02545166015625 time for calcul the mask position with numpy : 0.023862123489379883 nb_pixel_total : 42966 time to create 1 rle with old method : 0.047844886779785156 create new chi : 2.1121442317962646 time to delete rle : 0.0009691715240478516 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++++Number RLEs to save : 6590 TO DO : save crop sub photo not yet done ! save time : 0.4152848720550537 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 3.8905556201934814 time for calcul the mask position with numpy : 0.42934226989746094 nb_pixel_total : 7731525 time to create 1 rle with new method : 0.7236630916595459 time for calcul the mask position with numpy : 0.02432417869567871 nb_pixel_total : 19809 time to create 1 rle with old method : 0.024062395095825195 time for calcul the mask position with numpy : 0.02599048614501953 nb_pixel_total : 174349 time to create 1 rle with new method : 0.8219995498657227 time for calcul the mask position with numpy : 0.024065732955932617 nb_pixel_total : 79592 time to create 1 rle with old method : 0.0841054916381836 time for calcul the mask position with numpy : 0.0248105525970459 nb_pixel_total : 44976 time to create 1 rle with old method : 0.04837632179260254 time for calcul the mask position with numpy : 0.02452826499938965 nb_pixel_total : 39588 time to create 1 rle with old method : 0.042783260345458984 time for calcul the mask position with numpy : 0.025112628936767578 nb_pixel_total : 106282 time to create 1 rle with old method : 0.1169121265411377 time for calcul the mask position with numpy : 0.02522873878479004 nb_pixel_total : 21719 time to create 1 rle with old method : 0.023717164993286133 time for calcul the mask position with numpy : 0.024050474166870117 nb_pixel_total : 43268 time to create 1 rle with old method : 0.045850276947021484 time for calcul the mask position with numpy : 0.02380657196044922 nb_pixel_total : 15166 time to create 1 rle with old method : 0.016304731369018555 time for calcul the mask position with numpy : 0.023302078247070312 nb_pixel_total : 18126 time to create 1 rle with old method : 0.019234180450439453 create new chi : 2.7147717475891113 time to delete rle : 0.0012316703796386719 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8089 TO DO : save crop sub photo not yet done ! save time : 0.518688440322876 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 6.549952507019043 time for calcul the mask position with numpy : 0.4988675117492676 nb_pixel_total : 6526745 time to create 1 rle with new method : 0.7925965785980225 time for calcul the mask position with numpy : 0.02360057830810547 nb_pixel_total : 7069 time to create 1 rle with old method : 0.007866859436035156 time for calcul the mask position with numpy : 0.029076337814331055 nb_pixel_total : 828556 time to create 1 rle with new method : 0.6123836040496826 time for calcul the mask position with numpy : 0.02579665184020996 nb_pixel_total : 142395 time to create 1 rle with old method : 0.15828347206115723 time for calcul the mask position with numpy : 0.025375843048095703 nb_pixel_total : 51454 time to create 1 rle with old method : 0.05632424354553223 time for calcul the mask position with numpy : 0.02604508399963379 nb_pixel_total : 26437 time to create 1 rle with old method : 0.02929067611694336 time for calcul the mask position with numpy : 0.02510666847229004 nb_pixel_total : 20666 time to create 1 rle with old method : 0.022792577743530273 time for calcul the mask position with numpy : 0.023787498474121094 nb_pixel_total : 112563 time to create 1 rle with old method : 0.12094283103942871 time for calcul the mask position with numpy : 0.02463078498840332 nb_pixel_total : 154995 time to create 1 rle with new method : 0.6280784606933594 time for calcul the mask position with numpy : 0.030507802963256836 nb_pixel_total : 73601 time to create 1 rle with old method : 0.07963180541992188 time for calcul the mask position with numpy : 0.025861501693725586 nb_pixel_total : 179074 time to create 1 rle with new method : 0.7602355480194092 time for calcul the mask position with numpy : 0.02467179298400879 nb_pixel_total : 57508 time to create 1 rle with old method : 0.06462955474853516 time for calcul the mask position with numpy : 0.027876615524291992 nb_pixel_total : 28860 time to create 1 rle with old method : 0.031378984451293945 time for calcul the mask position with numpy : 0.024829626083374023 nb_pixel_total : 28755 time to create 1 rle with old method : 0.030802249908447266 time for calcul the mask position with numpy : 0.024518489837646484 nb_pixel_total : 55722 time to create 1 rle with old method : 0.059103965759277344 create new chi : 4.436080694198608 time to delete rle : 0.0019865036010742188 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14444 TO DO : save crop sub photo not yet done ! save time : 0.8277614116668701 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 4.854579925537109 time for calcul the mask position with numpy : 0.5504848957061768 nb_pixel_total : 7552037 time to create 1 rle with new method : 0.795386791229248 time for calcul the mask position with numpy : 0.023180246353149414 nb_pixel_total : 37509 time to create 1 rle with old method : 0.04013228416442871 time for calcul the mask position with numpy : 0.024936914443969727 nb_pixel_total : 121849 time to create 1 rle with old method : 0.13353943824768066 time for calcul the mask position with numpy : 0.025282859802246094 nb_pixel_total : 108296 time to create 1 rle with old method : 0.1168985366821289 time for calcul the mask position with numpy : 0.025544166564941406 nb_pixel_total : 31592 time to create 1 rle with old method : 0.03489804267883301 time for calcul the mask position with numpy : 0.02490854263305664 nb_pixel_total : 57336 time to create 1 rle with old method : 0.06094503402709961 time for calcul the mask position with numpy : 0.023450613021850586 nb_pixel_total : 17631 time to create 1 rle with old method : 0.018996715545654297 time for calcul the mask position with numpy : 0.025231122970581055 nb_pixel_total : 102986 time to create 1 rle with old method : 0.10858416557312012 time for calcul the mask position with numpy : 0.023734092712402344 nb_pixel_total : 113758 time to create 1 rle with old method : 0.12069821357727051 time for calcul the mask position with numpy : 0.023867368698120117 nb_pixel_total : 10073 time to create 1 rle with old method : 0.010815858840942383 time for calcul the mask position with numpy : 0.039899349212646484 nb_pixel_total : 25732 time to create 1 rle with old method : 0.02757120132446289 time for calcul the mask position with numpy : 0.038674354553222656 nb_pixel_total : 11530 time to create 1 rle with old method : 0.012349128723144531 time for calcul the mask position with numpy : 0.03843355178833008 nb_pixel_total : 16490 time to create 1 rle with old method : 0.01699209213256836 time for calcul the mask position with numpy : 0.023976564407348633 nb_pixel_total : 21688 time to create 1 rle with old method : 0.022598743438720703 time for calcul the mask position with numpy : 0.025887489318847656 nb_pixel_total : 56625 time to create 1 rle with old method : 0.06555461883544922 time for calcul the mask position with numpy : 0.02508258819580078 nb_pixel_total : 9268 time to create 1 rle with old method : 0.01046609878540039 create new chi : 2.6019718647003174 time to delete rle : 0.0016145706176757812 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10668 TO DO : save crop sub photo not yet done ! save time : 0.6483111381530762 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.239168167114258 time for calcul the mask position with numpy : 0.7443828582763672 nb_pixel_total : 7711244 time to create 1 rle with new method : 0.7997636795043945 time for calcul the mask position with numpy : 0.02316570281982422 nb_pixel_total : 9367 time to create 1 rle with old method : 0.010056257247924805 time for calcul the mask position with numpy : 0.023686885833740234 nb_pixel_total : 44353 time to create 1 rle with old method : 0.0508885383605957 time for calcul the mask position with numpy : 0.025296926498413086 nb_pixel_total : 46417 time to create 1 rle with old method : 0.04998898506164551 time for calcul the mask position with numpy : 0.025385379791259766 nb_pixel_total : 118965 time to create 1 rle with old method : 0.1313190460205078 time for calcul the mask position with numpy : 0.025296688079833984 nb_pixel_total : 163332 time to create 1 rle with new method : 0.6832339763641357 time for calcul the mask position with numpy : 0.024437427520751953 nb_pixel_total : 90824 time to create 1 rle with old method : 0.09497952461242676 time for calcul the mask position with numpy : 0.02473759651184082 nb_pixel_total : 19976 time to create 1 rle with old method : 0.02174997329711914 time for calcul the mask position with numpy : 0.024466753005981445 nb_pixel_total : 41865 time to create 1 rle with old method : 0.044138193130493164 time for calcul the mask position with numpy : 0.023123979568481445 nb_pixel_total : 48057 time to create 1 rle with old method : 0.053508758544921875 create new chi : 2.969655752182007 time to delete rle : 0.0009870529174804688 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 7768 TO DO : save crop sub photo not yet done ! save time : 0.4884958267211914 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 5.661556243896484 time for calcul the mask position with numpy : 0.4900059700012207 nb_pixel_total : 6639583 time to create 1 rle with new method : 0.7484867572784424 time for calcul the mask position with numpy : 0.022629976272583008 nb_pixel_total : 27490 time to create 1 rle with old method : 0.029422521591186523 time for calcul the mask position with numpy : 0.025504350662231445 nb_pixel_total : 304116 time to create 1 rle with new method : 0.7000160217285156 time for calcul the mask position with numpy : 0.02454996109008789 nb_pixel_total : 88842 time to create 1 rle with old method : 0.09583330154418945 time for calcul the mask position with numpy : 0.023681640625 nb_pixel_total : 25372 time to create 1 rle with old method : 0.027243852615356445 time for calcul the mask position with numpy : 0.024829626083374023 nb_pixel_total : 208052 time to create 1 rle with new method : 0.5699484348297119 time for calcul the mask position with numpy : 0.024190187454223633 nb_pixel_total : 57185 time to create 1 rle with old method : 0.05961489677429199 time for calcul the mask position with numpy : 0.023891687393188477 nb_pixel_total : 52991 time to create 1 rle with old method : 0.05424356460571289 time for calcul the mask position with numpy : 0.023926258087158203 nb_pixel_total : 39025 time to create 1 rle with old method : 0.04071664810180664 time for calcul the mask position with numpy : 0.024239540100097656 nb_pixel_total : 15264 time to create 1 rle with old method : 0.01621222496032715 time for calcul the mask position with numpy : 0.023975133895874023 nb_pixel_total : 61210 time to create 1 rle with old method : 0.0652625560760498 time for calcul the mask position with numpy : 0.023972749710083008 nb_pixel_total : 57181 time to create 1 rle with old method : 0.059050559997558594 time for calcul the mask position with numpy : 0.02332758903503418 nb_pixel_total : 42851 time to create 1 rle with old method : 0.044179677963256836 time for calcul the mask position with numpy : 0.023432016372680664 nb_pixel_total : 44775 time to create 1 rle with old method : 0.049300193786621094 time for calcul the mask position with numpy : 0.02422499656677246 nb_pixel_total : 14059 time to create 1 rle with old method : 0.01503896713256836 time for calcul the mask position with numpy : 0.02324199676513672 nb_pixel_total : 44555 time to create 1 rle with old method : 0.04642772674560547 time for calcul the mask position with numpy : 0.024428606033325195 nb_pixel_total : 160573 time to create 1 rle with new method : 0.6461915969848633 time for calcul the mask position with numpy : 0.02358722686767578 nb_pixel_total : 59436 time to create 1 rle with old method : 0.062421560287475586 time for calcul the mask position with numpy : 0.02467203140258789 nb_pixel_total : 109616 time to create 1 rle with old method : 0.1185140609741211 time for calcul the mask position with numpy : 0.02488088607788086 nb_pixel_total : 223477 time to create 1 rle with new method : 0.5842845439910889 time for calcul the mask position with numpy : 0.023404359817504883 nb_pixel_total : 18747 time to create 1 rle with old method : 0.020046472549438477 create new chi : 5.161339282989502 time to delete rle : 0.0027403831481933594 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 19199 TO DO : save crop sub photo not yet done ! save time : 1.1348237991333008 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 4.0865159034729 time for calcul the mask position with numpy : 0.6971261501312256 nb_pixel_total : 7960362 time to create 1 rle with new method : 0.8415372371673584 time for calcul the mask position with numpy : 0.023450136184692383 nb_pixel_total : 21825 time to create 1 rle with old method : 0.023597002029418945 time for calcul the mask position with numpy : 0.02412247657775879 nb_pixel_total : 16878 time to create 1 rle with old method : 0.01801776885986328 time for calcul the mask position with numpy : 0.023993968963623047 nb_pixel_total : 16889 time to create 1 rle with old method : 0.017925500869750977 time for calcul the mask position with numpy : 0.02376413345336914 nb_pixel_total : 32358 time to create 1 rle with old method : 0.0356142520904541 time for calcul the mask position with numpy : 0.02400803565979004 nb_pixel_total : 27944 time to create 1 rle with old method : 0.03014683723449707 time for calcul the mask position with numpy : 0.02494525909423828 nb_pixel_total : 15421 time to create 1 rle with old method : 0.01625800132751465 time for calcul the mask position with numpy : 0.02377009391784668 nb_pixel_total : 18567 time to create 1 rle with old method : 0.01961374282836914 time for calcul the mask position with numpy : 0.023412466049194336 nb_pixel_total : 33291 time to create 1 rle with old method : 0.035483598709106445 time for calcul the mask position with numpy : 0.025084972381591797 nb_pixel_total : 150865 time to create 1 rle with new method : 0.6910290718078613 create new chi : 2.709043025970459 time to delete rle : 0.0009307861328125 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 5866 TO DO : save crop sub photo not yet done ! save time : 0.38992786407470703 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 5.129307270050049 time for calcul the mask position with numpy : 0.7704470157623291 nb_pixel_total : 7335849 time to create 1 rle with new method : 0.7474255561828613 time for calcul the mask position with numpy : 0.023452043533325195 nb_pixel_total : 41460 time to create 1 rle with old method : 0.04334735870361328 time for calcul the mask position with numpy : 0.023785829544067383 nb_pixel_total : 101420 time to create 1 rle with old method : 0.10789990425109863 time for calcul the mask position with numpy : 0.02443861961364746 nb_pixel_total : 41099 time to create 1 rle with old method : 0.04279041290283203 time for calcul the mask position with numpy : 0.024625539779663086 nb_pixel_total : 105904 time to create 1 rle with old method : 0.11088061332702637 time for calcul the mask position with numpy : 0.02420973777770996 nb_pixel_total : 99716 time to create 1 rle with old method : 0.10580921173095703 time for calcul the mask position with numpy : 0.025103092193603516 nb_pixel_total : 61118 time to create 1 rle with old method : 0.06402826309204102 time for calcul the mask position with numpy : 0.03819537162780762 nb_pixel_total : 32879 time to create 1 rle with old method : 0.03460860252380371 time for calcul the mask position with numpy : 0.03689742088317871 nb_pixel_total : 19546 time to create 1 rle with old method : 0.020984172821044922 time for calcul the mask position with numpy : 0.03303670883178711 nb_pixel_total : 9062 time to create 1 rle with old method : 0.009932994842529297 time for calcul the mask position with numpy : 0.024403810501098633 nb_pixel_total : 59035 time to create 1 rle with old method : 0.06722569465637207 time for calcul the mask position with numpy : 0.02338266372680664 nb_pixel_total : 16895 time to create 1 rle with old method : 0.017649173736572266 time for calcul the mask position with numpy : 0.023947954177856445 nb_pixel_total : 72482 time to create 1 rle with old method : 0.0766913890838623 time for calcul the mask position with numpy : 0.02399921417236328 nb_pixel_total : 22434 time to create 1 rle with old method : 0.02395176887512207 time for calcul the mask position with numpy : 0.024019718170166016 nb_pixel_total : 118114 time to create 1 rle with old method : 0.12471604347229004 time for calcul the mask position with numpy : 0.02512192726135254 nb_pixel_total : 32197 time to create 1 rle with old method : 0.03421926498413086 time for calcul the mask position with numpy : 0.02535724639892578 nb_pixel_total : 125190 time to create 1 rle with old method : 0.13416147232055664 create new chi : 3.0013985633850098 time to delete rle : 0.0018792152404785156 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 12097 TO DO : save crop sub photo not yet done ! save time : 0.7378103733062744 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 3.793733835220337 time for calcul the mask position with numpy : 0.48237109184265137 nb_pixel_total : 7294410 time to create 1 rle with new method : 0.7434723377227783 time for calcul the mask position with numpy : 0.025919675827026367 nb_pixel_total : 59564 time to create 1 rle with old method : 0.06692171096801758 time for calcul the mask position with numpy : 0.02482128143310547 nb_pixel_total : 36721 time to create 1 rle with old method : 0.04113006591796875 time for calcul the mask position with numpy : 0.025113582611083984 nb_pixel_total : 50013 time to create 1 rle with old method : 0.055800437927246094 time for calcul the mask position with numpy : 0.027287721633911133 nb_pixel_total : 202374 time to create 1 rle with new method : 0.6619040966033936 time for calcul the mask position with numpy : 0.024454832077026367 nb_pixel_total : 55830 time to create 1 rle with old method : 0.05872535705566406 time for calcul the mask position with numpy : 0.025859355926513672 nb_pixel_total : 44365 time to create 1 rle with old method : 0.07257294654846191 time for calcul the mask position with numpy : 0.02498483657836914 nb_pixel_total : 51450 time to create 1 rle with old method : 0.05550265312194824 time for calcul the mask position with numpy : 0.02590632438659668 nb_pixel_total : 54293 time to create 1 rle with old method : 0.059332847595214844 time for calcul the mask position with numpy : 0.024495601654052734 nb_pixel_total : 35515 time to create 1 rle with old method : 0.03861641883850098 time for calcul the mask position with numpy : 0.024965286254882812 nb_pixel_total : 17308 time to create 1 rle with old method : 0.018924951553344727 time for calcul the mask position with numpy : 0.02582240104675293 nb_pixel_total : 46405 time to create 1 rle with old method : 0.0508580207824707 time for calcul the mask position with numpy : 0.029860258102416992 nb_pixel_total : 346152 time to create 1 rle with new method : 0.849860668182373 create new chi : 3.6596920490264893 time to delete rle : 0.0016722679138183594 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 11066 TO DO : save crop sub photo not yet done ! save time : 0.6683952808380127 map_output_result : {1381125730: (0.0, 'Should be the crop_list due to order', 0), 1381125685: (0.0, 'Should be the crop_list due to order', 0), 1381125655: (0.0, 'Should be the crop_list due to order', 0), 1381125619: (0.0, 'Should be the crop_list due to order', 0), 1381125539: (0.0, 'Should be the crop_list due to order', 0), 1381124882: (0.0, 'Should be the crop_list due to order', 0), 1381124823: (0.0, 'Should be the crop_list due to order', 0), 1381124766: (0.0, 'Should be the crop_list due to order', 0), 1381124700: (0.0, 'Should be the crop_list due to order', 0), 1381124579: (0.0, 'Should be the crop_list due to order', 0), 1381123908: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1381125730, 1381125685, 1381125655, 1381125619, 1381125539, 1381124882, 1381124823, 1381124766, 1381124700, 1381124579, 1381123908] Looping around the photos to save general results len do output : 11 /1381125730.Didn't retrieve data . /1381125685.Didn't retrieve data . /1381125655.Didn't retrieve data . /1381125619.Didn't retrieve data . /1381125539.Didn't retrieve data . /1381124882.Didn't retrieve data . /1381124823.Didn't retrieve data . /1381124766.Didn't retrieve data . /1381124700.Didn't retrieve data . /1381124579.Didn't retrieve data . /1381123908.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125730', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125685', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125655', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125619', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125539', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124882', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124823', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124766', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124700', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124579', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381123908', None, None, None, None, None, '3659209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.02116560935974121 save_final save missing photos in datou_result : time spend for datou_step_exec : 101.22904324531555 time spend to save output : 0.021590471267700195 total time spend for step 3 : 101.25063371658325 step4:ventilate_hashtags_in_portfolio Wed Sep 3 15:45:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26492294 get user id for portfolio 26492294 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26492294 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_clair','environnement','mal_croppe','flou','metal','background','autre','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26492294 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_clair','environnement','mal_croppe','flou','metal','background','autre','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26492294 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_clair','environnement','mal_croppe','flou','metal','background','autre','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26492565,26492566,26492567,26492568,26492569,26492570,26492571,26492572,26492573,26492574,26492575?tags=papier,pehd,pet_clair,environnement,mal_croppe,flou,metal,background,autre,carton,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1381125730, 1381125685, 1381125655, 1381125619, 1381125539, 1381124882, 1381124823, 1381124766, 1381124700, 1381124579, 1381123908] Looping around the photos to save general results len do output : 1 /26492294. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125730', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125685', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125655', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125619', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125539', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124882', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124823', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124766', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124700', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124579', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381123908', None, None, None, None, None, '3659209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014442920684814453 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.799638032913208 time spend to save output : 0.014708757400512695 total time spend for step 4 : 0.8143467903137207 step5:final Wed Sep 3 15:45:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1381125730: ('0.11959475396324351',), 1381125685: ('0.11959475396324351',), 1381125655: ('0.11959475396324351',), 1381125619: ('0.11959475396324351',), 1381125539: ('0.11959475396324351',), 1381124882: ('0.11959475396324351',), 1381124823: ('0.11959475396324351',), 1381124766: ('0.11959475396324351',), 1381124700: ('0.11959475396324351',), 1381124579: ('0.11959475396324351',), 1381123908: ('0.11959475396324351',)} new output for save of step final : {1381125730: ('0.11959475396324351',), 1381125685: ('0.11959475396324351',), 1381125655: ('0.11959475396324351',), 1381125619: ('0.11959475396324351',), 1381125539: ('0.11959475396324351',), 1381124882: ('0.11959475396324351',), 1381124823: ('0.11959475396324351',), 1381124766: ('0.11959475396324351',), 1381124700: ('0.11959475396324351',), 1381124579: ('0.11959475396324351',), 1381123908: ('0.11959475396324351',)} [1381125730, 1381125685, 1381125655, 1381125619, 1381125539, 1381124882, 1381124823, 1381124766, 1381124700, 1381124579, 1381123908] Looping around the photos to save general results len do output : 11 /1381125730.Didn't retrieve data . /1381125685.Didn't retrieve data . /1381125655.Didn't retrieve data . /1381125619.Didn't retrieve data . /1381125539.Didn't retrieve data . /1381124882.Didn't retrieve data . /1381124823.Didn't retrieve data . /1381124766.Didn't retrieve data . /1381124700.Didn't retrieve data . /1381124579.Didn't retrieve data . /1381123908.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125730', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125685', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125655', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125619', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125539', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124882', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124823', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124766', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124700', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124579', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381123908', None, None, None, None, None, '3659209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01638650894165039 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1270313262939453 time spend to save output : 0.017035961151123047 total time spend for step 5 : 0.14406728744506836 step6:blur_detection Wed Sep 3 15:45:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f.jpg resize: (2160, 3840) 1381125730 -6.107776619939095 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48.jpg resize: (2160, 3840) 1381125685 -6.705799938525851 treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba.jpg resize: (2160, 3840) 1381125655 -6.812566558536308 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e.jpg resize: (2160, 3840) 1381125619 -6.802532945958235 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5.jpg resize: (2160, 3840) 1381125539 -6.75812341276488 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247.jpg resize: (2160, 3840) 1381124882 -6.813865640381913 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000.jpg resize: (2160, 3840) 1381124823 -6.70212060734206 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130.jpg resize: (2160, 3840) 1381124766 -6.138780381551253 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458.jpg resize: (2160, 3840) 1381124700 -6.624299926401652 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9.jpg resize: (2160, 3840) 1381124579 -6.608184009350188 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1.jpg resize: (2160, 3840) 1381123908 -6.862550359731584 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287503_0.png resize: (572, 334) 1381132791 -1.03632871645418 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287505_0.png resize: (250, 172) 1381132792 -0.7545787814209336 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287506_0.png resize: (954, 266) 1381132793 -3.6112990581227007 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287507_0.png resize: (257, 190) 1381132794 -1.9628182925862518 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287508_0.png resize: (119, 140) 1381132795 -2.2822711511007787 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287509_0.png resize: (327, 414) 1381132796 0.932134625724028 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287510_0.png resize: (344, 431) 1381132797 -1.3786668206393844 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287511_0.png resize: (957, 928) 1381132798 -4.2587733672630135 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287513_0.png resize: (314, 238) 1381132799 0.6689985812586826 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287514_0.png resize: (118, 138) 1381132800 -1.2583160529305746 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287515_0.png resize: (306, 259) 1381132801 -2.6719356948338673 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287518_0.png resize: (113, 148) 1381132802 -1.6039018772475948 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287523_0.png resize: (260, 225) 1381132803 -2.7259986141959853 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287525_0.png resize: (142, 190) 1381132804 -0.6712230059188158 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287526_0.png resize: (458, 477) 1381132805 -3.2269068630447717 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287527_0.png resize: (301, 177) 1381132806 -0.8653306549994839 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287528_0.png resize: (377, 145) 1381132807 -4.879672638956762 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287529_0.png resize: (173, 175) 1381132808 -3.0073758400442787 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287532_0.png resize: (296, 313) 1381132809 -3.454179442925541 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287533_0.png resize: (187, 153) 1381132810 -2.232150717329126 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287536_0.png resize: (152, 168) 1381132811 -3.5321582589831597 treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287541_0.png resize: (328, 527) 1381132812 -2.3513832259710368 treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287542_0.png resize: (318, 306) 1381132813 -3.605030668346566 treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287543_0.png resize: (355, 257) 1381132814 -3.8671567785246905 treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287544_0.png resize: (209, 236) 1381132815 -0.29406914393557937 treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287545_0.png resize: (223, 268) 1381132816 -3.741295086351624 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287546_0.png resize: (147, 183) 1381132817 -0.5550764909441384 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287547_0.png resize: (147, 153) 1381132818 -0.09499996553627787 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287548_0.png resize: (168, 323) 1381132819 -0.675951936981722 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287549_0.png resize: (198, 295) 1381132820 -2.766518092057447 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287551_0.png resize: (168, 333) 1381132821 -4.606496089147931 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287552_0.png resize: (402, 145) 1381132822 -3.473077999137539 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287554_0.png resize: (520, 735) 1381132823 -4.143114862416265 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287555_0.png resize: (80, 374) 1381132824 -4.087679082516986 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287556_0.png resize: (283, 271) 1381132825 -5.682883212125082 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287557_0.png resize: (252, 135) 1381132826 -2.7832898959350194 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287558_0.png resize: (222, 166) 1381132827 -4.070025550214907 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287559_0.png resize: (253, 407) 1381132828 2.3126116030669457 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287560_0.png resize: (652, 449) 1381132829 -3.503693536136846 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287561_0.png resize: (382, 410) 1381132830 -3.4109676154882007 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287562_0.png resize: (579, 523) 1381132831 -4.270885449593537 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287564_0.png resize: (210, 123) 1381132832 0.13372781939447528 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287565_0.png resize: (301, 617) 1381132833 -4.622674218334442 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287566_0.png resize: (316, 246) 1381132834 3.112220995144068 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287567_0.png resize: (384, 674) 1381132835 -3.116190423129197 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287568_0.png resize: (1408, 1143) 1381132836 -5.720763950297382 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287569_0.png resize: (492, 279) 1381132837 -5.112297691888233 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287570_0.png resize: (97, 127) 1381132838 -1.118949055702734 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287571_0.png resize: (293, 300) 1381132839 -1.6434251262470383 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287572_0.png resize: (314, 139) 1381132840 -1.3034072020593621 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287573_0.png resize: (135, 153) 1381132841 -3.127333038371513 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287574_0.png resize: (143, 139) 1381132842 -3.4956291395757524 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287575_0.png resize: (262, 190) 1381132843 -2.570780244866895 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287576_0.png resize: (107, 113) 1381132844 -2.412043943354859 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287577_0.png resize: (293, 523) 1381132845 -1.2594402762768693 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287579_0.png resize: (149, 152) 1381132846 -4.436501883189559 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287580_0.png resize: (456, 182) 1381132847 -3.692244098425815 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287581_0.png resize: (184, 197) 1381132848 -3.5023000043145798 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287587_0.png resize: (150, 195) 1381132849 -1.2643309965959364 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287588_0.png resize: (403, 398) 1381132850 -2.8445144126517614 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287589_0.png resize: (483, 438) 1381132851 -1.127862750024611 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287590_0.png resize: (349, 488) 1381132852 0.9595769365915675 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287592_0.png resize: (316, 258) 1381132853 -3.0772437792572966 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287593_0.png resize: (119, 120) 1381132854 -4.95224143591536 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287594_0.png resize: (143, 146) 1381132855 4.378614925036003 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287595_0.png resize: (551, 602) 1381132856 0.2935853592226281 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287596_0.png resize: (316, 493) 1381132857 1.0446191936533655 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287597_0.png resize: (307, 321) 1381132858 0.534120048753854 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287598_0.png resize: (521, 569) 1381132859 1.3448117362571306 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287599_0.png resize: (293, 274) 1381132860 -3.883868227790448 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287600_0.png resize: (146, 120) 1381132861 2.266353549065131 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287601_0.png resize: (480, 227) 1381132862 -3.5607248413091446 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287602_0.png resize: (211, 304) 1381132863 -0.42501214780092317 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287603_0.png resize: (300, 265) 1381132864 -4.4473239147535235 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287605_0.png resize: (233, 241) 1381132865 -1.922966540784187 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287606_0.png resize: (336, 177) 1381132866 -1.7535795474975306 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287607_0.png resize: (290, 253) 1381132867 -3.760323408933196 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287609_0.png resize: (668, 466) 1381132868 -5.150445831195211 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287610_0.png resize: (126, 323) 1381132869 -2.2588185547582857 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287612_0.png resize: (1215, 646) 1381132870 -0.4146340991797322 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287613_0.png resize: (190, 208) 1381132872 -3.076816802572242 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287614_0.png resize: (319, 656) 1381132873 -3.9273900351366198 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287615_0.png resize: (187, 260) 1381132874 -0.33562265635766103 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287616_0.png resize: (133, 219) 1381132876 -1.9872565086836385 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287617_0.png resize: (218, 129) 1381132877 -1.550575496326564 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287621_0.png resize: (159, 166) 1381132878 -2.4095127586529475 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287622_0.png resize: (190, 226) 1381132880 -1.9395338247853928 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287626_0.png resize: (253, 121) 1381132881 -4.189196354176027 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287627_0.png resize: (480, 249) 1381132882 -2.964992172461474 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287628_0.png resize: (132, 154) 1381132884 1.112576399933317 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287629_0.png resize: (259, 361) 1381132885 -3.761647172959523 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287630_0.png resize: (105, 129) 1381132886 0.3764731758207877 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287632_0.png resize: (154, 321) 1381132888 -2.0739524729427354 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287633_0.png resize: (261, 387) 1381132889 -2.8768231961017317 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287634_0.png resize: (420, 475) 1381132890 -4.014310126781719 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287638_0.png resize: (262, 201) 1381132891 0.6946561327374848 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287641_0.png resize: (138, 149) 1381132893 -0.9881836414709118 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287642_0.png resize: (265, 229) 1381132894 -3.6719813923204474 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287644_0.png resize: (182, 365) 1381132895 -3.0366221648798164 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287646_0.png resize: (470, 202) 1381132896 -3.315451281370019 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287648_0.png resize: (276, 230) 1381132897 1.0594100152978312 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287649_0.png resize: (252, 241) 1381132898 -3.7530041554147155 treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287540_0.png resize: (347, 106) 1381132899 -3.910767659198438 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287584_0.png resize: (230, 212) 1381132900 -3.7009712423145964 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287620_0.png resize: (163, 153) 1381132901 -2.97751131155314 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287631_0.png resize: (121, 215) 1381132902 -3.8712413155061527 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287502_0.png resize: (476, 405) 1381132942 -5.151830090395292 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287512_0.png resize: (378, 540) 1381132944 -3.493055412754859 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287516_0.png resize: (406, 357) 1381132945 -4.117846436519828 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287517_0.png resize: (341, 364) 1381132946 -3.8991666402017433 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287519_0.png resize: (268, 375) 1381132948 -2.591165253406651 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287520_0.png resize: (615, 555) 1381132949 -3.615835637388835 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287521_0.png resize: (197, 342) 1381132951 -4.201595329248874 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287522_0.png resize: (278, 260) 1381132952 -4.057840137066323 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287524_0.png resize: (519, 471) 1381132953 -4.569001857118734 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287531_0.png resize: (302, 326) 1381132955 -4.884476741771399 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287534_0.png resize: (111, 294) 1381132956 -3.7663454415726805 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287535_0.png resize: (313, 494) 1381132957 -4.1913345190891675 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287537_0.png resize: (392, 289) 1381132959 -4.183915587734146 treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287539_0.png resize: (271, 224) 1381132960 -4.530509068201754 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287550_0.png resize: (626, 225) 1381132961 -5.250617127764416 treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287553_0.png resize: (352, 311) 1381132963 -4.40966933717796 treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287563_0.png resize: (321, 500) 1381132964 -4.605562288326892 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287578_0.png resize: (262, 545) 1381132965 -3.8041472732898614 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287582_0.png resize: (658, 258) 1381132967 -4.567944932502038 treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287583_0.png resize: (490, 397) 1381132968 -4.2744769186263865 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287586_0.png resize: (275, 202) 1381132969 -4.557939740382602 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287591_0.png resize: (317, 250) 1381132971 -3.824963316844135 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287604_0.png resize: (337, 222) 1381132972 -2.6544973407289443 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287608_0.png resize: (238, 290) 1381132973 -4.345327821635495 treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287611_0.png resize: (495, 231) 1381132975 -4.23107085243853 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287623_0.png resize: (470, 412) 1381132976 -4.463240094533471 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287624_0.png resize: (184, 232) 1381132977 -4.174895841514321 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287625_0.png resize: (552, 279) 1381132980 -4.074201585225756 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287635_0.png resize: (449, 353) 1381132981 -4.920970797387292 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287636_0.png resize: (236, 251) 1381132982 -2.5339878632714177 treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287637_0.png resize: (444, 303) 1381132984 -4.692420927596422 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287639_0.png resize: (741, 758) 1381132985 -4.924566963448305 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287640_0.png resize: (238, 347) 1381132986 -3.40484136055796 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287643_0.png resize: (348, 273) 1381132988 -4.403342241617664 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287645_0.png resize: (280, 237) 1381132989 -4.262369369782179 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287647_0.png resize: (618, 431) 1381132990 -4.670783978632673 treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287650_0.png resize: (348, 272) 1381132992 -4.589269088949419 treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287504_0.png resize: (159, 272) 1381132997 -0.38278042342392016 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287530_0.png resize: (312, 276) 1381132998 -3.60077487000455 treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287538_0.png resize: (119, 93) 1381132999 -3.4831481140062657 treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287585_0.png resize: (179, 386) 1381133000 -2.5495452465466153 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287618_0.png resize: (190, 184) 1381133001 -0.22773292211388543 treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287619_0.png resize: (228, 179) 1381133009 -2.1132193557567165 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 160 time used for this insertion : 0.017731666564941406 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 160 time used for this insertion : 0.029774188995361328 save missing photos in datou_result : time spend for datou_step_exec : 45.4590585231781 time spend to save output : 0.05235719680786133 total time spend for step 6 : 45.51141571998596 step7:brightness Wed Sep 3 15:46:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f.jpg treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48.jpg treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba.jpg treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e.jpg treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5.jpg treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247.jpg treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000.jpg treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130.jpg treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458.jpg treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9.jpg treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1.jpg treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287503_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287505_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287506_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287507_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287508_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287509_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287510_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287511_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287513_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287514_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287515_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287518_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287523_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287525_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287526_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287527_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287528_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287529_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287532_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287533_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287536_0.png treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287541_0.png treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287542_0.png treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287543_0.png treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287544_0.png treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287545_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287546_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287547_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287548_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287549_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287551_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287552_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287554_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287555_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287556_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287557_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287558_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287559_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287560_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287561_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287562_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287564_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287565_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287566_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287567_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287568_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287569_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287570_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287571_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287572_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287573_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287574_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287575_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287576_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287577_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287579_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287580_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287581_0.png treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287587_0.png treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287588_0.png treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287589_0.png treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287590_0.png treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287592_0.png treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287593_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287594_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287595_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287596_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287597_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287598_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287599_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287600_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287601_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287602_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287603_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287605_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287606_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287607_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287609_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287610_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287612_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287613_0.png treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287614_0.png treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287615_0.png treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287616_0.png treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287617_0.png treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287621_0.png treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287622_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287626_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287627_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287628_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287629_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287630_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287632_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287633_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287634_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287638_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287641_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287642_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287644_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287646_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287648_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287649_0.png treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287540_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287584_0.png treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287620_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287631_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287502_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287512_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287516_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287517_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287519_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287520_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287521_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287522_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287524_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287531_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287534_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287535_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287537_0.png treat image : temp/1756906829_2364654_1381125655_6b08cf3064537223701157271710abba_rle_crop_3942287539_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287550_0.png treat image : temp/1756906829_2364654_1381125619_f870d348c1a25df09faaedf4419cf50e_rle_crop_3942287553_0.png treat image : temp/1756906829_2364654_1381125539_a3d5aa8f53174e72ed2c315a2b649db5_rle_crop_3942287563_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287578_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287582_0.png treat image : temp/1756906829_2364654_1381124882_32ea1429af5996d681afd102bf6ae247_rle_crop_3942287583_0.png treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287586_0.png treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287591_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287604_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287608_0.png treat image : temp/1756906829_2364654_1381124766_c2a3f9df047ec77c74c227dbaf6e9130_rle_crop_3942287611_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287623_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287624_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287625_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287635_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287636_0.png treat image : temp/1756906829_2364654_1381124579_10a2b299d01522e98705a08196d2a9c9_rle_crop_3942287637_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287639_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287640_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287643_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287645_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287647_0.png treat image : temp/1756906829_2364654_1381123908_abfbc9eb67beadc3a390951f268affe1_rle_crop_3942287650_0.png treat image : temp/1756906829_2364654_1381125730_24e7ccc2a51a34599c1f3f720e71038f_rle_crop_3942287504_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287530_0.png treat image : temp/1756906829_2364654_1381125685_817a302a6f514c71515de74cfd650a48_rle_crop_3942287538_0.png treat image : temp/1756906829_2364654_1381124823_3bd306a0de8e4c69c58cfd9fb8e8e000_rle_crop_3942287585_0.png treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287618_0.png treat image : temp/1756906829_2364654_1381124700_fc398df64542d90bf483a3c224db1458_rle_crop_3942287619_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 160 time used for this insertion : 0.01970839500427246 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 160 time used for this insertion : 0.03384208679199219 save missing photos in datou_result : time spend for datou_step_exec : 11.865370750427246 time spend to save output : 0.05904126167297363 total time spend for step 7 : 11.92441201210022 step8:velours_tree Wed Sep 3 15:46:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.4902689456939697 time spend to save output : 4.76837158203125e-05 total time spend for step 8 : 0.49031662940979004 step9:send_mail_cod Wed Sep 3 15:46:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26492294_03-09-2025_15_46_25.pdf 26492565 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264925651756907185 26492566 imagette264925661756907186 26492567 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264925671756907186 26492569 imagette264925691756907188 26492570 imagette264925701756907188 26492571 imagette264925711756907188 26492572 imagette264925721756907188 26492573 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264925731756907188 26492574 change filename to text .change filename to text .change filename to text .change filename to text .imagette264925741756907188 26492575 change filename to text .imagette264925751756907188 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26492294 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26492565,26492566,26492567,26492568,26492569,26492570,26492571,26492572,26492573,26492574,26492575?tags=papier,pehd,pet_clair,environnement,mal_croppe,flou,metal,background,autre,carton,pet_fonce args[1381125730] : ((1381125730, -6.107776619939095, 492609224), (1381125730, 1.5095139561113151, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381125685] : ((1381125685, -6.705799938525851, 492609224), (1381125685, 1.3702154487769476, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381125655] : ((1381125655, -6.812566558536308, 492609224), (1381125655, 1.1875238160510178, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381125619] : ((1381125619, -6.802532945958235, 492609224), (1381125619, 1.2072477499682668, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381125539] : ((1381125539, -6.75812341276488, 492609224), (1381125539, 1.3779895158543258, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381124882] : ((1381124882, -6.813865640381913, 492609224), (1381124882, 1.2315000021914582, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381124823] : ((1381124823, -6.70212060734206, 492609224), (1381124823, 1.2873588833199339, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381124766] : ((1381124766, -6.138780381551253, 492609224), (1381124766, 1.446059580148427, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381124700] : ((1381124700, -6.624299926401652, 492609224), (1381124700, 1.4718433701839717, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381124579] : ((1381124579, -6.608184009350188, 492609224), (1381124579, 1.3908178656694992, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com args[1381123908] : ((1381123908, -6.862550359731584, 492609224), (1381123908, 1.266438333777135, 2107752395), '0.11959475396324351') We are sending mail with results at report@fotonower.com refus_total : 0.11959475396324351 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26492294 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26492294_03-09-2025_15_46_25.pdf results_Auto_P26492294_03-09-2025_15_46_25.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26492294_03-09-2025_15_46_25.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26492294','results_Auto_P26492294_03-09-2025_15_46_25.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26492294_03-09-2025_15_46_25.pdf','pdf','','0.77','0.11959475396324351') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26492294

https://www.fotonower.com/image?json=false&list_photos_id=1381125730
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381125685
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381125655
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381125619
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381125539
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381124882
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381124823
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381124766
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381124700
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381124579
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381123908
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.96%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/26492565?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26492567?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26492573?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26492574?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26492575?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26492294_03-09-2025_15_46_25.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26492565,26492566,26492567,26492568,26492569,26492570,26492571,26492572,26492573,26492574,26492575?tags=papier,pehd,pet_clair,environnement,mal_croppe,flou,metal,background,autre,carton,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 03 Sep 2025 13:46:32 GMT Content-Length: 0 Connection: close X-Message-Id: sh8yyOB4QIOW3qrqmDY25A Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1381125730, 1381125685, 1381125655, 1381125619, 1381125539, 1381124882, 1381124823, 1381124766, 1381124700, 1381124579, 1381123908] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125730', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125685', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125655', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125619', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125539', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124882', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124823', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124766', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124700', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124579', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381123908', None, None, None, None, None, '3659209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01378011703491211 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.3875367641448975 time spend to save output : 0.014048099517822266 total time spend for step 9 : 7.40158486366272 step10:split_time_score Wed Sep 3 15:46:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03092025 26492294 Nombre de photos uploadées : 11 / 23040 (0%) 03092025 26492294 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 03092025 26492294 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.0251998901367188e-05 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004913806915283203 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2142167091369629 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.033641923365876306 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26474311_03-09-2025_07_36_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26474311 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26474311 AND mptpi.`type`=3726 To do Qualite : 0.05173950027863514 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26492268_03-09-2025_15_42_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26492268 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26492268 AND mptpi.`type`=3594 To do Qualite : 0.03993974264039564 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26479246_03-09-2025_10_13_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26479246 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26479246 AND mptpi.`type`=3726 To do Qualite : 0.040500265772951315 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26482157_03-09-2025_11_12_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26482157 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26482157 AND mptpi.`type`=3726 To do Qualite : 0.021976532867700977 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26482163_03-09-2025_11_06_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26482163 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26482163 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26491437 order by id desc limit 1 Qualite : 0.06122043788580245 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26487565_03-09-2025_13_42_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26487565 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26487565 AND mptpi.`type`=3594 To do Qualite : 0.06982871977880656 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26489096_03-09-2025_14_17_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26489096 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26489096 AND mptpi.`type`=3594 To do Qualite : 0.028099811787241708 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26489121_03-09-2025_14_16_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26489121 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26489121 AND mptpi.`type`=3726 To do Qualite : 0.11959475396324351 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26492294_03-09-2025_15_46_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26492294 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26492294 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03092025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1381125730, 1381125685, 1381125655, 1381125619, 1381125539, 1381124882, 1381124823, 1381124766, 1381124700, 1381124579, 1381123908] Looping around the photos to save general results len do output : 1 /26492294Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125730', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125685', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125655', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125619', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381125539', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124882', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124823', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124766', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124700', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381124579', None, None, None, None, None, '3659209') ('3318', None, None, None, None, None, None, None, '3659209') ('3318', '26492294', '1381123908', None, None, None, None, None, '3659209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014864206314086914 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9223723411560059 time spend to save output : 0.015189886093139648 total time spend for step 10 : 1.9375622272491455 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 176.88user 136.37system 6:09.10elapsed 84%CPU (0avgtext+0avgdata 3844440maxresident)k 1183592inputs+170512outputs (23879major+14580639minor)pagefaults 0swaps