python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3150529 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2627073'] with mtr_portfolio_ids : ['20951095'] and first list_photo_ids : [] new path : /proc/3150529/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.41384434700012207 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Mar 1 21:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5525 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-01 21:20:34.864135: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-01 21:20:34.895149: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-01 21:20:34.897776: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6780000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-01 21:20:34.897835: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-01 21:20:34.903349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-01 21:20:35.164185: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x46f0800 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-01 21:20:35.164249: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-01 21:20:35.166087: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 21:20:35.167844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 21:20:35.199805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 21:20:35.218941: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 21:20:35.223722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 21:20:35.255876: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 21:20:35.260660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 21:20:35.316830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 21:20:35.318425: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 21:20:35.318880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 21:20:35.320489: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-01 21:20:35.320512: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-01 21:20:35.320521: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-01 21:20:35.321861: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-01 21:20:35.740808: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 21:20:35.740930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 21:20:35.740948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 21:20:35.740964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 21:20:35.740980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 21:20:35.740995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 21:20:35.741009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 21:20:35.741025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 21:20:35.741993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 21:20:35.743269: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 21:20:35.743317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 21:20:35.743343: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 21:20:35.743365: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 21:20:35.743384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 21:20:35.743403: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 21:20:35.743422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 21:20:35.743440: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 21:20:35.744629: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 21:20:35.744679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-01 21:20:35.744691: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-01 21:20:35.744701: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-01 21:20:35.745967: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-01 21:20:43.875344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 21:20:44.222159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.75078 max: 149.49062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0008141994476318359 length of segment : 35 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.00018835067749023438 length of segment : 28 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0009903907775878906 length of segment : 14 length of segment : 0 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 595 time to create 1 rle with old method : 0.001386880874633789 length of segment : 60 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.001310110092163086 length of segment : 79 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0008385181427001953 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.91094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 930 time to create 1 rle with old method : 0.0016105175018310547 length of segment : 50 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0004074573516845703 length of segment : 32 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0006558895111083984 length of segment : 43 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 2442 time to create 1 rle with old method : 0.0037050247192382812 length of segment : 48 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 2443 time to create 1 rle with old method : 0.0036230087280273438 length of segment : 51 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 2810 time to create 1 rle with old method : 0.004037618637084961 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 5 time to create 1 rle with old method : 3.790855407714844e-05 length of segment : 2 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 1398 time to create 1 rle with old method : 0.0021827220916748047 length of segment : 56 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.82891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00021004676818847656 nb_pixel_total : 9669 time to create 1 rle with old method : 0.01523447036743164 length of segment : 78 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0017600059509277344 length of segment : 74 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0008289813995361328 length of segment : 24 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0008041858673095703 length of segment : 21 time for calcul the mask position with numpy : 0.00016570091247558594 nb_pixel_total : 1496 time to create 1 rle with old method : 0.0035254955291748047 length of segment : 35 time for calcul the mask position with numpy : 0.000102996826171875 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0025184154510498047 length of segment : 45 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 1643 time to create 1 rle with old method : 0.0028162002563476562 length of segment : 42 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0004553794860839844 length of segment : 19 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1127 time to create 1 rle with old method : 0.001566171646118164 length of segment : 55 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 224.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 98.43984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0008189678192138672 length of segment : 17 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0016148090362548828 length of segment : 75 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1651 time to create 1 rle with old method : 0.002530336380004883 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -101.27813 max: 69.95547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.53984 max: 133.56484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 0.00010895729064941406 nb_pixel_total : 373 time to create 1 rle with old method : 0.0009999275207519531 length of segment : 29 time for calcul the mask position with numpy : 0.0005724430084228516 nb_pixel_total : 20248 time to create 1 rle with old method : 0.04396939277648926 length of segment : 228 time for calcul the mask position with numpy : 0.00015401840209960938 nb_pixel_total : 739 time to create 1 rle with old method : 0.0020401477813720703 length of segment : 41 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0008420944213867188 length of segment : 15 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 362 time to create 1 rle with old method : 0.0010776519775390625 length of segment : 25 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 430 time to create 1 rle with old method : 0.0011844635009765625 length of segment : 20 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 349 time to create 1 rle with old method : 0.0012331008911132812 length of segment : 21 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 302 time to create 1 rle with old method : 0.000888824462890625 length of segment : 24 time for calcul the mask position with numpy : 0.000179290771484375 nb_pixel_total : 512 time to create 1 rle with old method : 0.0014286041259765625 length of segment : 33 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0013773441314697266 length of segment : 23 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0009109973907470703 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.51250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00031566619873046875 length of segment : 18 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1295 time to create 1 rle with old method : 0.0019683837890625 length of segment : 34 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.000993490219116211 length of segment : 26 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0006704330444335938 length of segment : 27 time for calcul the mask position with numpy : 0.0002372264862060547 nb_pixel_total : 7567 time to create 1 rle with old method : 0.010984420776367188 length of segment : 140 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 1535 time to create 1 rle with old method : 0.0024230480194091797 length of segment : 46 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0005145072937011719 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.40703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.0002675056457519531 nb_pixel_total : 13650 time to create 1 rle with old method : 0.01854109764099121 length of segment : 171 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 976 time to create 1 rle with old method : 0.00133514404296875 length of segment : 45 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 844 time to create 1 rle with old method : 0.0011398792266845703 length of segment : 64 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 1622 time to create 1 rle with old method : 0.002199411392211914 length of segment : 101 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1285 time to create 1 rle with old method : 0.0017313957214355469 length of segment : 46 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1400 time to create 1 rle with old method : 0.001960277557373047 length of segment : 48 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 243.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 126.38906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.250640869140625e-05 nb_pixel_total : 2715 time to create 1 rle with old method : 0.003651857376098633 length of segment : 208 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 1803 time to create 1 rle with old method : 0.0028781890869140625 length of segment : 85 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 666 time to create 1 rle with old method : 0.0009167194366455078 length of segment : 41 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 2901 time to create 1 rle with old method : 0.0039141178131103516 length of segment : 141 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 1797 time to create 1 rle with old method : 0.002395153045654297 length of segment : 90 Processing 1 images image shape: (280, 400, 3) min: 5.00000 max: 178.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 50.43594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009565353393554688 nb_pixel_total : 105661 time to create 1 rle with old method : 0.13039636611938477 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.35625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0004923343658447266 length of segment : 11 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 3193 time to create 1 rle with old method : 0.0051708221435546875 length of segment : 46 time for calcul the mask position with numpy : 0.00011754035949707031 nb_pixel_total : 3317 time to create 1 rle with old method : 0.005358695983886719 length of segment : 115 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 867 time to create 1 rle with old method : 0.001495361328125 length of segment : 31 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003879070281982422 length of segment : 38 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00016379356384277344 length of segment : 11 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0009412765502929688 length of segment : 21 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0003170967102050781 length of segment : 13 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.000141143798828125 length of segment : 10 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.0002856254577636719 length of segment : 15 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0005495548248291016 length of segment : 17 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 7 time to create 1 rle with old method : 3.3855438232421875e-05 length of segment : 5 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00024962425231933594 length of segment : 15 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 3274 time to create 1 rle with old method : 0.004755258560180664 length of segment : 78 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.001009225845336914 length of segment : 27 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 635 time to create 1 rle with old method : 0.0012917518615722656 length of segment : 35 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0003781318664550781 length of segment : 14 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 601 time to create 1 rle with old method : 0.0012688636779785156 length of segment : 29 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 128.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00037217140197753906 length of segment : 15 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.0002694129943847656 length of segment : 11 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00037932395935058594 length of segment : 19 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002789497375488281 length of segment : 19 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0004489421844482422 length of segment : 29 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003342628479003906 length of segment : 17 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.001360177993774414 length of segment : 38 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0006353855133056641 length of segment : 16 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0004813671112060547 length of segment : 23 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0008192062377929688 length of segment : 16 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0005319118499755859 length of segment : 31 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.32656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0005025863647460938 length of segment : 39 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0004699230194091797 length of segment : 22 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.00072479248046875 length of segment : 39 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004911422729492188 length of segment : 20 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0005218982696533203 length of segment : 30 time for calcul the mask position with numpy : 0.0004565715789794922 nb_pixel_total : 22035 time to create 1 rle with old method : 0.035672903060913086 length of segment : 446 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0004901885986328125 length of segment : 59 time for calcul the mask position with numpy : 0.00044727325439453125 nb_pixel_total : 30738 time to create 1 rle with old method : 0.04320478439331055 length of segment : 253 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0008957386016845703 length of segment : 54 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.47734 max: 148.80703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 572 time to create 1 rle with old method : 0.0009746551513671875 length of segment : 59 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00041747093200683594 length of segment : 26 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 2694 time to create 1 rle with old method : 0.0038826465606689453 length of segment : 63 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.001154184341430664 length of segment : 67 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 902 time to create 1 rle with old method : 0.0012776851654052734 length of segment : 90 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0009129047393798828 length of segment : 61 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 841 time to create 1 rle with old method : 0.0011916160583496094 length of segment : 55 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 2563 time to create 1 rle with old method : 0.003568410873413086 length of segment : 51 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2661 time to create 1 rle with old method : 0.003650665283203125 length of segment : 53 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.0005524158477783203 length of segment : 33 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.0012285709381103516 length of segment : 40 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0006487369537353516 length of segment : 33 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 2890 time to create 1 rle with old method : 0.004927396774291992 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.68828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010919570922851562 nb_pixel_total : 1355 time to create 1 rle with old method : 0.0020017623901367188 length of segment : 103 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 1016 time to create 1 rle with old method : 0.00160980224609375 length of segment : 94 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 549 time to create 1 rle with old method : 0.0009169578552246094 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.07500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 751 time to create 1 rle with old method : 0.0012042522430419922 length of segment : 43 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 9433 time to create 1 rle with old method : 0.012673377990722656 length of segment : 80 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1381 time to create 1 rle with old method : 0.0018682479858398438 length of segment : 52 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0007803440093994141 length of segment : 24 time for calcul the mask position with numpy : 0.00015664100646972656 nb_pixel_total : 1468 time to create 1 rle with old method : 0.0021851062774658203 length of segment : 31 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 232.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 112.58047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.000978231430053711 length of segment : 19 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0005424022674560547 length of segment : 30 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1997 time to create 1 rle with old method : 0.0032961368560791016 length of segment : 61 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 3636 time to create 1 rle with old method : 0.004713535308837891 length of segment : 63 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 156.00000 molded_images shape: (1, 640, 640, 3) min: -98.56328 max: 48.24062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.99688 max: 132.61953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0005474090576171875 length of segment : 16 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0006794929504394531 length of segment : 20 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0008752346038818359 length of segment : 36 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 597 time to create 1 rle with old method : 0.0009856224060058594 length of segment : 25 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0006842613220214844 length of segment : 24 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003821849822998047 length of segment : 15 time for calcul the mask position with numpy : 0.000274658203125 nb_pixel_total : 14451 time to create 1 rle with old method : 0.020555734634399414 length of segment : 174 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 2495 time to create 1 rle with old method : 0.003642559051513672 length of segment : 48 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00022649765014648438 length of segment : 13 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0006072521209716797 length of segment : 20 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0005221366882324219 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.89922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005831718444824219 length of segment : 41 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 35 time to create 1 rle with old method : 0.0001163482666015625 length of segment : 5 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0007030963897705078 length of segment : 27 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 603 time to create 1 rle with old method : 0.000957489013671875 length of segment : 26 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00030922889709472656 length of segment : 17 time for calcul the mask position with numpy : 0.00023937225341796875 nb_pixel_total : 5717 time to create 1 rle with old method : 0.008333206176757812 length of segment : 153 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.000431060791015625 length of segment : 20 time for calcul the mask position with numpy : 0.00015401840209960938 nb_pixel_total : 1943 time to create 1 rle with old method : 0.002914905548095703 length of segment : 60 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0003104209899902344 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.60625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.0002703666687011719 nb_pixel_total : 17262 time to create 1 rle with old method : 0.022993087768554688 length of segment : 146 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0018711090087890625 length of segment : 80 time for calcul the mask position with numpy : 0.0002415180206298828 nb_pixel_total : 3334 time to create 1 rle with old method : 0.005067348480224609 length of segment : 183 time for calcul the mask position with numpy : 0.00019693374633789062 nb_pixel_total : 11499 time to create 1 rle with old method : 0.016369342803955078 length of segment : 119 time for calcul the mask position with numpy : 0.00010919570922851562 nb_pixel_total : 910 time to create 1 rle with old method : 0.0014104843139648438 length of segment : 43 time for calcul the mask position with numpy : 0.0007069110870361328 nb_pixel_total : 36589 time to create 1 rle with old method : 0.05147147178649902 length of segment : 348 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 253.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 115.86953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0017130374908447266 length of segment : 123 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 646 time to create 1 rle with old method : 0.0008935928344726562 length of segment : 41 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0007503032684326172 length of segment : 51 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1911 time to create 1 rle with old method : 0.0024945735931396484 length of segment : 89 time for calcul the mask position with numpy : 0.0001621246337890625 nb_pixel_total : 4807 time to create 1 rle with old method : 0.0070416927337646484 length of segment : 214 Processing 1 images image shape: (280, 400, 3) min: 14.00000 max: 133.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 24.27969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010106563568115234 nb_pixel_total : 106000 time to create 1 rle with old method : 0.1712963581085205 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.89141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1522 time to create 1 rle with old method : 0.0020737648010253906 length of segment : 37 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003924369812011719 length of segment : 12 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002410411834716797 length of segment : 13 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00019812583923339844 length of segment : 15 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00031185150146484375 length of segment : 35 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 2220 time to create 1 rle with old method : 0.0030188560485839844 length of segment : 83 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.00014591217041015625 length of segment : 13 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0008056163787841797 length of segment : 21 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0007240772247314453 length of segment : 56 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 52 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 1991 time to create 1 rle with old method : 0.0034656524658203125 length of segment : 116 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0009748935699462891 length of segment : 20 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1673 time to create 1 rle with old method : 0.003284931182861328 length of segment : 74 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00017595291137695312 length of segment : 9 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0006048679351806641 length of segment : 19 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 2843 time to create 1 rle with old method : 0.0052187442779541016 length of segment : 45 time for calcul the mask position with numpy : 0.0005621910095214844 nb_pixel_total : 33925 time to create 1 rle with old method : 0.04463791847229004 length of segment : 242 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.000885009765625 length of segment : 31 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 657 time to create 1 rle with old method : 0.0008919239044189453 length of segment : 30 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 619 time to create 1 rle with old method : 0.0009472370147705078 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 119.06094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001766681671142578 length of segment : 12 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0003113746643066406 length of segment : 18 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00022935867309570312 length of segment : 11 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003173351287841797 length of segment : 21 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003495216369628906 length of segment : 19 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004608631134033203 length of segment : 31 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003426074981689453 length of segment : 13 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.00034737586975097656 length of segment : 13 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.000537872314453125 length of segment : 22 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.56875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0005385875701904297 length of segment : 41 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 2063 time to create 1 rle with old method : 0.0041964054107666016 length of segment : 81 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0010149478912353516 length of segment : 35 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003464221954345703 length of segment : 9 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 1266 time to create 1 rle with old method : 0.0025475025177001953 length of segment : 112 time for calcul the mask position with numpy : 0.00044727325439453125 nb_pixel_total : 21478 time to create 1 rle with old method : 0.033017873764038086 length of segment : 334 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 36688 time to create 1 rle with old method : 0.04391598701477051 length of segment : 244 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.00020694732666015625 length of segment : 30 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.63750 max: 145.22891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0006194114685058594 length of segment : 35 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00011944770812988281 length of segment : 24 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 50 time to create 1 rle with old method : 0.00013327598571777344 length of segment : 20 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0005619525909423828 length of segment : 40 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 653 time to create 1 rle with old method : 0.0012962818145751953 length of segment : 77 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.45781 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0006313323974609375 length of segment : 38 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0008249282836914062 length of segment : 28 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 674 time to create 1 rle with old method : 0.0012900829315185547 length of segment : 47 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 1037 time to create 1 rle with old method : 0.0020999908447265625 length of segment : 32 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0008208751678466797 length of segment : 33 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0005636215209960938 length of segment : 31 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1472 time to create 1 rle with old method : 0.002029895782470703 length of segment : 47 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 16 time to create 1 rle with old method : 5.6743621826171875e-05 length of segment : 3 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 1641 time to create 1 rle with old method : 0.002220630645751953 length of segment : 77 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 1859 time to create 1 rle with old method : 0.002466917037963867 length of segment : 83 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 920 time to create 1 rle with old method : 0.0017669200897216797 length of segment : 48 time for calcul the mask position with numpy : 0.0002796649932861328 nb_pixel_total : 3049 time to create 1 rle with old method : 0.004366159439086914 length of segment : 169 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0011458396911621094 length of segment : 38 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0004227161407470703 length of segment : 31 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0014247894287109375 length of segment : 29 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1779 time to create 1 rle with old method : 0.0022389888763427734 length of segment : 74 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.26250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.0012729167938232422 length of segment : 64 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 827 time to create 1 rle with old method : 0.0013365745544433594 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.49297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003342628479003906 length of segment : 21 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1026 time to create 1 rle with old method : 0.0018284320831298828 length of segment : 81 time for calcul the mask position with numpy : 0.0001895427703857422 nb_pixel_total : 9516 time to create 1 rle with old method : 0.016550302505493164 length of segment : 79 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00037932395935058594 length of segment : 21 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0005078315734863281 length of segment : 18 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.0016701221466064453 length of segment : 52 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0018122196197509766 length of segment : 50 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 1685 time to create 1 rle with old method : 0.0026395320892333984 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 231.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 100.90469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0007383823394775391 length of segment : 18 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1247 time to create 1 rle with old method : 0.0016341209411621094 length of segment : 80 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1192 time to create 1 rle with old method : 0.0017168521881103516 length of segment : 44 time for calcul the mask position with numpy : 0.0006392002105712891 nb_pixel_total : 62054 time to create 1 rle with old method : 0.08017230033874512 length of segment : 343 time for calcul the mask position with numpy : 0.0009942054748535156 nb_pixel_total : 60862 time to create 1 rle with old method : 0.08789348602294922 length of segment : 286 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -103.66484 max: 66.39687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.88359 max: 138.20937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 0.00026035308837890625 nb_pixel_total : 12909 time to create 1 rle with old method : 0.018393754959106445 length of segment : 227 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0006265640258789062 length of segment : 19 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005767345428466797 length of segment : 20 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00044465065002441406 length of segment : 15 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005972385406494141 length of segment : 26 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0008039474487304688 length of segment : 27 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0008575916290283203 length of segment : 21 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00016832351684570312 length of segment : 11 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0006315708160400391 length of segment : 29 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.0003638267517089844 length of segment : 12 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005586147308349609 length of segment : 20 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0008790493011474609 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.60625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 37 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0006747245788574219 length of segment : 26 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1319 time to create 1 rle with old method : 0.0023527145385742188 length of segment : 35 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0021512508392333984 length of segment : 43 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0020613670349121094 length of segment : 47 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 30 time to create 1 rle with old method : 8.749961853027344e-05 length of segment : 5 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00028014183044433594 length of segment : 17 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.0002155303955078125 length of segment : 9 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0004763603210449219 length of segment : 18 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1313 time to create 1 rle with old method : 0.002265453338623047 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.60625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 1510 time to create 1 rle with old method : 0.0026602745056152344 length of segment : 80 time for calcul the mask position with numpy : 0.00024175643920898438 nb_pixel_total : 13231 time to create 1 rle with old method : 0.02011251449584961 length of segment : 181 time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 4469 time to create 1 rle with old method : 0.00714874267578125 length of segment : 114 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 920 time to create 1 rle with old method : 0.0012385845184326172 length of segment : 44 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0018241405487060547 length of segment : 81 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0003705024719238281 length of segment : 7 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0021848678588867188 length of segment : 30 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 123.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 726 time to create 1 rle with old method : 0.0021827220916748047 length of segment : 44 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 152.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 36.63516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012362003326416016 nb_pixel_total : 105869 time to create 1 rle with old method : 0.15982604026794434 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.68437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003821849822998047 length of segment : 11 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 3247 time to create 1 rle with old method : 0.004446268081665039 length of segment : 50 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0008072853088378906 length of segment : 26 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 4291 time to create 1 rle with old method : 0.0055768489837646484 length of segment : 76 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003151893615722656 length of segment : 38 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.0008647441864013672 length of segment : 28 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.0002493858337402344 length of segment : 13 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00018358230590820312 length of segment : 14 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 825 time to create 1 rle with old method : 0.001142263412475586 length of segment : 127 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 2081 time to create 1 rle with old method : 0.0029947757720947266 length of segment : 98 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00014138221740722656 length of segment : 9 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006773471832275391 length of segment : 25 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006816387176513672 length of segment : 44 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004208087921142578 length of segment : 19 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0009100437164306641 length of segment : 20 time for calcul the mask position with numpy : 2.6226043701171875e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.00011682510375976562 length of segment : 10 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006687641143798828 length of segment : 27 time for calcul the mask position with numpy : 8.940696716308594e-05 nb_pixel_total : 4155 time to create 1 rle with old method : 0.007042646408081055 length of segment : 72 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0004513263702392578 length of segment : 17 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0007269382476806641 length of segment : 32 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 1819 time to create 1 rle with old method : 0.00415802001953125 length of segment : 43 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 125.13906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.00030875205993652344 length of segment : 13 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00035071372985839844 length of segment : 18 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004246234893798828 length of segment : 30 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00032401084899902344 length of segment : 13 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00036334991455078125 length of segment : 17 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.00042438507080078125 length of segment : 21 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00042557716369628906 length of segment : 14 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0004494190216064453 length of segment : 32 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.73672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.0005507469177246094 length of segment : 23 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 1706 time to create 1 rle with old method : 0.0027794837951660156 length of segment : 90 time for calcul the mask position with numpy : 0.0005371570587158203 nb_pixel_total : 34730 time to create 1 rle with old method : 0.06057381629943848 length of segment : 255 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 730 time to create 1 rle with old method : 0.001486063003540039 length of segment : 50 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0003414154052734375 length of segment : 9 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0008177757263183594 length of segment : 59 Detection mask done ! Trying to reset tf kernel 3150886 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 291 len(list_Values) 291 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 291 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 291 chid ids of type : 4228 Number RLEs to save : 16004 save missing photos in datou_result : time spend for datou_step_exec : 29.58756375312805 time spend to save output : 1.1516926288604736 total time spend for step 1 : 30.739256381988525 step2:brightness Sat Mar 1 21:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740860430_3150529_1340418320_2ea66dbd4c1e11776eeb301e88b29052.jpg treat image : temp/1740860430_3150529_1340418304_8a151d03bc14f375f2eb30aac860ab2e.jpg treat image : temp/1740860430_3150529_1340418272_75aea1860ca13ad30e6a9d940ee7b06f.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.012320756912231445 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.013371944427490234 save missing photos in datou_result : time spend for datou_step_exec : 1.0124504566192627 time spend to save output : 0.030126571655273438 total time spend for step 2 : 1.0425770282745361 step3:blur_detection Sat Mar 1 21:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740860430_3150529_1340418320_2ea66dbd4c1e11776eeb301e88b29052.jpg resize: (1080, 1920) 1340418320 -7.23524117379197 treat image : temp/1740860430_3150529_1340418304_8a151d03bc14f375f2eb30aac860ab2e.jpg resize: (1080, 1920) 1340418304 -6.649461433823994 treat image : temp/1740860430_3150529_1340418272_75aea1860ca13ad30e6a9d940ee7b06f.jpg resize: (1080, 1920) 1340418272 -7.056372716280913 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.013835668563842773 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.013386726379394531 save missing photos in datou_result : time spend for datou_step_exec : 3.466780662536621 time spend to save output : 0.03194928169250488 total time spend for step 3 : 3.498729944229126 step4:rle_unique_nms_with_priority Sat Mar 1 21:21:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 291 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 93 nb_hashtags : 7 time to prepare the origin masks : 1.2856147289276123 time for calcul the mask position with numpy : 0.19668197631835938 nb_pixel_total : 1812517 time to create 1 rle with new method : 0.46879005432128906 time for calcul the mask position with numpy : 0.009084939956665039 nb_pixel_total : 1398 time to create 1 rle with old method : 0.0018017292022705078 time for calcul the mask position with numpy : 0.00914311408996582 nb_pixel_total : 238 time to create 1 rle with old method : 0.00039458274841308594 time for calcul the mask position with numpy : 0.010679483413696289 nb_pixel_total : 168 time to create 1 rle with old method : 0.00036525726318359375 time for calcul the mask position with numpy : 0.009700775146484375 nb_pixel_total : 133 time to create 1 rle with old method : 0.0002300739288330078 time for calcul the mask position with numpy : 0.0108489990234375 nb_pixel_total : 69 time to create 1 rle with old method : 0.00013756752014160156 time for calcul the mask position with numpy : 0.010496377944946289 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005908012390136719 time for calcul the mask position with numpy : 0.011403322219848633 nb_pixel_total : 930 time to create 1 rle with old method : 0.0016512870788574219 time for calcul the mask position with numpy : 0.011480331420898438 nb_pixel_total : 595 time to create 1 rle with old method : 0.0012543201446533203 time for calcul the mask position with numpy : 0.011555194854736328 nb_pixel_total : 247 time to create 1 rle with old method : 0.0004999637603759766 time for calcul the mask position with numpy : 0.012180566787719727 nb_pixel_total : 2442 time to create 1 rle with old method : 0.004065036773681641 time for calcul the mask position with numpy : 0.01150655746459961 nb_pixel_total : 128 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.011557579040527344 nb_pixel_total : 5 time to create 1 rle with old method : 3.933906555175781e-05 time for calcul the mask position with numpy : 0.011631250381469727 nb_pixel_total : 1113 time to create 1 rle with old method : 0.001894235610961914 time for calcul the mask position with numpy : 0.011520862579345703 nb_pixel_total : 421 time to create 1 rle with old method : 0.0007219314575195312 time for calcul the mask position with numpy : 0.011198759078979492 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0019865036010742188 time for calcul the mask position with numpy : 0.011354684829711914 nb_pixel_total : 234 time to create 1 rle with old method : 0.0004227161407470703 time for calcul the mask position with numpy : 0.011149883270263672 nb_pixel_total : 412 time to create 1 rle with old method : 0.0007185935974121094 time for calcul the mask position with numpy : 0.011115789413452148 nb_pixel_total : 27 time to create 1 rle with old method : 0.0001068115234375 time for calcul the mask position with numpy : 0.011102437973022461 nb_pixel_total : 406 time to create 1 rle with old method : 0.0007340908050537109 time for calcul the mask position with numpy : 0.011425971984863281 nb_pixel_total : 9669 time to create 1 rle with old method : 0.015675783157348633 time for calcul the mask position with numpy : 0.011431694030761719 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0018684864044189453 time for calcul the mask position with numpy : 0.011158943176269531 nb_pixel_total : 1651 time to create 1 rle with old method : 0.002655029296875 time for calcul the mask position with numpy : 0.011037826538085938 nb_pixel_total : 134 time to create 1 rle with old method : 0.000270843505859375 time for calcul the mask position with numpy : 0.011066436767578125 nb_pixel_total : 1496 time to create 1 rle with old method : 0.0024063587188720703 time for calcul the mask position with numpy : 0.011037349700927734 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004875659942626953 time for calcul the mask position with numpy : 0.009375333786010742 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006134510040283203 time for calcul the mask position with numpy : 0.008524894714355469 nb_pixel_total : 1295 time to create 1 rle with old method : 0.0016329288482666016 time for calcul the mask position with numpy : 0.008592844009399414 nb_pixel_total : 1535 time to create 1 rle with old method : 0.0019335746765136719 time for calcul the mask position with numpy : 0.008643865585327148 nb_pixel_total : 13650 time to create 1 rle with old method : 0.016720294952392578 time for calcul the mask position with numpy : 0.008696794509887695 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007243156433105469 time for calcul the mask position with numpy : 0.00856637954711914 nb_pixel_total : 976 time to create 1 rle with old method : 0.001238107681274414 time for calcul the mask position with numpy : 0.008600234985351562 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003590583801269531 time for calcul the mask position with numpy : 0.008528709411621094 nb_pixel_total : 170 time to create 1 rle with old method : 0.00025916099548339844 time for calcul the mask position with numpy : 0.008611679077148438 nb_pixel_total : 1285 time to create 1 rle with old method : 0.0016672611236572266 time for calcul the mask position with numpy : 0.008736848831176758 nb_pixel_total : 666 time to create 1 rle with old method : 0.0008678436279296875 time for calcul the mask position with numpy : 0.008939266204833984 nb_pixel_total : 7567 time to create 1 rle with old method : 0.009210824966430664 time for calcul the mask position with numpy : 0.00881814956665039 nb_pixel_total : 20248 time to create 1 rle with old method : 0.024793386459350586 time for calcul the mask position with numpy : 0.00871729850769043 nb_pixel_total : 106 time to create 1 rle with old method : 0.00018215179443359375 time for calcul the mask position with numpy : 0.008714675903320312 nb_pixel_total : 744 time to create 1 rle with old method : 0.001024007797241211 time for calcul the mask position with numpy : 0.00875401496887207 nb_pixel_total : 844 time to create 1 rle with old method : 0.0010714530944824219 time for calcul the mask position with numpy : 0.008713960647583008 nb_pixel_total : 2715 time to create 1 rle with old method : 0.0035135746002197266 time for calcul the mask position with numpy : 0.008729696273803711 nb_pixel_total : 1622 time to create 1 rle with old method : 0.002048969268798828 time for calcul the mask position with numpy : 0.008700370788574219 nb_pixel_total : 389 time to create 1 rle with old method : 0.0006797313690185547 time for calcul the mask position with numpy : 0.008724451065063477 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003802776336669922 time for calcul the mask position with numpy : 0.008562326431274414 nb_pixel_total : 459 time to create 1 rle with old method : 0.0006847381591796875 time for calcul the mask position with numpy : 0.008492231369018555 nb_pixel_total : 21 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.00849151611328125 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006647109985351562 time for calcul the mask position with numpy : 0.008506059646606445 nb_pixel_total : 95 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.008472442626953125 nb_pixel_total : 1803 time to create 1 rle with old method : 0.0022101402282714844 time for calcul the mask position with numpy : 0.00857686996459961 nb_pixel_total : 34 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.008510828018188477 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004799365997314453 time for calcul the mask position with numpy : 0.008514404296875 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005669593811035156 time for calcul the mask position with numpy : 0.00850224494934082 nb_pixel_total : 739 time to create 1 rle with old method : 0.0009479522705078125 time for calcul the mask position with numpy : 0.008484840393066406 nb_pixel_total : 302 time to create 1 rle with old method : 0.0004363059997558594 time for calcul the mask position with numpy : 0.009357452392578125 nb_pixel_total : 105661 time to create 1 rle with old method : 0.12210416793823242 time for calcul the mask position with numpy : 0.008848428726196289 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003330707550048828 time for calcul the mask position with numpy : 0.008195638656616211 nb_pixel_total : 141 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.008239269256591797 nb_pixel_total : 16 time to create 1 rle with old method : 3.361701965332031e-05 time for calcul the mask position with numpy : 0.008086919784545898 nb_pixel_total : 71 time to create 1 rle with old method : 9.679794311523438e-05 time for calcul the mask position with numpy : 0.007990360260009766 nb_pixel_total : 498 time to create 1 rle with old method : 0.0006351470947265625 time for calcul the mask position with numpy : 0.008144617080688477 nb_pixel_total : 635 time to create 1 rle with old method : 0.0007886886596679688 time for calcul the mask position with numpy : 0.008183956146240234 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.008067607879638672 nb_pixel_total : 230 time to create 1 rle with old method : 0.00031876564025878906 time for calcul the mask position with numpy : 0.008271455764770508 nb_pixel_total : 7 time to create 1 rle with old method : 1.5020370483398438e-05 time for calcul the mask position with numpy : 0.008032560348510742 nb_pixel_total : 159 time to create 1 rle with old method : 0.00017786026000976562 time for calcul the mask position with numpy : 0.007951974868774414 nb_pixel_total : 21184 time to create 1 rle with old method : 0.024428129196166992 time for calcul the mask position with numpy : 0.007995843887329102 nb_pixel_total : 31 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.008033037185668945 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003352165222167969 time for calcul the mask position with numpy : 0.008044958114624023 nb_pixel_total : 154 time to create 1 rle with old method : 0.00017976760864257812 time for calcul the mask position with numpy : 0.00803065299987793 nb_pixel_total : 30738 time to create 1 rle with old method : 0.03579974174499512 time for calcul the mask position with numpy : 0.008203744888305664 nb_pixel_total : 275 time to create 1 rle with old method : 0.00035762786865234375 time for calcul the mask position with numpy : 0.00805807113647461 nb_pixel_total : 3274 time to create 1 rle with old method : 0.0039060115814208984 time for calcul the mask position with numpy : 0.008200645446777344 nb_pixel_total : 111 time to create 1 rle with old method : 0.00014925003051757812 time for calcul the mask position with numpy : 0.008240222930908203 nb_pixel_total : 341 time to create 1 rle with old method : 0.0004565715789794922 time for calcul the mask position with numpy : 0.008151531219482422 nb_pixel_total : 14 time to create 1 rle with old method : 3.361701965332031e-05 time for calcul the mask position with numpy : 0.008020639419555664 nb_pixel_total : 308 time to create 1 rle with old method : 0.0003936290740966797 time for calcul the mask position with numpy : 0.009416341781616211 nb_pixel_total : 85 time to create 1 rle with old method : 0.0002675056457519531 time for calcul the mask position with numpy : 0.017015695571899414 nb_pixel_total : 23 time to create 1 rle with old method : 0.00010514259338378906 time for calcul the mask position with numpy : 0.011332035064697266 nb_pixel_total : 3193 time to create 1 rle with old method : 0.006165027618408203 time for calcul the mask position with numpy : 0.01050877571105957 nb_pixel_total : 627 time to create 1 rle with old method : 0.0008289813995361328 time for calcul the mask position with numpy : 0.008651256561279297 nb_pixel_total : 259 time to create 1 rle with old method : 0.00034689903259277344 time for calcul the mask position with numpy : 0.00872039794921875 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006570816040039062 time for calcul the mask position with numpy : 0.008781194686889648 nb_pixel_total : 255 time to create 1 rle with old method : 0.00034809112548828125 time for calcul the mask position with numpy : 0.008719205856323242 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004088878631591797 time for calcul the mask position with numpy : 0.00864267349243164 nb_pixel_total : 867 time to create 1 rle with old method : 0.0011210441589355469 time for calcul the mask position with numpy : 0.009649038314819336 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009882450103759766 time for calcul the mask position with numpy : 0.00859379768371582 nb_pixel_total : 3317 time to create 1 rle with old method : 0.004226207733154297 time for calcul the mask position with numpy : 0.008526086807250977 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003199577331542969 time for calcul the mask position with numpy : 0.008516550064086914 nb_pixel_total : 212 time to create 1 rle with old method : 0.00028634071350097656 time for calcul the mask position with numpy : 0.008436441421508789 nb_pixel_total : 210 time to create 1 rle with old method : 0.00027489662170410156 time for calcul the mask position with numpy : 0.008451461791992188 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004711151123046875 time for calcul the mask position with numpy : 0.008400917053222656 nb_pixel_total : 181 time to create 1 rle with old method : 0.00023603439331054688 time for calcul the mask position with numpy : 0.00856161117553711 nb_pixel_total : 18 time to create 1 rle with old method : 5.7220458984375e-05 create new chi : 1.8732001781463623 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.005883693695068359 batch 1 Loaded 94 chid ids of type : 4230 Number RLEs to save : 10034 TO DO : save crop sub photo not yet done ! save time : 0.649601936340332 nb_obj : 94 nb_hashtags : 8 time to prepare the origin masks : 2.9839460849761963 time for calcul the mask position with numpy : 0.16172504425048828 nb_pixel_total : 1732644 time to create 1 rle with new method : 0.1463611125946045 time for calcul the mask position with numpy : 0.0065762996673583984 nb_pixel_total : 1355 time to create 1 rle with old method : 0.0016827583312988281 time for calcul the mask position with numpy : 0.00673985481262207 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003063678741455078 time for calcul the mask position with numpy : 0.006581306457519531 nb_pixel_total : 19 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.006814479827880859 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003571510314941406 time for calcul the mask position with numpy : 0.006463766098022461 nb_pixel_total : 572 time to create 1 rle with old method : 0.0007586479187011719 time for calcul the mask position with numpy : 0.006411552429199219 nb_pixel_total : 593 time to create 1 rle with old method : 0.0007894039154052734 time for calcul the mask position with numpy : 0.006439924240112305 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003223419189453125 time for calcul the mask position with numpy : 0.006469249725341797 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003085136413574219 time for calcul the mask position with numpy : 0.0065174102783203125 nb_pixel_total : 2563 time to create 1 rle with old method : 0.0031585693359375 time for calcul the mask position with numpy : 0.006387948989868164 nb_pixel_total : 158 time to create 1 rle with old method : 0.00026345252990722656 time for calcul the mask position with numpy : 0.006503105163574219 nb_pixel_total : 902 time to create 1 rle with old method : 0.0011432170867919922 time for calcul the mask position with numpy : 0.006374835968017578 nb_pixel_total : 1016 time to create 1 rle with old method : 0.0013132095336914062 time for calcul the mask position with numpy : 0.006700038909912109 nb_pixel_total : 2694 time to create 1 rle with old method : 0.003325939178466797 time for calcul the mask position with numpy : 0.006800651550292969 nb_pixel_total : 841 time to create 1 rle with old method : 0.001043558120727539 time for calcul the mask position with numpy : 0.007068157196044922 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003578662872314453 time for calcul the mask position with numpy : 0.0071370601654052734 nb_pixel_total : 915 time to create 1 rle with old method : 0.001155853271484375 time for calcul the mask position with numpy : 0.007043600082397461 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005807876586914062 time for calcul the mask position with numpy : 0.006890535354614258 nb_pixel_total : 549 time to create 1 rle with old method : 0.0007610321044921875 time for calcul the mask position with numpy : 0.0074999332427978516 nb_pixel_total : 751 time to create 1 rle with old method : 0.0009748935699462891 time for calcul the mask position with numpy : 0.007216930389404297 nb_pixel_total : 3636 time to create 1 rle with old method : 0.0044863224029541016 time for calcul the mask position with numpy : 0.007025718688964844 nb_pixel_total : 1997 time to create 1 rle with old method : 0.002557516098022461 time for calcul the mask position with numpy : 0.007586240768432617 nb_pixel_total : 9433 time to create 1 rle with old method : 0.011971473693847656 time for calcul the mask position with numpy : 0.007561445236206055 nb_pixel_total : 1381 time to create 1 rle with old method : 0.001753091812133789 time for calcul the mask position with numpy : 0.007681846618652344 nb_pixel_total : 1468 time to create 1 rle with old method : 0.002030611038208008 time for calcul the mask position with numpy : 0.007446765899658203 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006344318389892578 time for calcul the mask position with numpy : 0.006848812103271484 nb_pixel_total : 1943 time to create 1 rle with old method : 0.0026085376739501953 time for calcul the mask position with numpy : 0.007010221481323242 nb_pixel_total : 17262 time to create 1 rle with old method : 0.020772457122802734 time for calcul the mask position with numpy : 0.006585836410522461 nb_pixel_total : 3334 time to create 1 rle with old method : 0.0042002201080322266 time for calcul the mask position with numpy : 0.0068817138671875 nb_pixel_total : 36572 time to create 1 rle with old method : 0.04370880126953125 time for calcul the mask position with numpy : 0.0063703060150146484 nb_pixel_total : 603 time to create 1 rle with old method : 0.0007545948028564453 time for calcul the mask position with numpy : 0.007513523101806641 nb_pixel_total : 281 time to create 1 rle with old method : 0.0005240440368652344 time for calcul the mask position with numpy : 0.0075647830963134766 nb_pixel_total : 910 time to create 1 rle with old method : 0.0011243820190429688 time for calcul the mask position with numpy : 0.00665736198425293 nb_pixel_total : 244 time to create 1 rle with old method : 0.00033855438232421875 time for calcul the mask position with numpy : 0.006424665451049805 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002334117889404297 time for calcul the mask position with numpy : 0.006676912307739258 nb_pixel_total : 646 time to create 1 rle with old method : 0.00096893310546875 time for calcul the mask position with numpy : 0.00669407844543457 nb_pixel_total : 5716 time to create 1 rle with old method : 0.007078647613525391 time for calcul the mask position with numpy : 0.006486177444458008 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002510547637939453 time for calcul the mask position with numpy : 0.006654024124145508 nb_pixel_total : 14055 time to create 1 rle with old method : 0.018048763275146484 time for calcul the mask position with numpy : 0.007223844528198242 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005559921264648438 time for calcul the mask position with numpy : 0.007284879684448242 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0014824867248535156 time for calcul the mask position with numpy : 0.00741124153137207 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0018222332000732422 time for calcul the mask position with numpy : 0.0071070194244384766 nb_pixel_total : 4792 time to create 1 rle with old method : 0.006076812744140625 time for calcul the mask position with numpy : 0.006756305694580078 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005087852478027344 time for calcul the mask position with numpy : 0.007649421691894531 nb_pixel_total : 35 time to create 1 rle with old method : 7.2479248046875e-05 time for calcul the mask position with numpy : 0.006947040557861328 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005025863647460938 time for calcul the mask position with numpy : 0.006862640380859375 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005497932434082031 time for calcul the mask position with numpy : 0.0071179866790771484 nb_pixel_total : 2041 time to create 1 rle with old method : 0.002617359161376953 time for calcul the mask position with numpy : 0.0072133541107177734 nb_pixel_total : 341 time to create 1 rle with old method : 0.0004608631134033203 time for calcul the mask position with numpy : 0.007274627685546875 nb_pixel_total : 340 time to create 1 rle with old method : 0.00046181678771972656 time for calcul the mask position with numpy : 0.0075724124908447266 nb_pixel_total : 3 time to create 1 rle with old method : 2.4557113647460938e-05 time for calcul the mask position with numpy : 0.006555318832397461 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003197193145751953 time for calcul the mask position with numpy : 0.006720781326293945 nb_pixel_total : 112 time to create 1 rle with old method : 0.00016546249389648438 time for calcul the mask position with numpy : 0.0071659088134765625 nb_pixel_total : 1911 time to create 1 rle with old method : 0.0024826526641845703 time for calcul the mask position with numpy : 0.006420135498046875 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006957054138183594 time for calcul the mask position with numpy : 0.006444215774536133 nb_pixel_total : 132 time to create 1 rle with old method : 0.0001926422119140625 time for calcul the mask position with numpy : 0.006517648696899414 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005538463592529297 time for calcul the mask position with numpy : 0.007613182067871094 nb_pixel_total : 106000 time to create 1 rle with old method : 0.17435431480407715 time for calcul the mask position with numpy : 0.009766340255737305 nb_pixel_total : 233 time to create 1 rle with old method : 0.00042724609375 time for calcul the mask position with numpy : 0.008609294891357422 nb_pixel_total : 136 time to create 1 rle with old method : 0.00024247169494628906 time for calcul the mask position with numpy : 0.007699489593505859 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.007111787796020508 nb_pixel_total : 21478 time to create 1 rle with old method : 0.025831222534179688 time for calcul the mask position with numpy : 0.01011514663696289 nb_pixel_total : 213 time to create 1 rle with old method : 0.000286102294921875 time for calcul the mask position with numpy : 0.00970315933227539 nb_pixel_total : 30293 time to create 1 rle with old method : 0.0370783805847168 time for calcul the mask position with numpy : 0.008892536163330078 nb_pixel_total : 59 time to create 1 rle with old method : 0.00010085105895996094 time for calcul the mask position with numpy : 0.010757207870483398 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005893707275390625 time for calcul the mask position with numpy : 0.01153111457824707 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002789497375488281 time for calcul the mask position with numpy : 0.011612653732299805 nb_pixel_total : 100 time to create 1 rle with old method : 0.00017762184143066406 time for calcul the mask position with numpy : 0.012816190719604492 nb_pixel_total : 321 time to create 1 rle with old method : 0.0005249977111816406 time for calcul the mask position with numpy : 0.0098724365234375 nb_pixel_total : 36688 time to create 1 rle with old method : 0.05222749710083008 time for calcul the mask position with numpy : 0.01303553581237793 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002751350402832031 time for calcul the mask position with numpy : 0.00886392593383789 nb_pixel_total : 109 time to create 1 rle with old method : 0.0002815723419189453 time for calcul the mask position with numpy : 0.009702682495117188 nb_pixel_total : 227 time to create 1 rle with old method : 0.0005159378051757812 time for calcul the mask position with numpy : 0.009309768676757812 nb_pixel_total : 73 time to create 1 rle with old method : 0.0002071857452392578 time for calcul the mask position with numpy : 0.01125955581665039 nb_pixel_total : 653 time to create 1 rle with old method : 0.0014524459838867188 time for calcul the mask position with numpy : 0.012369632720947266 nb_pixel_total : 2843 time to create 1 rle with old method : 0.006147623062133789 time for calcul the mask position with numpy : 0.013016223907470703 nb_pixel_total : 27 time to create 1 rle with old method : 0.00013327598571777344 time for calcul the mask position with numpy : 0.01394343376159668 nb_pixel_total : 497 time to create 1 rle with old method : 0.0011796951293945312 time for calcul the mask position with numpy : 0.012720823287963867 nb_pixel_total : 3 time to create 1 rle with old method : 3.457069396972656e-05 time for calcul the mask position with numpy : 0.013674497604370117 nb_pixel_total : 1 time to create 1 rle with old method : 3.0040740966796875e-05 time for calcul the mask position with numpy : 0.013428449630737305 nb_pixel_total : 225 time to create 1 rle with old method : 0.00038886070251464844 time for calcul the mask position with numpy : 0.012833833694458008 nb_pixel_total : 2220 time to create 1 rle with old method : 0.0034644603729248047 time for calcul the mask position with numpy : 0.013364791870117188 nb_pixel_total : 116 time to create 1 rle with old method : 0.0002796649932861328 time for calcul the mask position with numpy : 0.013681173324584961 nb_pixel_total : 339 time to create 1 rle with old method : 0.0005044937133789062 time for calcul the mask position with numpy : 0.01304936408996582 nb_pixel_total : 1522 time to create 1 rle with old method : 0.0024051666259765625 time for calcul the mask position with numpy : 0.01330113410949707 nb_pixel_total : 2063 time to create 1 rle with old method : 0.0031363964080810547 time for calcul the mask position with numpy : 0.013703346252441406 nb_pixel_total : 289 time to create 1 rle with old method : 0.00046181678771972656 time for calcul the mask position with numpy : 0.014398336410522461 nb_pixel_total : 1991 time to create 1 rle with old method : 0.0031218528747558594 time for calcul the mask position with numpy : 0.013309001922607422 nb_pixel_total : 101 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.012930631637573242 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003132820129394531 time for calcul the mask position with numpy : 0.012550830841064453 nb_pixel_total : 160 time to create 1 rle with old method : 0.00026702880859375 time for calcul the mask position with numpy : 0.012616395950317383 nb_pixel_total : 197 time to create 1 rle with old method : 0.0003504753112792969 time for calcul the mask position with numpy : 0.012940645217895508 nb_pixel_total : 439 time to create 1 rle with old method : 0.0007932186126708984 time for calcul the mask position with numpy : 0.01083517074584961 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003654956817626953 time for calcul the mask position with numpy : 0.010548114776611328 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003161430358886719 create new chi : 1.627668857574463 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0017807483673095703 batch 1 Loaded 95 chid ids of type : 4230 Number RLEs to save : 11639 TO DO : save crop sub photo not yet done ! save time : 0.6986494064331055 nb_obj : 101 nb_hashtags : 7 time to prepare the origin masks : 1.3671348094940186 time for calcul the mask position with numpy : 0.10750174522399902 nb_pixel_total : 1769808 time to create 1 rle with new method : 0.4443168640136719 time for calcul the mask position with numpy : 0.0066967010498046875 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004048347473144531 time for calcul the mask position with numpy : 0.006598472595214844 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003383159637451172 time for calcul the mask position with numpy : 0.006276369094848633 nb_pixel_total : 376 time to create 1 rle with old method : 0.000453948974609375 time for calcul the mask position with numpy : 0.00646209716796875 nb_pixel_total : 14 time to create 1 rle with old method : 5.793571472167969e-05 time for calcul the mask position with numpy : 0.006913900375366211 nb_pixel_total : 674 time to create 1 rle with old method : 0.0009219646453857422 time for calcul the mask position with numpy : 0.0068781375885009766 nb_pixel_total : 62054 time to create 1 rle with old method : 0.07166552543640137 time for calcul the mask position with numpy : 0.007050275802612305 nb_pixel_total : 62 time to create 1 rle with old method : 0.00012683868408203125 time for calcul the mask position with numpy : 0.007232666015625 nb_pixel_total : 1037 time to create 1 rle with old method : 0.0013136863708496094 time for calcul the mask position with numpy : 0.006387948989868164 nb_pixel_total : 363 time to create 1 rle with old method : 0.0005166530609130859 time for calcul the mask position with numpy : 0.006631374359130859 nb_pixel_total : 344 time to create 1 rle with old method : 0.0004425048828125 time for calcul the mask position with numpy : 0.006292104721069336 nb_pixel_total : 920 time to create 1 rle with old method : 0.0011622905731201172 time for calcul the mask position with numpy : 0.006354808807373047 nb_pixel_total : 82 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.006279945373535156 nb_pixel_total : 50 time to create 1 rle with old method : 9.894371032714844e-05 time for calcul the mask position with numpy : 0.006184816360473633 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004291534423828125 time for calcul the mask position with numpy : 0.006139993667602539 nb_pixel_total : 1641 time to create 1 rle with old method : 0.0020380020141601562 time for calcul the mask position with numpy : 0.006145477294921875 nb_pixel_total : 16 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.006307125091552734 nb_pixel_total : 1472 time to create 1 rle with old method : 0.001817464828491211 time for calcul the mask position with numpy : 0.00642085075378418 nb_pixel_total : 4633 time to create 1 rle with old method : 0.005685567855834961 time for calcul the mask position with numpy : 0.006262779235839844 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006403923034667969 time for calcul the mask position with numpy : 0.005948305130004883 nb_pixel_total : 1247 time to create 1 rle with old method : 0.001436471939086914 time for calcul the mask position with numpy : 0.00621342658996582 nb_pixel_total : 3049 time to create 1 rle with old method : 0.0036339759826660156 time for calcul the mask position with numpy : 0.005963325500488281 nb_pixel_total : 954 time to create 1 rle with old method : 0.001203298568725586 time for calcul the mask position with numpy : 0.005951404571533203 nb_pixel_total : 1026 time to create 1 rle with old method : 0.0011763572692871094 time for calcul the mask position with numpy : 0.0059452056884765625 nb_pixel_total : 219 time to create 1 rle with old method : 0.00029921531677246094 time for calcul the mask position with numpy : 0.0060427188873291016 nb_pixel_total : 397 time to create 1 rle with old method : 0.00048232078552246094 time for calcul the mask position with numpy : 0.005963325500488281 nb_pixel_total : 28 time to create 1 rle with old method : 6.246566772460938e-05 time for calcul the mask position with numpy : 0.005890846252441406 nb_pixel_total : 1859 time to create 1 rle with old method : 0.0022394657135009766 time for calcul the mask position with numpy : 0.0059740543365478516 nb_pixel_total : 16 time to create 1 rle with old method : 0.00011968612670898438 time for calcul the mask position with numpy : 0.005846500396728516 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.00592350959777832 nb_pixel_total : 827 time to create 1 rle with old method : 0.0010662078857421875 time for calcul the mask position with numpy : 0.005851268768310547 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0016880035400390625 time for calcul the mask position with numpy : 0.00614476203918457 nb_pixel_total : 9516 time to create 1 rle with old method : 0.012132406234741211 time for calcul the mask position with numpy : 0.006122589111328125 nb_pixel_total : 1192 time to create 1 rle with old method : 0.0013937950134277344 time for calcul the mask position with numpy : 0.006212711334228516 nb_pixel_total : 790 time to create 1 rle with old method : 0.0010724067687988281 time for calcul the mask position with numpy : 0.006190776824951172 nb_pixel_total : 1077 time to create 1 rle with old method : 0.0013968944549560547 time for calcul the mask position with numpy : 0.005974769592285156 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006377696990966797 time for calcul the mask position with numpy : 0.00620579719543457 nb_pixel_total : 1319 time to create 1 rle with old method : 0.0016634464263916016 time for calcul the mask position with numpy : 0.006764411926269531 nb_pixel_total : 13231 time to create 1 rle with old method : 0.015594005584716797 time for calcul the mask position with numpy : 0.0063860416412353516 nb_pixel_total : 1339 time to create 1 rle with old method : 0.001737833023071289 time for calcul the mask position with numpy : 0.006360769271850586 nb_pixel_total : 920 time to create 1 rle with old method : 0.0011150836944580078 time for calcul the mask position with numpy : 0.006409883499145508 nb_pixel_total : 62 time to create 1 rle with old method : 0.00013327598571777344 time for calcul the mask position with numpy : 0.006677389144897461 nb_pixel_total : 230 time to create 1 rle with old method : 0.00030159950256347656 time for calcul the mask position with numpy : 0.006349802017211914 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0015215873718261719 time for calcul the mask position with numpy : 0.006643772125244141 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0013082027435302734 time for calcul the mask position with numpy : 0.006245851516723633 nb_pixel_total : 726 time to create 1 rle with old method : 0.0011439323425292969 time for calcul the mask position with numpy : 0.00652766227722168 nb_pixel_total : 12909 time to create 1 rle with old method : 0.01640772819519043 time for calcul the mask position with numpy : 0.006439208984375 nb_pixel_total : 1510 time to create 1 rle with old method : 0.002183198928833008 time for calcul the mask position with numpy : 0.00649714469909668 nb_pixel_total : 30 time to create 1 rle with old method : 5.841255187988281e-05 time for calcul the mask position with numpy : 0.006823062896728516 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001842975616455078 time for calcul the mask position with numpy : 0.006454944610595703 nb_pixel_total : 154 time to create 1 rle with old method : 0.0003490447998046875 time for calcul the mask position with numpy : 0.006751298904418945 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0014569759368896484 time for calcul the mask position with numpy : 0.006827116012573242 nb_pixel_total : 132 time to create 1 rle with old method : 0.00018715858459472656 time for calcul the mask position with numpy : 0.006286144256591797 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005204677581787109 time for calcul the mask position with numpy : 0.006589174270629883 nb_pixel_total : 276 time to create 1 rle with old method : 0.00041413307189941406 time for calcul the mask position with numpy : 0.006339073181152344 nb_pixel_total : 93 time to create 1 rle with old method : 0.00012969970703125 time for calcul the mask position with numpy : 0.006371974945068359 nb_pixel_total : 4469 time to create 1 rle with old method : 0.005396366119384766 time for calcul the mask position with numpy : 0.0064198970794677734 nb_pixel_total : 29 time to create 1 rle with old method : 7.343292236328125e-05 time for calcul the mask position with numpy : 0.00621485710144043 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004317760467529297 time for calcul the mask position with numpy : 0.006349325180053711 nb_pixel_total : 353 time to create 1 rle with old method : 0.0004394054412841797 time for calcul the mask position with numpy : 0.006417036056518555 nb_pixel_total : 21 time to create 1 rle with old method : 6.365776062011719e-05 time for calcul the mask position with numpy : 0.006297588348388672 nb_pixel_total : 8 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.006382465362548828 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005555152893066406 time for calcul the mask position with numpy : 0.006346940994262695 nb_pixel_total : 166 time to create 1 rle with old method : 0.00022649765014648438 time for calcul the mask position with numpy : 0.0062408447265625 nb_pixel_total : 383 time to create 1 rle with old method : 0.0004897117614746094 time for calcul the mask position with numpy : 0.0062067508697509766 nb_pixel_total : 197 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.005981922149658203 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003211498260498047 time for calcul the mask position with numpy : 0.006015777587890625 nb_pixel_total : 125 time to create 1 rle with old method : 0.00016427040100097656 time for calcul the mask position with numpy : 0.0067021846771240234 nb_pixel_total : 105869 time to create 1 rle with old method : 0.12238121032714844 time for calcul the mask position with numpy : 0.00606989860534668 nb_pixel_total : 1 time to create 1 rle with old method : 2.2411346435546875e-05 time for calcul the mask position with numpy : 0.006066083908081055 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011992454528808594 time for calcul the mask position with numpy : 0.0060007572174072266 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005450248718261719 time for calcul the mask position with numpy : 0.006366252899169922 nb_pixel_total : 220 time to create 1 rle with old method : 0.00029206275939941406 time for calcul the mask position with numpy : 0.006289005279541016 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.006824016571044922 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006117820739746094 time for calcul the mask position with numpy : 0.006103038787841797 nb_pixel_total : 219 time to create 1 rle with old method : 0.00027871131896972656 time for calcul the mask position with numpy : 0.006145954132080078 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006735324859619141 time for calcul the mask position with numpy : 0.006189823150634766 nb_pixel_total : 286 time to create 1 rle with old method : 0.0003867149353027344 time for calcul the mask position with numpy : 0.006166696548461914 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.006083488464355469 nb_pixel_total : 18 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.006068229675292969 nb_pixel_total : 1819 time to create 1 rle with old method : 0.0021610260009765625 time for calcul the mask position with numpy : 0.006674289703369141 nb_pixel_total : 34544 time to create 1 rle with old method : 0.04126310348510742 time for calcul the mask position with numpy : 0.006422519683837891 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005867481231689453 time for calcul the mask position with numpy : 0.006485939025878906 nb_pixel_total : 99 time to create 1 rle with old method : 0.00014829635620117188 time for calcul the mask position with numpy : 0.006476879119873047 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003349781036376953 time for calcul the mask position with numpy : 0.005972623825073242 nb_pixel_total : 18 time to create 1 rle with old method : 5.9604644775390625e-05 time for calcul the mask position with numpy : 0.006382465362548828 nb_pixel_total : 825 time to create 1 rle with old method : 0.0009918212890625 time for calcul the mask position with numpy : 0.006152629852294922 nb_pixel_total : 3247 time to create 1 rle with old method : 0.003889799118041992 time for calcul the mask position with numpy : 0.00652766227722168 nb_pixel_total : 626 time to create 1 rle with old method : 0.0007452964782714844 time for calcul the mask position with numpy : 0.00590968132019043 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006182193756103516 time for calcul the mask position with numpy : 0.006065845489501953 nb_pixel_total : 70 time to create 1 rle with old method : 0.00016069412231445312 time for calcul the mask position with numpy : 0.005950212478637695 nb_pixel_total : 4291 time to create 1 rle with old method : 0.005225419998168945 time for calcul the mask position with numpy : 0.00624847412109375 nb_pixel_total : 1706 time to create 1 rle with old method : 0.0020685195922851562 time for calcul the mask position with numpy : 0.0061113834381103516 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003325939178466797 time for calcul the mask position with numpy : 0.0062961578369140625 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007114410400390625 time for calcul the mask position with numpy : 0.006075620651245117 nb_pixel_total : 2081 time to create 1 rle with old method : 0.002666950225830078 time for calcul the mask position with numpy : 0.008228778839111328 nb_pixel_total : 181 time to create 1 rle with old method : 0.00024008750915527344 time for calcul the mask position with numpy : 0.008055925369262695 nb_pixel_total : 211 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.00888204574584961 nb_pixel_total : 168 time to create 1 rle with old method : 0.0003190040588378906 time for calcul the mask position with numpy : 0.00958561897277832 nb_pixel_total : 82 time to create 1 rle with old method : 0.00015926361083984375 time for calcul the mask position with numpy : 0.009649515151977539 nb_pixel_total : 246 time to create 1 rle with old method : 0.00043129920959472656 time for calcul the mask position with numpy : 0.009639739990234375 nb_pixel_total : 185 time to create 1 rle with old method : 0.0003333091735839844 create new chi : 1.5813829898834229 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001964569091796875 batch 1 Loaded 102 chid ids of type : 4230 Number RLEs to save : 10426 TO DO : save crop sub photo not yet done ! save time : 0.624225378036499 map_output_result : {1340418320: (0.0, 'Should be the crop_list due to order', 0.0), 1340418304: (0.0, 'Should be the crop_list due to order', 0.0), 1340418272: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340418320, 1340418304, 1340418272] Looping around the photos to save general results len do output : 3 /1340418320.Didn't retrieve data . /1340418304.Didn't retrieve data . /1340418272.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418320', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418304', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418272', None, None, None, None, None, '2627073') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012052297592163086 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.192981481552124 time spend to save output : 0.012437582015991211 total time spend for step 4 : 13.205419063568115 step5:crop_condition Sat Mar 1 21:21:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 291 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 86 About to insert : list_path_to_insert length 86 new photo from crops ! About to upload 86 photos upload in portfolio : 4869462 init cache_photo without model_param we have 86 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740860481_3150529 we have uploaded 86 photos in the portfolio 4869462 time of upload the photos Elapsed time : 19.861185550689697 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 4869462 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740860502_3150529 we have uploaded 40 photos in the portfolio 4869462 time of upload the photos Elapsed time : 10.645422458648682 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740860512_3150529 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6054630279541016 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740860513_3150529 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.882988691329956 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 53 About to insert : list_path_to_insert length 53 new photo from crops ! About to upload 53 photos upload in portfolio : 4869462 init cache_photo without model_param we have 53 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740860515_3150529 we have uploaded 53 photos in the portfolio 4869462 time of upload the photos Elapsed time : 13.49897289276123 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740860529_3150529 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5399682521820068 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340418320, 1340418304, 1340418272] Looping around the photos to save general results len do output : 183 /1340438060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340438547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418320', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418304', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418272', None, None, None, None, None, '2627073') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 552 time used for this insertion : 0.03510928153991699 save_final save missing photos in datou_result : time spend for datou_step_exec : 50.155046701431274 time spend to save output : 0.03950309753417969 total time spend for step 5 : 50.194549798965454 step6:thcl Sat Mar 1 21:22:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.006534099578857422 time to convert the images to numpy array : 0.029041767120361328 time to import caffe and check if the image exist : 0.013416767120361328 time to convert the images to numpy array : 0.05154895782470703 time to import caffe and check if the image exist : 0.01493215560913086 time to convert the images to numpy array : 0.05452752113342285 time to import caffe and check if the image exist : 0.01274561882019043 time to convert the images to numpy array : 0.061040401458740234 time to import caffe and check if the image exist : 0.020415306091308594 time to convert the images to numpy array : 0.05837821960449219 time to import caffe and check if the image exist : 0.02700495719909668 time to convert the images to numpy array : 0.05270552635192871 time to import caffe and check if the image exist : 0.018761634826660156 time to convert the images to numpy array : 0.06128668785095215 time to import caffe and check if the image exist : 0.024075746536254883 time to convert the images to numpy array : 0.057177066802978516 time to import caffe and check if the image exist : 0.0192415714263916 time to convert the images to numpy array : 0.062287092208862305 time to import caffe and check if the image exist : 0.022684812545776367 time to convert the images to numpy array : 0.06122255325317383 total time to convert the images to numpy array : 0.397463321685791 list photo_ids error: [] list photo_ids correct : [1340438511, 1340438513, 1340438515, 1340438517, 1340438519, 1340438521, 1340438523, 1340438525, 1340438527, 1340438529, 1340438531, 1340438547, 1340438119, 1340438120, 1340438121, 1340438122, 1340438123, 1340438124, 1340438125, 1340438126, 1340438127, 1340438128, 1340438129, 1340438130, 1340438131, 1340438132, 1340438133, 1340438134, 1340438135, 1340438136, 1340438137, 1340438472, 1340438474, 1340438476, 1340438478, 1340438480, 1340438482, 1340438484, 1340438486, 1340438489, 1340438491, 1340438493, 1340438495, 1340438497, 1340438499, 1340438501, 1340438503, 1340438505, 1340438507, 1340438509, 1340438081, 1340438082, 1340438083, 1340438084, 1340438085, 1340438086, 1340438087, 1340438088, 1340438089, 1340438090, 1340438091, 1340438092, 1340438093, 1340438094, 1340438095, 1340438096, 1340438097, 1340438098, 1340438099, 1340438183, 1340438184, 1340438185, 1340438186, 1340438187, 1340438188, 1340438189, 1340438190, 1340438191, 1340438192, 1340438193, 1340438194, 1340438195, 1340438197, 1340438198, 1340438426, 1340438428, 1340438430, 1340438432, 1340438138, 1340438139, 1340438140, 1340438141, 1340438142, 1340438143, 1340438144, 1340438145, 1340438146, 1340438147, 1340438155, 1340438156, 1340438157, 1340438158, 1340438159, 1340438160, 1340438161, 1340438162, 1340438163, 1340438434, 1340438436, 1340438438, 1340438440, 1340438442, 1340438444, 1340438446, 1340438448, 1340438450, 1340438452, 1340438454, 1340438456, 1340438458, 1340438460, 1340438462, 1340438464, 1340438466, 1340438468, 1340438470, 1340438060, 1340438062, 1340438063, 1340438064, 1340438065, 1340438066, 1340438067, 1340438068, 1340438069, 1340438071, 1340438072, 1340438073, 1340438074, 1340438075, 1340438076, 1340438077, 1340438078, 1340438079, 1340438080, 1340438100, 1340438101, 1340438102, 1340438103, 1340438104, 1340438105, 1340438106, 1340438107, 1340438108, 1340438109, 1340438110, 1340438111, 1340438112, 1340438113, 1340438114, 1340438115, 1340438116, 1340438117, 1340438118, 1340438164, 1340438165, 1340438166, 1340438167, 1340438168, 1340438169, 1340438170, 1340438171, 1340438172, 1340438173, 1340438174, 1340438175, 1340438176, 1340438177, 1340438178, 1340438179, 1340438180, 1340438181, 1340438182] number of photos to traite : 183 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5302 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 2500 l 3632 free memory gpu now : 1889 wait 20 seconds l 3637 free memory gpu now : 1889 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 0.8690214157104492 time used to do the prediction : 0.7954347133636475 save descriptor for thcl : 3237 time to traite the descriptors : 1.0134177207946777 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340438511 To insert : 1340438513 To insert : 1340438515 To insert : 1340438517 To insert : 1340438519 To insert : 1340438521 To insert : 1340438523 To insert : 1340438525 To insert : 1340438527 To insert : 1340438529 To insert : 1340438531 To insert : 1340438547 To insert : 1340438119 To insert : 1340438120 To insert : 1340438121 To insert : 1340438122 To insert : 1340438123 To insert : 1340438124 To insert : 1340438125 To insert : 1340438126 To insert : 1340438127 To insert : 1340438128 To insert : 1340438129 To insert : 1340438130 To insert : 1340438131 To insert : 1340438132 To insert : 1340438133 To insert : 1340438134 To insert : 1340438135 To insert : 1340438136 To insert : 1340438137 To insert : 1340438472 To insert : 1340438474 To insert : 1340438476 To insert : 1340438478 To insert : 1340438480 To insert : 1340438482 To insert : 1340438484 To insert : 1340438486 To insert : 1340438489 To insert : 1340438491 To insert : 1340438493 To insert : 1340438495 To insert : 1340438497 To insert : 1340438499 To insert : 1340438501 To insert : 1340438503 To insert : 1340438505 To insert : 1340438507 To insert : 1340438509 To insert : 1340438081 To insert : 1340438082 To insert : 1340438083 To insert : 1340438084 To insert : 1340438085 To insert : 1340438086 To insert : 1340438087 To insert : 1340438088 To insert : 1340438089 To insert : 1340438090 To insert : 1340438091 To insert : 1340438092 To insert : 1340438093 To insert : 1340438094 To insert : 1340438095 To insert : 1340438096 To insert : 1340438097 To insert : 1340438098 To insert : 1340438099 To insert : 1340438183 To insert : 1340438184 To insert : 1340438185 To insert : 1340438186 To insert : 1340438187 To insert : 1340438188 To insert : 1340438189 To insert : 1340438190 To insert : 1340438191 To insert : 1340438192 To insert : 1340438193 To insert : 1340438194 To insert : 1340438195 To insert : 1340438197 To insert : 1340438198 To insert : 1340438426 To insert : 1340438428 To insert : 1340438430 To insert : 1340438432 To insert : 1340438138 To insert : 1340438139 To insert : 1340438140 To insert : 1340438141 To insert : 1340438142 To insert : 1340438143 To insert : 1340438144 To insert : 1340438145 To insert : 1340438146 To insert : 1340438147 To insert : 1340438155 To insert : 1340438156 To insert : 1340438157 To insert : 1340438158 To insert : 1340438159 To insert : 1340438160 To insert : 1340438161 To insert : 1340438162 To insert : 1340438163 To insert : 1340438434 To insert : 1340438436 To insert : 1340438438 To insert : 1340438440 To insert : 1340438442 To insert : 1340438444 To insert : 1340438446 To insert : 1340438448 To insert : 1340438450 To insert : 1340438452 To insert : 1340438454 To insert : 1340438456 To insert : 1340438458 To insert : 1340438460 To insert : 1340438462 To insert : 1340438464 To insert : 1340438466 To insert : 1340438468 To insert : 1340438470 To insert : 1340438060 To insert : 1340438062 To insert : 1340438063 To insert : 1340438064 To insert : 1340438065 To insert : 1340438066 To insert : 1340438067 To insert : 1340438068 To insert : 1340438069 To insert : 1340438071 To insert : 1340438072 To insert : 1340438073 To insert : 1340438074 To insert : 1340438075 To insert : 1340438076 To insert : 1340438077 To insert : 1340438078 To insert : 1340438079 To insert : 1340438080 To insert : 1340438100 To insert : 1340438101 To insert : 1340438102 To insert : 1340438103 To insert : 1340438104 To insert : 1340438105 To insert : 1340438106 To insert : 1340438107 To insert : 1340438108 To insert : 1340438109 To insert : 1340438110 To insert : 1340438111 To insert : 1340438112 To insert : 1340438113 To insert : 1340438114 To insert : 1340438115 To insert : 1340438116 To insert : 1340438117 To insert : 1340438118 To insert : 1340438164 To insert : 1340438165 To insert : 1340438166 To insert : 1340438167 To insert : 1340438168 To insert : 1340438169 To insert : 1340438170 To insert : 1340438171 To insert : 1340438172 To insert : 1340438173 To insert : 1340438174 To insert : 1340438175 To insert : 1340438176 To insert : 1340438177 To insert : 1340438178 To insert : 1340438179 To insert : 1340438180 To insert : 1340438181 To insert : 1340438182 time to insert the descriptors : 37.46788024902344 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 286 time used for this insertion : 0.024002552032470703 save missing photos in datou_result : time spend for datou_step_exec : 64.77041792869568 time spend to save output : 0.07472348213195801 total time spend for step 6 : 64.84514141082764 step7:ventilate_hashtags_in_portfolio Sat Mar 1 21:23:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20951095 get user id for portfolio 20951095 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951095 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','refus','pet_fonce','pet_clair','mal_croppe','PET_fonce','autre','papier','Tetrapak','Film_plastique','PEHD','Papier','PET_clair','metal','environnement','carton','Carton')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951095 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','refus','pet_fonce','pet_clair','mal_croppe','PET_fonce','autre','papier','Tetrapak','Film_plastique','PEHD','Papier','PET_clair','metal','environnement','carton','Carton')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951095 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','refus','pet_fonce','pet_clair','mal_croppe','PET_fonce','autre','papier','Tetrapak','Film_plastique','PEHD','Papier','PET_clair','metal','environnement','carton','Carton')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951095 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','refus','pet_fonce','pet_clair','mal_croppe','PET_fonce','autre','papier','Tetrapak','Film_plastique','PEHD','Papier','PET_clair','metal','environnement','carton','Carton')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20952166,20952177,20952168,20952172,20952179,20952171,20952173,20952178,20952175,20952176,20952180,20952181,20952183?tags=flou,pehd,refus,pet_fonce,pet_clair,mal_croppe,autre,papier,tetrapak,film_plastique,metal,environnement,carton&datou_id_consolidate=4235&port_consolidate=20951095 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340418320, 1340418304, 1340418272] Looping around the photos to save general results len do output : 1 /20951095. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418320', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418304', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418272', None, None, None, None, None, '2627073') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013319730758666992 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.0290603637695312 time spend to save output : 0.013623952865600586 total time spend for step 7 : 3.042684316635132 step8:final Sat Mar 1 21:23:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340418320: ('0.2384060799479104',), 1340418304: ('0.2384060799479104',), 1340418272: ('0.2384060799479104',)} new output for save of step final : {1340418320: ('0.2384060799479104',), 1340418304: ('0.2384060799479104',), 1340418272: ('0.2384060799479104',)} [1340418320, 1340418304, 1340418272] Looping around the photos to save general results len do output : 3 /1340418320.Didn't retrieve data . /1340418304.Didn't retrieve data . /1340418272.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418320', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418304', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418272', None, None, None, None, None, '2627073') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012598514556884766 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12825298309326172 time spend to save output : 0.012868881225585938 total time spend for step 8 : 0.14112186431884766 step9:velours_tree Sat Mar 1 21:23:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20952166,20952177,20952168,20952172,20952179,20952171,20952173,20952178,20952175,20952176,20952180,20952181,20952183 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952166 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952177 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952168 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952172 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952179 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952171 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952173 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952178 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952175 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952176 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952180 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952181 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20952183 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 183 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 1 1 0 0 0 0 0 5 0 0 0 0 5 2 0 0 0 2 0 1 5 5 2 1 0 1 1 1 2 0 0 0 0 0 3 0 0 5 0 2 2 0 5 0 0 5 5 2 2 0 0 1 2 2 1 1 3 1 0 0 0 0 0 0 0 0 0 3 1 0 0 2 0 0 2 0 1 5 5 0 2 1 1 0 1 2 2 2 0 0 0 5 0 0 4 0 4 1 2 0 0 0 5 5 5 0 0 4 4 1 0 2 0 2 0 0 1 0 5 0 0 4 0 5 4 1 1 5 3 3 0 5 3 1 2 0 5 2 2 1 2 3 5 2 2 2 3 3 3 1 1 1 2 2 5 0 5 5 2 1 1 2 2 5 2 2 3 5 3 5 0 1 0 2 2 0 2 0 5 2 2 0] Elapsed time: 0.0295717716217041 graph_id used : 80930 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20952166,20952177,20952168,20952172,20952179,20952171,20952173,20952178,20952175,20952176,20952180,20952181,20952183?tags=flou,pehd,refus,pet_fonce,pet_clair,mal_croppe,autre,papier,tetrapak,film_plastique,metal,environnement,carton&datou_id_consolidate=4235&port_consolidate=20951095&tree_id=80930 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340418320, 1340418304, 1340418272] Looping around the photos to save general results len do output : 1 /20951095Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418320', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418304', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418272', None, None, None, None, None, '2627073') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.01256871223449707 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.556904792785645 time spend to save output : 0.012843608856201172 total time spend for step 9 : 11.569748401641846 step10:send_mail_cod Sat Mar 1 21:23:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20951095_01-03-2025_21_23_29.pdf 20952148 imagette209521481740860609 20952159 change filename to text .imagette209521591740860609 20952150 imagette209521501740860609 20952154 imagette209521541740860609 20952161 change filename to text .change filename to text .imagette209521611740860609 20952153 imagette209521531740860609 20952155 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209521551740860609 20952160 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209521601740860610 20952157 imagette209521571740860611 20952158 imagette209521581740860611 20952162 change filename to text .imagette209521621740860611 20952165 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209521651740860611 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20951095 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20952166,20952177,20952168,20952172,20952179,20952171,20952173,20952178,20952175,20952176,20952180,20952181,20952183?tags=flou,pehd,refus,pet_fonce,pet_clair,mal_croppe,autre,papier,tetrapak,film_plastique,metal,environnement,carton&datou_id_consolidate=4235&port_consolidate=20951095&tree_id=80930 your option no_mail is active, we will not send the real mail to your client args[1340418320] : ((1340418320, -7.23524117379197, 492609224), (1340418320, -0.9052307442614385, 501862349), '0.2384060799479104') We are sending mail with results at cod@fotonower.com args[1340418304] : ((1340418304, -6.649461433823994, 492609224), (1340418304, -1.280932972335848, 501862349), '0.2384060799479104') We are sending mail with results at cod@fotonower.com args[1340418272] : ((1340418272, -7.056372716280913, 492609224), (1340418272, -1.1813348717054095, 501862349), '0.2384060799479104') We are sending mail with results at cod@fotonower.com refus_total : 0.2384060799479104 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20951095 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951095_01-03-2025_21_23_29.pdf results_Qualipapia_P20951095_01-03-2025_21_23_29.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951095_01-03-2025_21_23_29.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20951095','results_Qualipapia_P20951095_01-03-2025_21_23_29.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951095_01-03-2025_21_23_29.pdf','pdf','','0.15','0.2384060799479104') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340418320, 1340418304, 1340418272] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418320', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418304', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418272', None, None, None, None, None, '2627073') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012270450592041016 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.097147703170776 time spend to save output : 0.01247406005859375 total time spend for step 10 : 4.10962176322937 step11:split_time_score Sat Mar 1 21:23:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01032025 20951095 Nombre de photos uploadées : 3 / 23040 (0%) 01032025 20951095 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 01032025 20951095 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ??? elapsed_time : fill_and_build_computed_from_old_data 0.0001876354217529297 elapsed_time : insert_dashboard_record_day_entry 0.022836923599243164 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.23892758134565031 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20948539_01-03-2025_10_46_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20948539 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20948539 AND mptpi.`type`=4230 To do Qualite : 0.24625960389241422 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20948540_01-03-2025_10_34_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20948540 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20948540 AND mptpi.`type`=4230 To do Qualite : 0.20216657906345706 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20948718_01-03-2025_11_24_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20948718 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20948718 AND mptpi.`type`=4230 To do Qualite : 0.2000221582417073 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20948719_01-03-2025_11_32_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20948719 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20948719 AND mptpi.`type`=4230 To do Qualite : 0.2290304525818133 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20948720_01-03-2025_12_57_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20948720 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20948720 AND mptpi.`type`=4230 To do Qualite : 0.19748340895258557 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20948721_01-03-2025_11_14_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20948721 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20948721 AND mptpi.`type`=4230 To do Qualite : 0.20384795441780693 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20948722_01-03-2025_11_16_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20948722 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20948722 AND mptpi.`type`=4230 To do Qualite : 0.2061637751903161 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949315_01-03-2025_13_47_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949315 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949315 AND mptpi.`type`=4230 To do Qualite : 0.2563436286744535 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949316_01-03-2025_13_34_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949316 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949316 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949932 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949933 order by id desc limit 1 Qualite : 0.19003003768128784 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949934_01-03-2025_19_47_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949934 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949934 AND mptpi.`type`=4230 To do Qualite : 0.18267498874268273 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949935_01-03-2025_19_52_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949935 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949935 AND mptpi.`type`=4230 To do Qualite : 0.15507671090403438 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949936_01-03-2025_19_57_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949936 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949936 AND mptpi.`type`=4230 To do Qualite : 0.1896269828090784 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949937_01-03-2025_20_02_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949937 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949937 AND mptpi.`type`=4230 To do Qualite : 0.2206964868641459 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949938_01-03-2025_20_08_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949938 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949938 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949939 order by id desc limit 1 Qualite : 0.21540164959389502 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949940_01-03-2025_20_17_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949940 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949940 AND mptpi.`type`=4230 To do Qualite : 0.2172482883806568 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949941_01-03-2025_15_46_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949941 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949941 AND mptpi.`type`=4230 To do Qualite : 0.25138606860582935 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949942_01-03-2025_20_22_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949942 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949942 AND mptpi.`type`=4230 To do Qualite : 0.18540509980212977 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20949943_01-03-2025_15_34_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20949943 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20949943 AND mptpi.`type`=4230 To do Qualite : 0.2189982274230503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950047_01-03-2025_20_46_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950047 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950047 AND mptpi.`type`=4230 To do Qualite : 0.1488780590128922 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950048_01-03-2025_20_46_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950048 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950048 AND mptpi.`type`=4230 To do Qualite : 0.21836697330651178 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950049_01-03-2025_20_52_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950049 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950049 AND mptpi.`type`=4230 To do Qualite : 0.23844159780447716 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950050_01-03-2025_16_17_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950050 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950050 AND mptpi.`type`=4230 To do Qualite : 0.22493991237329264 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950051_01-03-2025_16_32_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950051 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950051 AND mptpi.`type`=4230 To do Qualite : 0.188511470189505 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950052_01-03-2025_16_23_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950052 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950052 AND mptpi.`type`=4230 To do Qualite : 0.18109626908376963 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950260_01-03-2025_16_54_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950260 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950260 AND mptpi.`type`=4230 To do Qualite : 0.16586306959729208 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950261_01-03-2025_16_35_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950261 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950261 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950391 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950392 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950393 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950394 order by id desc limit 1 Qualite : 0.19328712984834084 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950395_01-03-2025_17_18_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950395 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950395 AND mptpi.`type`=4230 To do Qualite : 0.2392599817619378 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950396_01-03-2025_17_24_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950396 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950396 AND mptpi.`type`=4230 To do Qualite : 0.22411548065894654 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950397_01-03-2025_17_32_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950397 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950397 AND mptpi.`type`=4230 To do Qualite : 0.2172577121206167 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950398_01-03-2025_17_11_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950398 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950398 AND mptpi.`type`=4230 To do Qualite : 0.1877535365280539 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950604_01-03-2025_18_32_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950604 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950604 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950605 order by id desc limit 1 Qualite : 0.19067849606352008 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950606_01-03-2025_17_38_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950606 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950606 AND mptpi.`type`=4230 To do Qualite : 0.1888073545444506 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950607_01-03-2025_17_47_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950607 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950607 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950608 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950901 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950902 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950903 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950904 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950905 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950906 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950907 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950908 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950909 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950910 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950911 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950912 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950913 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950914 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950915 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950916 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950917 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950918 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950919 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950920 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950921 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950922 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950923 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950924 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950925 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950926 order by id desc limit 1 Qualite : 0.20176256870286613 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20950927_01-03-2025_18_46_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950927 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20950927 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20950928 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951089 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951090 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951091 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951092 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951093 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951094 order by id desc limit 1 Qualite : 0.2384060799479104 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951095_01-03-2025_21_23_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951095 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951095 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951096 order by id desc limit 1 Qualite : 0.25799234271610344 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951097_01-03-2025_19_31_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951097 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951097 AND mptpi.`type`=4230 To do Qualite : 0.22821889640806445 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951098_01-03-2025_20_22_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951098 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951098 AND mptpi.`type`=4230 To do Qualite : 0.262537491134539 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951099_01-03-2025_20_50_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951099 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951099 AND mptpi.`type`=4230 To do Qualite : 0.21309613582432863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951100_01-03-2025_19_22_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951100 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951100 AND mptpi.`type`=4230 To do Qualite : 0.21972640480246933 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951101_01-03-2025_20_19_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951101 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951101 AND mptpi.`type`=4230 To do Qualite : 0.23383995199841548 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951102_01-03-2025_19_13_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951102 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951102 AND mptpi.`type`=4230 To do Qualite : 0.13174541824828773 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951315_01-03-2025_19_46_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951315 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951315 AND mptpi.`type`=4230 To do Qualite : 0.14942461706778604 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20951316_01-03-2025_19_34_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20951316 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20951316 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01032025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340418320, 1340418304, 1340418272] Looping around the photos to save general results len do output : 1 /20951095Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418320', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418304', None, None, None, None, None, '2627073') ('4234', None, None, None, None, None, None, None, '2627073') ('4234', '20951095', '1340418272', None, None, None, None, None, '2627073') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012053489685058594 save_final save missing photos in datou_result : time spend for datou_step_exec : 36.924076318740845 time spend to save output : 0.012276887893676758 total time spend for step 11 : 36.93635320663452 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 43.68user 28.69system 3:44.91elapsed 32%CPU (0avgtext+0avgdata 2522712maxresident)k 2618448inputs+14872outputs (9772major+2166954minor)pagefaults 0swaps