python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2189983 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 76>5 please execute split_portfolio.py -i 20278471 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2557296'] with mtr_portfolio_ids : ['20278471'] and first list_photo_ids : [] new path : /proc/2189983/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.44974303245544434 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Thu Feb 6 05:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10332 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-06 05:20:30.883371: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-06 05:20:30.911159: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-06 05:20:30.912682: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5290000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-06 05:20:30.912704: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-06 05:20:30.915562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-06 05:20:31.136438: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x40b9f060 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-06 05:20:31.136487: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-06 05:20:31.137270: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-06 05:20:31.137615: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-06 05:20:31.139664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-06 05:20:31.141855: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-06 05:20:31.142187: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-06 05:20:31.144913: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-06 05:20:31.145994: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-06 05:20:31.151190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-06 05:20:31.152726: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-06 05:20:31.152806: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-06 05:20:31.153551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-06 05:20:31.153567: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-06 05:20:31.153576: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-06 05:20:31.154879: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9570 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-06 05:20:31.491005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-06 05:20:31.491106: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-06 05:20:31.491134: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-06 05:20:31.491166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-06 05:20:31.491199: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-06 05:20:31.491225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-06 05:20:31.491250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-06 05:20:31.491275: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-06 05:20:31.492984: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-06 05:20:31.494102: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-06 05:20:31.494145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-06 05:20:31.494161: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-06 05:20:31.494175: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-06 05:20:31.494189: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-06 05:20:31.494202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-06 05:20:31.494216: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-06 05:20:31.494230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-06 05:20:31.495532: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-06 05:20:31.495564: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-06 05:20:31.495573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-06 05:20:31.495581: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-06 05:20:31.496935: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9570 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-06 05:20:39.628773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-06 05:20:39.833249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.09844 max: 149.56094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.0001068115234375 nb_pixel_total : 425 time to create 1 rle with old method : 0.0008609294891357422 length of segment : 23 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 759 time to create 1 rle with old method : 0.0014433860778808594 length of segment : 34 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.0015537738800048828 length of segment : 36 time for calcul the mask position with numpy : 0.00034165382385253906 nb_pixel_total : 5810 time to create 1 rle with old method : 0.01203298568725586 length of segment : 122 time for calcul the mask position with numpy : 0.0002598762512207031 nb_pixel_total : 6625 time to create 1 rle with old method : 0.008496761322021484 length of segment : 136 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 807 time to create 1 rle with old method : 0.0011510848999023438 length of segment : 36 length of segment : 0 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1570 time to create 1 rle with old method : 0.003040790557861328 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.69609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00014925003051757812 nb_pixel_total : 8287 time to create 1 rle with old method : 0.010703802108764648 length of segment : 76 time for calcul the mask position with numpy : 0.00014972686767578125 nb_pixel_total : 4057 time to create 1 rle with old method : 0.005172252655029297 length of segment : 194 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 31 time to create 1 rle with old method : 8.177757263183594e-05 length of segment : 6 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0007054805755615234 length of segment : 36 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 7277 time to create 1 rle with old method : 0.00940251350402832 length of segment : 62 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.80938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1516 time to create 1 rle with old method : 0.0021407604217529297 length of segment : 28 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 559 time to create 1 rle with old method : 0.0010547637939453125 length of segment : 11 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 2530 time to create 1 rle with old method : 0.003339052200317383 length of segment : 106 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002760887145996094 length of segment : 8 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 5012 time to create 1 rle with old method : 0.006315946578979492 length of segment : 111 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.78203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00018286705017089844 nb_pixel_total : 10095 time to create 1 rle with old method : 0.015199661254882812 length of segment : 84 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.00041937828063964844 length of segment : 45 time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 3396 time to create 1 rle with old method : 0.004215717315673828 length of segment : 243 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.0010483264923095703 length of segment : 57 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0003020763397216797 length of segment : 18 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004687309265136719 length of segment : 30 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.02969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 1474 time to create 1 rle with old method : 0.0019066333770751953 length of segment : 114 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00043654441833496094 length of segment : 13 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 968 time to create 1 rle with old method : 0.00128936767578125 length of segment : 75 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0008490085601806641 length of segment : 24 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.00042057037353515625 length of segment : 60 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.0008664131164550781 length of segment : 21 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0014977455139160156 length of segment : 81 time for calcul the mask position with numpy : 0.0005421638488769531 nb_pixel_total : 49732 time to create 1 rle with old method : 0.060777902603149414 length of segment : 245 Processing 1 images image shape: (400, 400, 3) min: 8.00000 max: 194.00000 molded_images shape: (1, 640, 640, 3) min: -91.83359 max: 59.03984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.002056121826171875 nb_pixel_total : 155503 time to create 1 rle with new method : 0.0035262107849121094 length of segment : 407 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.80547 max: 132.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0005075931549072266 length of segment : 20 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006070137023925781 length of segment : 23 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 4024 time to create 1 rle with old method : 0.005379199981689453 length of segment : 77 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0008568763732910156 length of segment : 24 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.001207113265991211 length of segment : 21 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001933574676513672 length of segment : 9 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 2739 time to create 1 rle with old method : 0.003584146499633789 length of segment : 45 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.001046895980834961 length of segment : 29 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0006587505340576172 length of segment : 27 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0007691383361816406 length of segment : 24 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0011909008026123047 length of segment : 20 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 732 time to create 1 rle with old method : 0.0010902881622314453 length of segment : 27 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00027751922607421875 length of segment : 11 time for calcul the mask position with numpy : 0.00013780593872070312 nb_pixel_total : 4139 time to create 1 rle with old method : 0.005140781402587891 length of segment : 81 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.61016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 23 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00022554397583007812 length of segment : 16 time for calcul the mask position with numpy : 0.00011396408081054688 nb_pixel_total : 3440 time to create 1 rle with old method : 0.0045506954193115234 length of segment : 60 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.0010385513305664062 length of segment : 55 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006520748138427734 length of segment : 25 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.001123189926147461 length of segment : 56 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006415843963623047 length of segment : 84 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1050 time to create 1 rle with old method : 0.001321554183959961 length of segment : 67 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006616115570068359 length of segment : 23 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.0010907649993896484 length of segment : 30 time for calcul the mask position with numpy : 0.00018215179443359375 nb_pixel_total : 2772 time to create 1 rle with old method : 0.003458738327026367 length of segment : 82 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 9311 time to create 1 rle with old method : 0.012621164321899414 length of segment : 201 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00023865699768066406 length of segment : 25 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1674 time to create 1 rle with old method : 0.0021271705627441406 length of segment : 56 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004703998565673828 length of segment : 19 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0007190704345703125 length of segment : 10 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005183219909667969 length of segment : 22 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.00035834312438964844 length of segment : 22 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.0007112026214599609 length of segment : 80 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.0003116130828857422 length of segment : 11 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0010743141174316406 length of segment : 26 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.0004482269287109375 length of segment : 12 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 899 time to create 1 rle with old method : 0.0017015933990478516 length of segment : 48 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0018372535705566406 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.62188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00038313865661621094 length of segment : 36 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007653236389160156 length of segment : 77 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 1593 time to create 1 rle with old method : 0.0020999908447265625 length of segment : 112 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0007114410400390625 length of segment : 26 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0008425712585449219 length of segment : 28 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1337 time to create 1 rle with old method : 0.001729726791381836 length of segment : 41 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0006303787231445312 length of segment : 22 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1324 time to create 1 rle with old method : 0.0017037391662597656 length of segment : 43 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1627 time to create 1 rle with old method : 0.0021610260009765625 length of segment : 84 time for calcul the mask position with numpy : 0.0002617835998535156 nb_pixel_total : 3797 time to create 1 rle with old method : 0.004838466644287109 length of segment : 193 time for calcul the mask position with numpy : 0.0001537799835205078 nb_pixel_total : 1689 time to create 1 rle with old method : 0.002351522445678711 length of segment : 120 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 1354 time to create 1 rle with old method : 0.001859426498413086 length of segment : 118 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 1454 time to create 1 rle with old method : 0.0019867420196533203 length of segment : 121 Processing 1 images image shape: (280, 400, 3) min: 10.00000 max: 174.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 48.33672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012598037719726562 nb_pixel_total : 106837 time to create 1 rle with old method : 0.12591338157653809 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 254.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.74453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00025463104248046875 length of segment : 9 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.00047087669372558594 length of segment : 21 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 578 time to create 1 rle with old method : 0.0007791519165039062 length of segment : 28 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004909038543701172 length of segment : 31 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00033402442932128906 length of segment : 12 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006809234619140625 length of segment : 32 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007860660552978516 length of segment : 27 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.0003108978271484375 length of segment : 8 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0005042552947998047 length of segment : 22 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1524 time to create 1 rle with old method : 0.001918792724609375 length of segment : 52 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006597042083740234 length of segment : 33 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 911 time to create 1 rle with old method : 0.0012087821960449219 length of segment : 33 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0009002685546875 length of segment : 28 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.00041961669921875 length of segment : 26 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0008075237274169922 length of segment : 40 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.02578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 33 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00017309188842773438 length of segment : 11 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.00035309791564941406 length of segment : 21 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003273487091064453 length of segment : 17 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005843639373779297 length of segment : 24 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 2351 time to create 1 rle with old method : 0.0030603408813476562 length of segment : 57 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0005195140838623047 length of segment : 25 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002696514129638672 length of segment : 11 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004937648773193359 length of segment : 17 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007884502410888672 length of segment : 29 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002803802490234375 length of segment : 16 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002644062042236328 length of segment : 17 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 597 time to create 1 rle with old method : 0.0008587837219238281 length of segment : 28 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001475811004638672 length of segment : 7 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.0011403560638427734 length of segment : 31 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.00045561790466308594 length of segment : 39 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0007188320159912109 length of segment : 30 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 1208 time to create 1 rle with old method : 0.0019643306732177734 length of segment : 44 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004417896270751953 length of segment : 19 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00014901161193847656 length of segment : 10 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006787776947021484 length of segment : 32 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 897 time to create 1 rle with old method : 0.0020759105682373047 length of segment : 39 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 633 time to create 1 rle with old method : 0.0008578300476074219 length of segment : 29 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0006177425384521484 length of segment : 35 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00024628639221191406 length of segment : 7 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002541542053222656 length of segment : 13 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 2118 time to create 1 rle with old method : 0.0027959346771240234 length of segment : 52 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00027108192443847656 length of segment : 13 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1206 time to create 1 rle with old method : 0.0015947818756103516 length of segment : 48 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1102 time to create 1 rle with old method : 0.0014951229095458984 length of segment : 40 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1106 time to create 1 rle with old method : 0.0016055107116699219 length of segment : 46 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0014901161193847656 length of segment : 58 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 822 time to create 1 rle with old method : 0.0011734962463378906 length of segment : 64 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003273487091064453 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.90859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0006961822509765625 length of segment : 37 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1228 time to create 1 rle with old method : 0.0018157958984375 length of segment : 41 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004112720489501953 length of segment : 26 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.00033283233642578125 length of segment : 21 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.0015826225280761719 length of segment : 32 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 958 time to create 1 rle with old method : 0.001870870590209961 length of segment : 61 length of segment : 0 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 651 time to create 1 rle with old method : 0.0029141902923583984 length of segment : 28 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0006241798400878906 length of segment : 14 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00023818016052246094 length of segment : 15 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0005233287811279297 length of segment : 25 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0005087852478027344 length of segment : 14 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0005595684051513672 length of segment : 14 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1691 time to create 1 rle with old method : 0.0030198097229003906 length of segment : 40 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 34 time to create 1 rle with old method : 9.846687316894531e-05 length of segment : 8 time for calcul the mask position with numpy : 0.0001537799835205078 nb_pixel_total : 5555 time to create 1 rle with old method : 0.009028434753417969 length of segment : 132 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 642 time to create 1 rle with old method : 0.0008590221405029297 length of segment : 44 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00022649765014648438 length of segment : 19 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 755 time to create 1 rle with old method : 0.001146554946899414 length of segment : 135 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005033016204833984 length of segment : 43 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.000568389892578125 length of segment : 44 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 16 time to create 1 rle with old method : 5.459785461425781e-05 length of segment : 4 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 725 time to create 1 rle with old method : 0.001123666763305664 length of segment : 123 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0010673999786376953 length of segment : 122 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.13359 max: 149.44375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006923675537109375 length of segment : 27 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 933 time to create 1 rle with old method : 0.0013680458068847656 length of segment : 39 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 733 time to create 1 rle with old method : 0.0010547637939453125 length of segment : 46 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 811 time to create 1 rle with old method : 0.001154184341430664 length of segment : 37 time for calcul the mask position with numpy : 0.0002243518829345703 nb_pixel_total : 5259 time to create 1 rle with old method : 0.0069675445556640625 length of segment : 123 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.00032448768615722656 length of segment : 26 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001316070556640625 length of segment : 27 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 930 time to create 1 rle with old method : 0.0012993812561035156 length of segment : 43 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1786 time to create 1 rle with old method : 0.0023453235626220703 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.25469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 8135 time to create 1 rle with old method : 0.010524749755859375 length of segment : 72 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 36 time to create 1 rle with old method : 7.939338684082031e-05 length of segment : 6 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006856918334960938 length of segment : 37 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 32 time to create 1 rle with old method : 6.985664367675781e-05 length of segment : 7 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.80938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 2165 time to create 1 rle with old method : 0.003841876983642578 length of segment : 41 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 4107 time to create 1 rle with old method : 0.005266427993774414 length of segment : 180 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 659 time to create 1 rle with old method : 0.0011448860168457031 length of segment : 10 time for calcul the mask position with numpy : 9.250640869140625e-05 nb_pixel_total : 2819 time to create 1 rle with old method : 0.0036466121673583984 length of segment : 111 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.00022268295288085938 length of segment : 7 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 2147 time to create 1 rle with old method : 0.0026264190673828125 length of segment : 115 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.99688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 9580 time to create 1 rle with old method : 0.011847972869873047 length of segment : 86 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1087 time to create 1 rle with old method : 0.001378774642944336 length of segment : 55 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002903938293457031 length of segment : 20 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 3875 time to create 1 rle with old method : 0.004774808883666992 length of segment : 71 time for calcul the mask position with numpy : 0.00011992454528808594 nb_pixel_total : 1465 time to create 1 rle with old method : 0.0019674301147460938 length of segment : 142 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 3928 time to create 1 rle with old method : 0.004673004150390625 length of segment : 74 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.61172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1299 time to create 1 rle with old method : 0.0015766620635986328 length of segment : 107 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00021219253540039062 length of segment : 12 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007812976837158203 length of segment : 25 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004582405090332031 length of segment : 19 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 571 time to create 1 rle with old method : 0.0007736682891845703 length of segment : 25 time for calcul the mask position with numpy : 0.0006000995635986328 nb_pixel_total : 61675 time to create 1 rle with old method : 0.07121014595031738 length of segment : 276 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1757 time to create 1 rle with old method : 0.0022735595703125 length of segment : 82 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1397 time to create 1 rle with old method : 0.0017735958099365234 length of segment : 85 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 577 time to create 1 rle with old method : 0.0006682872772216797 length of segment : 79 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 198.00000 molded_images shape: (1, 640, 640, 3) min: -89.73984 max: 66.55547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.55938 max: 132.16641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00037097930908203125 length of segment : 22 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 714 time to create 1 rle with old method : 0.0010113716125488281 length of segment : 25 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0007052421569824219 length of segment : 28 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 886 time to create 1 rle with old method : 0.0011818408966064453 length of segment : 31 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 835 time to create 1 rle with old method : 0.0010716915130615234 length of segment : 31 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 608 time to create 1 rle with old method : 0.0008420944213867188 length of segment : 25 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 572 time to create 1 rle with old method : 0.0007500648498535156 length of segment : 23 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0011200904846191406 length of segment : 21 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 1487 time to create 1 rle with old method : 0.002122163772583008 length of segment : 112 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 756 time to create 1 rle with old method : 0.0010232925415039062 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.34844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 858 time to create 1 rle with old method : 0.0011510848999023438 length of segment : 53 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.00026297569274902344 length of segment : 17 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0015988349914550781 length of segment : 53 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 3064 time to create 1 rle with old method : 0.005564689636230469 length of segment : 52 time for calcul the mask position with numpy : 0.0003707408905029297 nb_pixel_total : 2701 time to create 1 rle with old method : 0.004969120025634766 length of segment : 143 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0004253387451171875 length of segment : 9 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0007390975952148438 length of segment : 19 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00031185150146484375 length of segment : 25 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0019228458404541016 length of segment : 74 time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 8309 time to create 1 rle with old method : 0.015496492385864258 length of segment : 183 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0004203319549560547 length of segment : 17 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0006098747253417969 length of segment : 24 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00036597251892089844 length of segment : 11 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005965232849121094 length of segment : 22 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0008006095886230469 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.05156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 752 time to create 1 rle with old method : 0.0011320114135742188 length of segment : 47 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.00041794776916503906 length of segment : 27 length of segment : 0 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003566741943359375 length of segment : 55 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1377 time to create 1 rle with old method : 0.0017118453979492188 length of segment : 132 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006277561187744141 length of segment : 30 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.0010437965393066406 length of segment : 71 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1037 time to create 1 rle with old method : 0.0014302730560302734 length of segment : 41 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00020766258239746094 length of segment : 14 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.00032067298889160156 length of segment : 26 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1653 time to create 1 rle with old method : 0.0021114349365234375 length of segment : 84 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 3325 time to create 1 rle with old method : 0.00426483154296875 length of segment : 177 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001480579376220703 length of segment : 16 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008797645568847656 length of segment : 46 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 2750 time to create 1 rle with old method : 0.003502368927001953 length of segment : 69 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 181.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 53.13750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 252.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.50234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00023245811462402344 length of segment : 9 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005919933319091797 length of segment : 42 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0006537437438964844 length of segment : 19 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0008213520050048828 length of segment : 27 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 741 time to create 1 rle with old method : 0.0009768009185791016 length of segment : 45 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 3807 time to create 1 rle with old method : 0.00478363037109375 length of segment : 72 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0006277561187744141 length of segment : 24 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.00046515464782714844 length of segment : 31 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002512931823730469 length of segment : 9 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1439 time to create 1 rle with old method : 0.0018317699432373047 length of segment : 50 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 40 time to create 1 rle with old method : 8.726119995117188e-05 length of segment : 6 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003979206085205078 length of segment : 23 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00010657310485839844 length of segment : 10 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 584 time to create 1 rle with old method : 0.0007839202880859375 length of segment : 27 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 937 time to create 1 rle with old method : 0.0011892318725585938 length of segment : 43 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.02969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 36 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00014448165893554688 length of segment : 10 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004942417144775391 length of segment : 22 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0013718605041503906 length of segment : 34 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0005123615264892578 length of segment : 33 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003337860107421875 length of segment : 17 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007877349853515625 length of segment : 26 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2339 time to create 1 rle with old method : 0.002945423126220703 length of segment : 61 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00032901763916015625 length of segment : 22 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00036406517028808594 length of segment : 27 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005664825439453125 length of segment : 24 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003445148468017578 length of segment : 23 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005543231964111328 length of segment : 27 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00014328956604003906 length of segment : 10 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1209 time to create 1 rle with old method : 0.0014967918395996094 length of segment : 39 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00021409988403320312 length of segment : 11 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0006144046783447266 length of segment : 32 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0017852783203125 length of segment : 55 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00023698806762695312 length of segment : 16 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00023055076599121094 length of segment : 11 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 802 time to create 1 rle with old method : 0.001039266586303711 length of segment : 36 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005958080291748047 length of segment : 36 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 901 time to create 1 rle with old method : 0.0012021064758300781 length of segment : 43 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003979206085205078 length of segment : 16 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00025391578674316406 length of segment : 13 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00030517578125 length of segment : 7 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003917217254638672 length of segment : 32 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.00024819374084472656 length of segment : 13 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 745 time to create 1 rle with old method : 0.0009837150573730469 length of segment : 31 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002949237823486328 length of segment : 22 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0007965564727783203 length of segment : 28 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0011038780212402344 length of segment : 39 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00022792816162109375 length of segment : 22 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1309 time to create 1 rle with old method : 0.0017247200012207031 length of segment : 52 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0004029273986816406 length of segment : 10 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001881122589111328 length of segment : 14 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.000125885009765625 length of segment : 7 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00036072731018066406 length of segment : 22 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003142356872558594 length of segment : 23 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00021266937255859375 length of segment : 17 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 575 time to create 1 rle with old method : 0.0007469654083251953 length of segment : 41 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1191 time to create 1 rle with old method : 0.001714944839477539 length of segment : 44 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.001068115234375 length of segment : 31 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 7585 time to create 1 rle with old method : 0.009412527084350586 length of segment : 133 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 710 time to create 1 rle with old method : 0.0011112689971923828 length of segment : 30 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003726482391357422 length of segment : 16 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 666 time to create 1 rle with old method : 0.0010066032409667969 length of segment : 30 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0008745193481445312 length of segment : 46 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.0004711151123046875 length of segment : 52 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006351470947265625 length of segment : 50 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.00043654441833496094 length of segment : 54 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.47734 max: 149.58828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0004756450653076172 length of segment : 26 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 741 time to create 1 rle with old method : 0.001058340072631836 length of segment : 29 time for calcul the mask position with numpy : 0.00022077560424804688 nb_pixel_total : 7038 time to create 1 rle with old method : 0.008614063262939453 length of segment : 128 time for calcul the mask position with numpy : 0.00019216537475585938 nb_pixel_total : 5990 time to create 1 rle with old method : 0.00746464729309082 length of segment : 117 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 789 time to create 1 rle with old method : 0.0010957717895507812 length of segment : 30 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1761 time to create 1 rle with old method : 0.002448558807373047 length of segment : 67 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.001161813735961914 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.45000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00010585784912109375 nb_pixel_total : 6779 time to create 1 rle with old method : 0.00851297378540039 length of segment : 64 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 34 time to create 1 rle with old method : 7.367134094238281e-05 length of segment : 7 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.0006034374237060547 length of segment : 31 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 6641 time to create 1 rle with old method : 0.009115934371948242 length of segment : 66 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00042700767517089844 length of segment : 13 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 30 time to create 1 rle with old method : 6.127357482910156e-05 length of segment : 6 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0006573200225830078 length of segment : 37 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005657672882080078 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.05547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 1746 time to create 1 rle with old method : 0.005137920379638672 length of segment : 26 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 666 time to create 1 rle with old method : 0.0017194747924804688 length of segment : 11 time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 3017 time to create 1 rle with old method : 0.003937482833862305 length of segment : 125 time for calcul the mask position with numpy : 0.00018525123596191406 nb_pixel_total : 3014 time to create 1 rle with old method : 0.0053462982177734375 length of segment : 109 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.0002880096435546875 length of segment : 8 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 3064 time to create 1 rle with old method : 0.0038831233978271484 length of segment : 133 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.77422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00014400482177734375 nb_pixel_total : 9873 time to create 1 rle with old method : 0.012192487716674805 length of segment : 86 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00028896331787109375 length of segment : 18 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 883 time to create 1 rle with old method : 0.0011415481567382812 length of segment : 46 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.00022101402282714844 length of segment : 21 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003604888916015625 length of segment : 21 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.22891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1372 time to create 1 rle with old method : 0.0017061233520507812 length of segment : 109 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 986 time to create 1 rle with old method : 0.0013341903686523438 length of segment : 74 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 571 time to create 1 rle with old method : 0.0008029937744140625 length of segment : 24 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 2069 time to create 1 rle with old method : 0.00273895263671875 length of segment : 59 time for calcul the mask position with numpy : 0.0006508827209472656 nb_pixel_total : 57203 time to create 1 rle with old method : 0.06685376167297363 length of segment : 296 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005309581756591797 length of segment : 21 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0007979869842529297 length of segment : 21 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1020 time to create 1 rle with old method : 0.0013885498046875 length of segment : 71 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 981 time to create 1 rle with old method : 0.002081632614135742 length of segment : 72 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0009191036224365234 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 201.00000 molded_images shape: (1, 640, 640, 3) min: -86.86094 max: 69.55547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.001657247543334961 nb_pixel_total : 153215 time to create 1 rle with new method : 0.002663135528564453 length of segment : 397 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.64531 max: 131.37734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0006487369537353516 length of segment : 22 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 832 time to create 1 rle with old method : 0.0011856555938720703 length of segment : 20 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0011539459228515625 length of segment : 24 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0005617141723632812 length of segment : 20 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 837 time to create 1 rle with old method : 0.0014805793762207031 length of segment : 31 time for calcul the mask position with numpy : 0.0001704692840576172 nb_pixel_total : 4656 time to create 1 rle with old method : 0.006184101104736328 length of segment : 88 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.00083160400390625 length of segment : 25 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 720 time to create 1 rle with old method : 0.0009763240814208984 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.10625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 23 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 878 time to create 1 rle with old method : 0.001911163330078125 length of segment : 59 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002219676971435547 length of segment : 16 time for calcul the mask position with numpy : 0.0001342296600341797 nb_pixel_total : 3286 time to create 1 rle with old method : 0.00431060791015625 length of segment : 60 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1091 time to create 1 rle with old method : 0.0014157295227050781 length of segment : 71 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0008296966552734375 length of segment : 66 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 1755 time to create 1 rle with old method : 0.0023491382598876953 length of segment : 159 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.00054931640625 length of segment : 22 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005121231079101562 length of segment : 20 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005428791046142578 length of segment : 23 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 2395 time to create 1 rle with old method : 0.0032105445861816406 length of segment : 177 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 6471 time to create 1 rle with old method : 0.008792877197265625 length of segment : 136 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004875659942626953 length of segment : 25 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00020599365234375 length of segment : 22 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0006573200225830078 length of segment : 22 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0008337497711181641 length of segment : 21 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004646778106689453 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00030350685119628906 length of segment : 13 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006544589996337891 length of segment : 73 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003452301025390625 length of segment : 22 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0011165142059326172 length of segment : 32 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1211 time to create 1 rle with old method : 0.0015532970428466797 length of segment : 91 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1449 time to create 1 rle with old method : 0.0018687248229980469 length of segment : 58 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004978179931640625 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.71953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 2253 time to create 1 rle with old method : 0.0028769969940185547 length of segment : 130 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006995201110839844 length of segment : 37 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006496906280517578 length of segment : 79 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1177 time to create 1 rle with old method : 0.0015425682067871094 length of segment : 40 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1467 time to create 1 rle with old method : 0.0018258094787597656 length of segment : 77 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 3180 time to create 1 rle with old method : 0.003977775573730469 length of segment : 174 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005824565887451172 length of segment : 43 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007767677307128906 length of segment : 43 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0015664100646972656 length of segment : 112 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 5015 time to create 1 rle with old method : 0.00629425048828125 length of segment : 186 Processing 1 images image shape: (280, 400, 3) min: 2.00000 max: 181.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 53.13750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008804798126220703 nb_pixel_total : 106470 time to create 1 rle with old method : 0.12177062034606934 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.54922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0004813671112060547 length of segment : 22 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 522 time to create 1 rle with old method : 0.0007443428039550781 length of segment : 30 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.00029659271240234375 length of segment : 13 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.0002219676971435547 length of segment : 8 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0008058547973632812 length of segment : 28 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.00039315223693847656 length of segment : 25 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00011110305786132812 length of segment : 11 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00021719932556152344 length of segment : 7 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 987 time to create 1 rle with old method : 0.0012371540069580078 length of segment : 35 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004870891571044922 length of segment : 31 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005877017974853516 length of segment : 29 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0007493495941162109 length of segment : 41 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.000133514404296875 length of segment : 8 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.000640869140625 length of segment : 27 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.93203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 37 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00014638900756835938 length of segment : 10 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.000324249267578125 length of segment : 17 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003414154052734375 length of segment : 17 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0007474422454833984 length of segment : 25 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0007097721099853516 length of segment : 31 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0014607906341552734 length of segment : 33 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.0008533000946044922 length of segment : 29 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003209114074707031 length of segment : 11 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00015163421630859375 length of segment : 7 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 939 time to create 1 rle with old method : 0.0012409687042236328 length of segment : 37 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002522468566894531 length of segment : 16 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 725 time to create 1 rle with old method : 0.0008788108825683594 length of segment : 38 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003943443298339844 length of segment : 18 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 619 time to create 1 rle with old method : 0.0008385181427001953 length of segment : 27 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1108 time to create 1 rle with old method : 0.0013761520385742188 length of segment : 65 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1939 time to create 1 rle with old method : 0.002480030059814453 length of segment : 43 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00014352798461914062 length of segment : 10 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005421638488769531 length of segment : 24 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0010242462158203125 length of segment : 36 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 988 time to create 1 rle with old method : 0.001331329345703125 length of segment : 52 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1042 time to create 1 rle with old method : 0.001279592514038086 length of segment : 52 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005822181701660156 length of segment : 22 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005781650543212891 length of segment : 26 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002455711364746094 length of segment : 15 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003895759582519531 length of segment : 20 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1042 time to create 1 rle with old method : 0.0013740062713623047 length of segment : 37 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1111 time to create 1 rle with old method : 0.0014841556549072266 length of segment : 64 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005383491516113281 length of segment : 26 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.00023937225341796875 length of segment : 13 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002167224884033203 length of segment : 13 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.00037288665771484375 length of segment : 16 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00015687942504882812 length of segment : 11 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 31 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 633 time to create 1 rle with old method : 0.0008690357208251953 length of segment : 30 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005242824554443359 length of segment : 24 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004036426544189453 length of segment : 19 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005502700805664062 length of segment : 35 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.49453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003228187561035156 length of segment : 20 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1166 time to create 1 rle with old method : 0.0016446113586425781 length of segment : 33 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003905296325683594 length of segment : 24 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00041675567626953125 length of segment : 25 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1580 time to create 1 rle with old method : 0.0020706653594970703 length of segment : 40 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001742839813232422 length of segment : 16 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 48 time to create 1 rle with old method : 9.512901306152344e-05 length of segment : 9 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003380775451660156 length of segment : 14 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00017070770263671875 length of segment : 10 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.00032401084899902344 length of segment : 14 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0003070831298828125 length of segment : 13 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0015711784362792969 length of segment : 45 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002567768096923828 length of segment : 22 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0006787776947021484 length of segment : 51 Detection mask done ! Trying to reset tf kernel 2190624 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4384 tf kernel not reseted sub process len(results) : 439 len(list_Values) 439 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 439 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7781 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 439 chid ids of type : 4228 Number RLEs to save : 20613 save missing photos in datou_result : time spend for datou_step_exec : 27.904486656188965 time spend to save output : 5.550189971923828 total time spend for step 1 : 33.45467662811279 step2:brightness Thu Feb 6 05:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738815627_2189983_1334935917_b3be9d757e7348aafc15d03ce51b7b08.jpg treat image : temp/1738815627_2189983_1334935866_f2de2f6b3e6574a92ff4f4b37d6e19fc.jpg treat image : temp/1738815627_2189983_1334935863_6f017f0a0d71c342414259b28fdca162.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.01559591293334961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.10594534873962402 save missing photos in datou_result : time spend for datou_step_exec : 0.8338539600372314 time spend to save output : 0.1261734962463379 total time spend for step 2 : 0.9600274562835693 step3:blur_detection Thu Feb 6 05:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738815627_2189983_1334935917_b3be9d757e7348aafc15d03ce51b7b08.jpg resize: (1080, 1920) 1334935917 -7.827725084134799 treat image : temp/1738815627_2189983_1334935866_f2de2f6b3e6574a92ff4f4b37d6e19fc.jpg resize: (1080, 1920) 1334935866 -7.821863523269276 treat image : temp/1738815627_2189983_1334935863_6f017f0a0d71c342414259b28fdca162.jpg resize: (1080, 1920) 1334935863 -7.835651359099072 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.015114068984985352 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.014266252517700195 save missing photos in datou_result : time spend for datou_step_exec : 2.9999473094940186 time spend to save output : 0.03375506401062012 total time spend for step 3 : 3.0337023735046387 step4:rle_unique_nms_with_priority Thu Feb 6 05:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 439 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 154 nb_hashtags : 7 time to prepare the origin masks : 1.187572956085205 time for calcul the mask position with numpy : 0.02121424674987793 nb_pixel_total : 1628056 time to create 1 rle with new method : 0.04658818244934082 time for calcul the mask position with numpy : 0.008282184600830078 nb_pixel_total : 1474 time to create 1 rle with old method : 0.0017161369323730469 time for calcul the mask position with numpy : 0.008232355117797852 nb_pixel_total : 5012 time to create 1 rle with old method : 0.005555152893066406 time for calcul the mask position with numpy : 0.008015871047973633 nb_pixel_total : 506 time to create 1 rle with old method : 0.000560760498046875 time for calcul the mask position with numpy : 0.008156776428222656 nb_pixel_total : 67 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.008861064910888672 nb_pixel_total : 94 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.008373260498046875 nb_pixel_total : 1570 time to create 1 rle with old method : 0.0018279552459716797 time for calcul the mask position with numpy : 0.008360624313354492 nb_pixel_total : 759 time to create 1 rle with old method : 0.0009162425994873047 time for calcul the mask position with numpy : 0.008417844772338867 nb_pixel_total : 425 time to create 1 rle with old method : 0.0004951953887939453 time for calcul the mask position with numpy : 0.00843501091003418 nb_pixel_total : 49732 time to create 1 rle with old method : 0.0563812255859375 time for calcul the mask position with numpy : 0.008209705352783203 nb_pixel_total : 31 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.008291006088256836 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003342628479003906 time for calcul the mask position with numpy : 0.008059263229370117 nb_pixel_total : 4057 time to create 1 rle with old method : 0.0046825408935546875 time for calcul the mask position with numpy : 0.008300542831420898 nb_pixel_total : 8287 time to create 1 rle with old method : 0.009493589401245117 time for calcul the mask position with numpy : 0.008390188217163086 nb_pixel_total : 988 time to create 1 rle with old method : 0.0013031959533691406 time for calcul the mask position with numpy : 0.008379936218261719 nb_pixel_total : 303 time to create 1 rle with old method : 0.00037169456481933594 time for calcul the mask position with numpy : 0.008255958557128906 nb_pixel_total : 3396 time to create 1 rle with old method : 0.004004716873168945 time for calcul the mask position with numpy : 0.008124828338623047 nb_pixel_total : 5810 time to create 1 rle with old method : 0.0066912174224853516 time for calcul the mask position with numpy : 0.008379936218261719 nb_pixel_total : 203 time to create 1 rle with old method : 0.00023317337036132812 time for calcul the mask position with numpy : 0.008257150650024414 nb_pixel_total : 1516 time to create 1 rle with old method : 0.0018684864044189453 time for calcul the mask position with numpy : 0.008292198181152344 nb_pixel_total : 968 time to create 1 rle with old method : 0.0012404918670654297 time for calcul the mask position with numpy : 0.008435249328613281 nb_pixel_total : 215 time to create 1 rle with old method : 0.00030231475830078125 time for calcul the mask position with numpy : 0.008467435836791992 nb_pixel_total : 2530 time to create 1 rle with old method : 0.0030472278594970703 time for calcul the mask position with numpy : 0.008380889892578125 nb_pixel_total : 287 time to create 1 rle with old method : 0.00038886070251464844 time for calcul the mask position with numpy : 0.008328676223754883 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001366138458251953 time for calcul the mask position with numpy : 0.008345365524291992 nb_pixel_total : 10095 time to create 1 rle with old method : 0.013572216033935547 time for calcul the mask position with numpy : 0.009715080261230469 nb_pixel_total : 118 time to create 1 rle with old method : 0.00022840499877929688 time for calcul the mask position with numpy : 0.009716033935546875 nb_pixel_total : 742 time to create 1 rle with old method : 0.0013151168823242188 time for calcul the mask position with numpy : 0.009682893753051758 nb_pixel_total : 574 time to create 1 rle with old method : 0.0010120868682861328 time for calcul the mask position with numpy : 0.009757757186889648 nb_pixel_total : 76 time to create 1 rle with old method : 0.00014352798461914062 time for calcul the mask position with numpy : 0.009657859802246094 nb_pixel_total : 559 time to create 1 rle with old method : 0.0010306835174560547 time for calcul the mask position with numpy : 0.009747982025146484 nb_pixel_total : 123 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.010618448257446289 nb_pixel_total : 155503 time to create 1 rle with new method : 0.03989911079406738 time for calcul the mask position with numpy : 0.008159399032592773 nb_pixel_total : 392 time to create 1 rle with old method : 0.00046896934509277344 time for calcul the mask position with numpy : 0.008034706115722656 nb_pixel_total : 1050 time to create 1 rle with old method : 0.0012526512145996094 time for calcul the mask position with numpy : 0.008029937744140625 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003204345703125 time for calcul the mask position with numpy : 0.008090496063232422 nb_pixel_total : 7789 time to create 1 rle with old method : 0.008833885192871094 time for calcul the mask position with numpy : 0.007910490036010742 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005300045013427734 time for calcul the mask position with numpy : 0.007881402969360352 nb_pixel_total : 1354 time to create 1 rle with old method : 0.0016417503356933594 time for calcul the mask position with numpy : 0.007958412170410156 nb_pixel_total : 805 time to create 1 rle with old method : 0.000919342041015625 time for calcul the mask position with numpy : 0.007965803146362305 nb_pixel_total : 126 time to create 1 rle with old method : 0.00016689300537109375 time for calcul the mask position with numpy : 0.00793910026550293 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005042552947998047 time for calcul the mask position with numpy : 0.007959127426147461 nb_pixel_total : 2772 time to create 1 rle with old method : 0.003144979476928711 time for calcul the mask position with numpy : 0.008016586303710938 nb_pixel_total : 152 time to create 1 rle with old method : 0.00017762184143066406 time for calcul the mask position with numpy : 0.007956743240356445 nb_pixel_total : 3440 time to create 1 rle with old method : 0.004069805145263672 time for calcul the mask position with numpy : 0.008154869079589844 nb_pixel_total : 47 time to create 1 rle with old method : 7.295608520507812e-05 time for calcul the mask position with numpy : 0.008083581924438477 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006270408630371094 time for calcul the mask position with numpy : 0.008089542388916016 nb_pixel_total : 1337 time to create 1 rle with old method : 0.001500844955444336 time for calcul the mask position with numpy : 0.008179187774658203 nb_pixel_total : 77 time to create 1 rle with old method : 0.00011992454528808594 time for calcul the mask position with numpy : 0.008135318756103516 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005574226379394531 time for calcul the mask position with numpy : 0.008069992065429688 nb_pixel_total : 320 time to create 1 rle with old method : 0.00039005279541015625 time for calcul the mask position with numpy : 0.008171319961547852 nb_pixel_total : 423 time to create 1 rle with old method : 0.00047016143798828125 time for calcul the mask position with numpy : 0.007952451705932617 nb_pixel_total : 773 time to create 1 rle with old method : 0.0009279251098632812 time for calcul the mask position with numpy : 0.008072137832641602 nb_pixel_total : 4024 time to create 1 rle with old method : 0.00470423698425293 time for calcul the mask position with numpy : 0.008033514022827148 nb_pixel_total : 190 time to create 1 rle with old method : 0.0003046989440917969 time for calcul the mask position with numpy : 0.007834434509277344 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001704692840576172 time for calcul the mask position with numpy : 0.007962942123413086 nb_pixel_total : 1689 time to create 1 rle with old method : 0.001936197280883789 time for calcul the mask position with numpy : 0.008010387420654297 nb_pixel_total : 448 time to create 1 rle with old method : 0.0004813671112060547 time for calcul the mask position with numpy : 0.008028268814086914 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001125335693359375 time for calcul the mask position with numpy : 0.007964372634887695 nb_pixel_total : 3797 time to create 1 rle with old method : 0.0042378902435302734 time for calcul the mask position with numpy : 0.008097410202026367 nb_pixel_total : 1593 time to create 1 rle with old method : 0.0018811225891113281 time for calcul the mask position with numpy : 0.008335351943969727 nb_pixel_total : 30 time to create 1 rle with old method : 5.936622619628906e-05 time for calcul the mask position with numpy : 0.00818634033203125 nb_pixel_total : 744 time to create 1 rle with old method : 0.0008993148803710938 time for calcul the mask position with numpy : 0.008121490478515625 nb_pixel_total : 770 time to create 1 rle with old method : 0.0008466243743896484 time for calcul the mask position with numpy : 0.007967472076416016 nb_pixel_total : 129 time to create 1 rle with old method : 0.00014138221740722656 time for calcul the mask position with numpy : 0.00805974006652832 nb_pixel_total : 14 time to create 1 rle with old method : 6.103515625e-05 time for calcul the mask position with numpy : 0.00800943374633789 nb_pixel_total : 547 time to create 1 rle with old method : 0.0006566047668457031 time for calcul the mask position with numpy : 0.008091926574707031 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003101825714111328 time for calcul the mask position with numpy : 0.0079498291015625 nb_pixel_total : 898 time to create 1 rle with old method : 0.0010597705841064453 time for calcul the mask position with numpy : 0.007844924926757812 nb_pixel_total : 516 time to create 1 rle with old method : 0.0006175041198730469 time for calcul the mask position with numpy : 0.008072853088378906 nb_pixel_total : 149 time to create 1 rle with old method : 0.000232696533203125 time for calcul the mask position with numpy : 0.008239030838012695 nb_pixel_total : 388 time to create 1 rle with old method : 0.0004944801330566406 time for calcul the mask position with numpy : 0.008011817932128906 nb_pixel_total : 127 time to create 1 rle with old method : 0.0001461505889892578 time for calcul the mask position with numpy : 0.008171796798706055 nb_pixel_total : 187 time to create 1 rle with old method : 0.00022912025451660156 time for calcul the mask position with numpy : 0.007909774780273438 nb_pixel_total : 1627 time to create 1 rle with old method : 0.0019063949584960938 time for calcul the mask position with numpy : 0.0079345703125 nb_pixel_total : 742 time to create 1 rle with old method : 0.0008242130279541016 time for calcul the mask position with numpy : 0.008052349090576172 nb_pixel_total : 262 time to create 1 rle with old method : 0.00032830238342285156 time for calcul the mask position with numpy : 0.008266687393188477 nb_pixel_total : 367 time to create 1 rle with old method : 0.0004296302795410156 time for calcul the mask position with numpy : 0.008205413818359375 nb_pixel_total : 157 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.008066415786743164 nb_pixel_total : 2739 time to create 1 rle with old method : 0.0030989646911621094 time for calcul the mask position with numpy : 0.008098602294921875 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005652904510498047 time for calcul the mask position with numpy : 0.009248018264770508 nb_pixel_total : 401 time to create 1 rle with old method : 0.0006937980651855469 time for calcul the mask position with numpy : 0.009612083435058594 nb_pixel_total : 350 time to create 1 rle with old method : 0.0006034374237060547 time for calcul the mask position with numpy : 0.010018587112426758 nb_pixel_total : 106837 time to create 1 rle with old method : 0.13654732704162598 time for calcul the mask position with numpy : 0.0084381103515625 nb_pixel_total : 178 time to create 1 rle with old method : 0.00021982192993164062 time for calcul the mask position with numpy : 0.009431838989257812 nb_pixel_total : 125 time to create 1 rle with old method : 0.0001628398895263672 time for calcul the mask position with numpy : 0.008394956588745117 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.008362293243408203 nb_pixel_total : 154 time to create 1 rle with old method : 0.00022912025451660156 time for calcul the mask position with numpy : 0.008295297622680664 nb_pixel_total : 642 time to create 1 rle with old method : 0.0007550716400146484 time for calcul the mask position with numpy : 0.0083770751953125 nb_pixel_total : 449 time to create 1 rle with old method : 0.0005331039428710938 time for calcul the mask position with numpy : 0.008336067199707031 nb_pixel_total : 185 time to create 1 rle with old method : 0.00026917457580566406 time for calcul the mask position with numpy : 0.008356332778930664 nb_pixel_total : 48 time to create 1 rle with old method : 8.058547973632812e-05 time for calcul the mask position with numpy : 0.008509159088134766 nb_pixel_total : 578 time to create 1 rle with old method : 0.0006854534149169922 time for calcul the mask position with numpy : 0.008391618728637695 nb_pixel_total : 755 time to create 1 rle with old method : 0.0009765625 time for calcul the mask position with numpy : 0.008374452590942383 nb_pixel_total : 211 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.008283376693725586 nb_pixel_total : 292 time to create 1 rle with old method : 0.00035381317138671875 time for calcul the mask position with numpy : 0.008246898651123047 nb_pixel_total : 16 time to create 1 rle with old method : 3.719329833984375e-05 time for calcul the mask position with numpy : 0.008117198944091797 nb_pixel_total : 797 time to create 1 rle with old method : 0.000978708267211914 time for calcul the mask position with numpy : 0.008287906646728516 nb_pixel_total : 1524 time to create 1 rle with old method : 0.001817941665649414 time for calcul the mask position with numpy : 0.008191823959350586 nb_pixel_total : 911 time to create 1 rle with old method : 0.0010581016540527344 time for calcul the mask position with numpy : 0.008235692977905273 nb_pixel_total : 84 time to create 1 rle with old method : 0.00010704994201660156 time for calcul the mask position with numpy : 0.008111238479614258 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003437995910644531 time for calcul the mask position with numpy : 0.008102655410766602 nb_pixel_total : 5426 time to create 1 rle with old method : 0.006290435791015625 time for calcul the mask position with numpy : 0.008073091506958008 nb_pixel_total : 40 time to create 1 rle with old method : 7.62939453125e-05 time for calcul the mask position with numpy : 0.008218765258789062 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006284713745117188 time for calcul the mask position with numpy : 0.008251428604125977 nb_pixel_total : 353 time to create 1 rle with old method : 0.0004169940948486328 time for calcul the mask position with numpy : 0.008434295654296875 nb_pixel_total : 633 time to create 1 rle with old method : 0.0007677078247070312 time for calcul the mask position with numpy : 0.008455514907836914 nb_pixel_total : 273 time to create 1 rle with old method : 0.000335693359375 time for calcul the mask position with numpy : 0.008432149887084961 nb_pixel_total : 160 time to create 1 rle with old method : 0.00020551681518554688 time for calcul the mask position with numpy : 0.008271932601928711 nb_pixel_total : 552 time to create 1 rle with old method : 0.0006127357482910156 time for calcul the mask position with numpy : 0.008243560791015625 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005445480346679688 time for calcul the mask position with numpy : 0.008262395858764648 nb_pixel_total : 345 time to create 1 rle with old method : 0.00044846534729003906 time for calcul the mask position with numpy : 0.00827789306640625 nb_pixel_total : 127 time to create 1 rle with old method : 0.000152587890625 time for calcul the mask position with numpy : 0.008326292037963867 nb_pixel_total : 8 time to create 1 rle with old method : 2.5033950805664062e-05 time for calcul the mask position with numpy : 0.008249521255493164 nb_pixel_total : 1102 time to create 1 rle with old method : 0.0012450218200683594 time for calcul the mask position with numpy : 0.008290767669677734 nb_pixel_total : 651 time to create 1 rle with old method : 0.0007135868072509766 time for calcul the mask position with numpy : 0.008153200149536133 nb_pixel_total : 226 time to create 1 rle with old method : 0.00029087066650390625 time for calcul the mask position with numpy : 0.008198976516723633 nb_pixel_total : 758 time to create 1 rle with old method : 0.0008907318115234375 time for calcul the mask position with numpy : 0.008124589920043945 nb_pixel_total : 1228 time to create 1 rle with old method : 0.0013632774353027344 time for calcul the mask position with numpy : 0.008098363876342773 nb_pixel_total : 3 time to create 1 rle with old method : 1.33514404296875e-05 time for calcul the mask position with numpy : 0.008333206176757812 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005488395690917969 time for calcul the mask position with numpy : 0.008238077163696289 nb_pixel_total : 183 time to create 1 rle with old method : 0.00023865699768066406 time for calcul the mask position with numpy : 0.008104801177978516 nb_pixel_total : 301 time to create 1 rle with old method : 0.0003676414489746094 time for calcul the mask position with numpy : 0.00818634033203125 nb_pixel_total : 433 time to create 1 rle with old method : 0.0004911422729492188 time for calcul the mask position with numpy : 0.007967710494995117 nb_pixel_total : 176 time to create 1 rle with old method : 0.00020432472229003906 time for calcul the mask position with numpy : 0.008180618286132812 nb_pixel_total : 1691 time to create 1 rle with old method : 0.0018236637115478516 time for calcul the mask position with numpy : 0.008173465728759766 nb_pixel_total : 352 time to create 1 rle with old method : 0.0004267692565917969 time for calcul the mask position with numpy : 0.007961273193359375 nb_pixel_total : 382 time to create 1 rle with old method : 0.00046062469482421875 time for calcul the mask position with numpy : 0.008000373840332031 nb_pixel_total : 897 time to create 1 rle with old method : 0.001066446304321289 time for calcul the mask position with numpy : 0.008150815963745117 nb_pixel_total : 34 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.008272171020507812 nb_pixel_total : 209 time to create 1 rle with old method : 0.00025725364685058594 time for calcul the mask position with numpy : 0.008157730102539062 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003132820129394531 time for calcul the mask position with numpy : 0.008127689361572266 nb_pixel_total : 261 time to create 1 rle with old method : 0.0002841949462890625 time for calcul the mask position with numpy : 0.008065223693847656 nb_pixel_total : 597 time to create 1 rle with old method : 0.0007386207580566406 time for calcul the mask position with numpy : 0.008080244064331055 nb_pixel_total : 556 time to create 1 rle with old method : 0.0006680488586425781 time for calcul the mask position with numpy : 0.008236885070800781 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002770423889160156 time for calcul the mask position with numpy : 0.008109569549560547 nb_pixel_total : 505 time to create 1 rle with old method : 0.0005533695220947266 time for calcul the mask position with numpy : 0.008008480072021484 nb_pixel_total : 16 time to create 1 rle with old method : 2.86102294921875e-05 time for calcul the mask position with numpy : 0.008151054382324219 nb_pixel_total : 29 time to create 1 rle with old method : 5.8650970458984375e-05 time for calcul the mask position with numpy : 0.008233070373535156 nb_pixel_total : 958 time to create 1 rle with old method : 0.0011906623840332031 time for calcul the mask position with numpy : 0.008352279663085938 nb_pixel_total : 1208 time to create 1 rle with old method : 0.0013916492462158203 time for calcul the mask position with numpy : 0.008314132690429688 nb_pixel_total : 114 time to create 1 rle with old method : 0.00015091896057128906 time for calcul the mask position with numpy : 0.008365154266357422 nb_pixel_total : 293 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.008507490158081055 nb_pixel_total : 96 time to create 1 rle with old method : 0.00018596649169921875 time for calcul the mask position with numpy : 0.008463144302368164 nb_pixel_total : 2351 time to create 1 rle with old method : 0.0028488636016845703 time for calcul the mask position with numpy : 0.008474349975585938 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004305839538574219 time for calcul the mask position with numpy : 0.008557558059692383 nb_pixel_total : 401 time to create 1 rle with old method : 0.0004978179931640625 time for calcul the mask position with numpy : 0.008626461029052734 nb_pixel_total : 107 time to create 1 rle with old method : 0.00018835067749023438 time for calcul the mask position with numpy : 0.008548498153686523 nb_pixel_total : 815 time to create 1 rle with old method : 0.0009744167327880859 time for calcul the mask position with numpy : 0.008334636688232422 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004367828369140625 time for calcul the mask position with numpy : 0.008423328399658203 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002541542053222656 time for calcul the mask position with numpy : 0.008231878280639648 nb_pixel_total : 152 time to create 1 rle with old method : 0.00022530555725097656 time for calcul the mask position with numpy : 0.008078336715698242 nb_pixel_total : 164 time to create 1 rle with old method : 0.00019097328186035156 time for calcul the mask position with numpy : 0.008205652236938477 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001556873321533203 time for calcul the mask position with numpy : 0.00816202163696289 nb_pixel_total : 72 time to create 1 rle with old method : 8.96453857421875e-05 create new chi : 1.7527964115142822 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006591796875 batch 1 Loaded 155 chid ids of type : 4230 Number RLEs to save : 14644 TO DO : save crop sub photo not yet done ! save time : 1.2228443622589111 nb_obj : 138 nb_hashtags : 6 time to prepare the origin masks : 2.3224310874938965 time for calcul the mask position with numpy : 0.0324101448059082 nb_pixel_total : 1891368 time to create 1 rle with new method : 0.061801910400390625 time for calcul the mask position with numpy : 0.006172895431518555 nb_pixel_total : 1299 time to create 1 rle with old method : 0.0015172958374023438 time for calcul the mask position with numpy : 0.009991645812988281 nb_pixel_total : 4107 time to create 1 rle with old method : 0.0047147274017333984 time for calcul the mask position with numpy : 0.010577678680419922 nb_pixel_total : 61556 time to create 1 rle with old method : 0.07609868049621582 time for calcul the mask position with numpy : 0.011549711227416992 nb_pixel_total : 504 time to create 1 rle with old method : 0.000850677490234375 time for calcul the mask position with numpy : 0.011458873748779297 nb_pixel_total : 42 time to create 1 rle with old method : 0.00013136863708496094 time for calcul the mask position with numpy : 0.011623620986938477 nb_pixel_total : 485 time to create 1 rle with old method : 0.0008165836334228516 time for calcul the mask position with numpy : 0.01137995719909668 nb_pixel_total : 933 time to create 1 rle with old method : 0.0015969276428222656 time for calcul the mask position with numpy : 0.011536121368408203 nb_pixel_total : 733 time to create 1 rle with old method : 0.0012354850769042969 time for calcul the mask position with numpy : 0.01150059700012207 nb_pixel_total : 1119 time to create 1 rle with old method : 0.0012998580932617188 time for calcul the mask position with numpy : 0.010105609893798828 nb_pixel_total : 96 time to create 1 rle with old method : 0.00012564659118652344 time for calcul the mask position with numpy : 0.005930662155151367 nb_pixel_total : 21 time to create 1 rle with old method : 5.5789947509765625e-05 time for calcul the mask position with numpy : 0.0058727264404296875 nb_pixel_total : 36 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.0057811737060546875 nb_pixel_total : 184 time to create 1 rle with old method : 0.00022363662719726562 time for calcul the mask position with numpy : 0.005849599838256836 nb_pixel_total : 32 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.005887508392333984 nb_pixel_total : 1465 time to create 1 rle with old method : 0.0017611980438232422 time for calcul the mask position with numpy : 0.005815267562866211 nb_pixel_total : 533 time to create 1 rle with old method : 0.0006597042083740234 time for calcul the mask position with numpy : 0.005811214447021484 nb_pixel_total : 8135 time to create 1 rle with old method : 0.008936882019042969 time for calcul the mask position with numpy : 0.00603795051574707 nb_pixel_total : 5259 time to create 1 rle with old method : 0.006124019622802734 time for calcul the mask position with numpy : 0.005962371826171875 nb_pixel_total : 1087 time to create 1 rle with old method : 0.0012736320495605469 time for calcul the mask position with numpy : 0.005964517593383789 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002448558807373047 time for calcul the mask position with numpy : 0.006209611892700195 nb_pixel_total : 2165 time to create 1 rle with old method : 0.002488374710083008 time for calcul the mask position with numpy : 0.005800962448120117 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001628398895263672 time for calcul the mask position with numpy : 0.005989551544189453 nb_pixel_total : 1536 time to create 1 rle with old method : 0.0017139911651611328 time for calcul the mask position with numpy : 0.005875825881958008 nb_pixel_total : 2819 time to create 1 rle with old method : 0.003283262252807617 time for calcul the mask position with numpy : 0.005839109420776367 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005125999450683594 time for calcul the mask position with numpy : 0.005865335464477539 nb_pixel_total : 9580 time to create 1 rle with old method : 0.010791301727294922 time for calcul the mask position with numpy : 0.006276130676269531 nb_pixel_total : 131 time to create 1 rle with old method : 0.00016880035400390625 time for calcul the mask position with numpy : 0.005765676498413086 nb_pixel_total : 315 time to create 1 rle with old method : 0.0003993511199951172 time for calcul the mask position with numpy : 0.005772590637207031 nb_pixel_total : 3875 time to create 1 rle with old method : 0.004270792007446289 time for calcul the mask position with numpy : 0.005830287933349609 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003528594970703125 time for calcul the mask position with numpy : 0.005945444107055664 nb_pixel_total : 589 time to create 1 rle with old method : 0.0006880760192871094 time for calcul the mask position with numpy : 0.007370471954345703 nb_pixel_total : 21 time to create 1 rle with old method : 6.580352783203125e-05 time for calcul the mask position with numpy : 0.009994983673095703 nb_pixel_total : 659 time to create 1 rle with old method : 0.0008568763732910156 time for calcul the mask position with numpy : 0.009441614151000977 nb_pixel_total : 88 time to create 1 rle with old method : 0.00012755393981933594 time for calcul the mask position with numpy : 0.00925755500793457 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0012469291687011719 time for calcul the mask position with numpy : 0.006255626678466797 nb_pixel_total : 152 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.006219148635864258 nb_pixel_total : 312 time to create 1 rle with old method : 0.00034809112548828125 time for calcul the mask position with numpy : 0.005963563919067383 nb_pixel_total : 6695 time to create 1 rle with old method : 0.008167743682861328 time for calcul the mask position with numpy : 0.0065228939056396484 nb_pixel_total : 2701 time to create 1 rle with old method : 0.0031151771545410156 time for calcul the mask position with numpy : 0.0062558650970458984 nb_pixel_total : 793 time to create 1 rle with old method : 0.0009512901306152344 time for calcul the mask position with numpy : 0.005956172943115234 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0014412403106689453 time for calcul the mask position with numpy : 0.006046772003173828 nb_pixel_total : 3064 time to create 1 rle with old method : 0.0036902427673339844 time for calcul the mask position with numpy : 0.0061855316162109375 nb_pixel_total : 134 time to create 1 rle with old method : 0.0001761913299560547 time for calcul the mask position with numpy : 0.006017208099365234 nb_pixel_total : 520 time to create 1 rle with old method : 0.0006251335144042969 time for calcul the mask position with numpy : 0.006116390228271484 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006017684936523438 time for calcul the mask position with numpy : 0.006005525588989258 nb_pixel_total : 835 time to create 1 rle with old method : 0.0009691715240478516 time for calcul the mask position with numpy : 0.005999565124511719 nb_pixel_total : 12 time to create 1 rle with old method : 0.00010204315185546875 time for calcul the mask position with numpy : 0.006105899810791016 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008282661437988281 time for calcul the mask position with numpy : 0.0066258907318115234 nb_pixel_total : 1397 time to create 1 rle with old method : 0.0017359256744384766 time for calcul the mask position with numpy : 0.006012916564941406 nb_pixel_total : 886 time to create 1 rle with old method : 0.0013709068298339844 time for calcul the mask position with numpy : 0.007119178771972656 nb_pixel_total : 3325 time to create 1 rle with old method : 0.003931760787963867 time for calcul the mask position with numpy : 0.006107330322265625 nb_pixel_total : 84 time to create 1 rle with old method : 0.00012230873107910156 time for calcul the mask position with numpy : 0.006159782409667969 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003135204315185547 time for calcul the mask position with numpy : 0.006053924560546875 nb_pixel_total : 714 time to create 1 rle with old method : 0.0008883476257324219 time for calcul the mask position with numpy : 0.0058972835540771484 nb_pixel_total : 118 time to create 1 rle with old method : 0.00018644332885742188 time for calcul the mask position with numpy : 0.006014108657836914 nb_pixel_total : 858 time to create 1 rle with old method : 0.001031637191772461 time for calcul the mask position with numpy : 0.006076812744140625 nb_pixel_total : 1377 time to create 1 rle with old method : 0.0016536712646484375 time for calcul the mask position with numpy : 0.006452798843383789 nb_pixel_total : 752 time to create 1 rle with old method : 0.0009431838989257812 time for calcul the mask position with numpy : 0.006139278411865234 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004715919494628906 time for calcul the mask position with numpy : 0.006165504455566406 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002269744873046875 time for calcul the mask position with numpy : 0.006294965744018555 nb_pixel_total : 608 time to create 1 rle with old method : 0.0007359981536865234 time for calcul the mask position with numpy : 0.0063741207122802734 nb_pixel_total : 2 time to create 1 rle with old method : 2.4557113647460938e-05 time for calcul the mask position with numpy : 0.006108283996582031 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003719329833984375 time for calcul the mask position with numpy : 0.006311655044555664 nb_pixel_total : 2750 time to create 1 rle with old method : 0.00463557243347168 time for calcul the mask position with numpy : 0.006442070007324219 nb_pixel_total : 225 time to create 1 rle with old method : 0.0004131793975830078 time for calcul the mask position with numpy : 0.006380319595336914 nb_pixel_total : 169 time to create 1 rle with old method : 0.0003001689910888672 time for calcul the mask position with numpy : 0.006474018096923828 nb_pixel_total : 1653 time to create 1 rle with old method : 0.002743244171142578 time for calcul the mask position with numpy : 0.0064275264739990234 nb_pixel_total : 20 time to create 1 rle with old method : 7.82012939453125e-05 time for calcul the mask position with numpy : 0.00656437873840332 nb_pixel_total : 253 time to create 1 rle with old method : 0.0004482269287109375 time for calcul the mask position with numpy : 0.006442546844482422 nb_pixel_total : 375 time to create 1 rle with old method : 0.0006387233734130859 time for calcul the mask position with numpy : 0.006452798843383789 nb_pixel_total : 429 time to create 1 rle with old method : 0.0007264614105224609 time for calcul the mask position with numpy : 0.006420135498046875 nb_pixel_total : 148 time to create 1 rle with old method : 0.00027179718017578125 time for calcul the mask position with numpy : 0.00651240348815918 nb_pixel_total : 424 time to create 1 rle with old method : 0.0007228851318359375 time for calcul the mask position with numpy : 0.006445884704589844 nb_pixel_total : 122 time to create 1 rle with old method : 0.00024318695068359375 time for calcul the mask position with numpy : 0.006395578384399414 nb_pixel_total : 82 time to create 1 rle with old method : 0.00012087821960449219 time for calcul the mask position with numpy : 0.006025552749633789 nb_pixel_total : 645 time to create 1 rle with old method : 0.0007596015930175781 time for calcul the mask position with numpy : 0.006197690963745117 nb_pixel_total : 575 time to create 1 rle with old method : 0.0006973743438720703 time for calcul the mask position with numpy : 0.006184816360473633 nb_pixel_total : 25 time to create 1 rle with old method : 7.867813110351562e-05 time for calcul the mask position with numpy : 0.0062694549560546875 nb_pixel_total : 267 time to create 1 rle with old method : 0.00035762786865234375 time for calcul the mask position with numpy : 0.006125450134277344 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007312297821044922 time for calcul the mask position with numpy : 0.0062143802642822266 nb_pixel_total : 40 time to create 1 rle with old method : 7.081031799316406e-05 time for calcul the mask position with numpy : 0.006285667419433594 nb_pixel_total : 10 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.0061757564544677734 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002856254577636719 time for calcul the mask position with numpy : 0.0061244964599609375 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003559589385986328 time for calcul the mask position with numpy : 0.006035327911376953 nb_pixel_total : 6829 time to create 1 rle with old method : 0.008292913436889648 time for calcul the mask position with numpy : 0.006008625030517578 nb_pixel_total : 1439 time to create 1 rle with old method : 0.0017392635345458984 time for calcul the mask position with numpy : 0.006039142608642578 nb_pixel_total : 77 time to create 1 rle with old method : 0.00011539459228515625 time for calcul the mask position with numpy : 0.005982637405395508 nb_pixel_total : 387 time to create 1 rle with old method : 0.00048661231994628906 time for calcul the mask position with numpy : 0.006002187728881836 nb_pixel_total : 447 time to create 1 rle with old method : 0.0005502700805664062 time for calcul the mask position with numpy : 0.0060024261474609375 nb_pixel_total : 741 time to create 1 rle with old method : 0.0008873939514160156 time for calcul the mask position with numpy : 0.0060291290283203125 nb_pixel_total : 577 time to create 1 rle with old method : 0.0007007122039794922 time for calcul the mask position with numpy : 0.006006956100463867 nb_pixel_total : 52 time to create 1 rle with old method : 0.000110626220703125 time for calcul the mask position with numpy : 0.0060269832611083984 nb_pixel_total : 25 time to create 1 rle with old method : 5.555152893066406e-05 time for calcul the mask position with numpy : 0.006412029266357422 nb_pixel_total : 745 time to create 1 rle with old method : 0.0008966922760009766 time for calcul the mask position with numpy : 0.0060389041900634766 nb_pixel_total : 802 time to create 1 rle with old method : 0.0010089874267578125 time for calcul the mask position with numpy : 0.005997180938720703 nb_pixel_total : 158 time to create 1 rle with old method : 0.00020122528076171875 time for calcul the mask position with numpy : 0.005959987640380859 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005340576171875 time for calcul the mask position with numpy : 0.005993843078613281 nb_pixel_total : 7 time to create 1 rle with old method : 3.0994415283203125e-05 time for calcul the mask position with numpy : 0.006053924560546875 nb_pixel_total : 143 time to create 1 rle with old method : 0.00019288063049316406 time for calcul the mask position with numpy : 0.006020545959472656 nb_pixel_total : 1209 time to create 1 rle with old method : 0.0014197826385498047 time for calcul the mask position with numpy : 0.0060007572174072266 nb_pixel_total : 122 time to create 1 rle with old method : 0.00023365020751953125 time for calcul the mask position with numpy : 0.006072521209716797 nb_pixel_total : 1191 time to create 1 rle with old method : 0.001506805419921875 time for calcul the mask position with numpy : 0.0059871673583984375 nb_pixel_total : 772 time to create 1 rle with old method : 0.0009562969207763672 time for calcul the mask position with numpy : 0.005994081497192383 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003533363342285156 time for calcul the mask position with numpy : 0.010472774505615234 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003459453582763672 time for calcul the mask position with numpy : 0.006063222885131836 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005061626434326172 time for calcul the mask position with numpy : 0.005968570709228516 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002040863037109375 time for calcul the mask position with numpy : 0.005963325500488281 nb_pixel_total : 180 time to create 1 rle with old method : 0.00023436546325683594 time for calcul the mask position with numpy : 0.00600433349609375 nb_pixel_total : 449 time to create 1 rle with old method : 0.0005583763122558594 time for calcul the mask position with numpy : 0.006133317947387695 nb_pixel_total : 126 time to create 1 rle with old method : 0.00016689300537109375 time for calcul the mask position with numpy : 0.0060427188873291016 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004429817199707031 time for calcul the mask position with numpy : 0.006043195724487305 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005164146423339844 time for calcul the mask position with numpy : 0.0061283111572265625 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002849102020263672 time for calcul the mask position with numpy : 0.006201982498168945 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001609325408935547 time for calcul the mask position with numpy : 0.006027698516845703 nb_pixel_total : 275 time to create 1 rle with old method : 0.00033926963806152344 time for calcul the mask position with numpy : 0.006060123443603516 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002741813659667969 time for calcul the mask position with numpy : 0.006044864654541016 nb_pixel_total : 125 time to create 1 rle with old method : 0.00017762184143066406 time for calcul the mask position with numpy : 0.005951642990112305 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006899833679199219 time for calcul the mask position with numpy : 0.006029367446899414 nb_pixel_total : 352 time to create 1 rle with old method : 0.000438690185546875 time for calcul the mask position with numpy : 0.005990266799926758 nb_pixel_total : 3807 time to create 1 rle with old method : 0.004477977752685547 time for calcul the mask position with numpy : 0.005821704864501953 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0016193389892578125 time for calcul the mask position with numpy : 0.006162166595458984 nb_pixel_total : 136 time to create 1 rle with old method : 0.00018262863159179688 time for calcul the mask position with numpy : 0.005971670150756836 nb_pixel_total : 13 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.005925893783569336 nb_pixel_total : 227 time to create 1 rle with old method : 0.00028133392333984375 time for calcul the mask position with numpy : 0.0058629512786865234 nb_pixel_total : 249 time to create 1 rle with old method : 0.00030040740966796875 time for calcul the mask position with numpy : 0.006009101867675781 nb_pixel_total : 901 time to create 1 rle with old method : 0.0011184215545654297 time for calcul the mask position with numpy : 0.0059969425201416016 nb_pixel_total : 2339 time to create 1 rle with old method : 0.0026807785034179688 time for calcul the mask position with numpy : 0.007550239562988281 nb_pixel_total : 4 time to create 1 rle with old method : 3.552436828613281e-05 time for calcul the mask position with numpy : 0.005955696105957031 nb_pixel_total : 347 time to create 1 rle with old method : 0.00043320655822753906 time for calcul the mask position with numpy : 0.005945444107055664 nb_pixel_total : 25 time to create 1 rle with old method : 9.441375732421875e-05 time for calcul the mask position with numpy : 0.0059511661529541016 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005195140838623047 time for calcul the mask position with numpy : 0.005941867828369141 nb_pixel_total : 710 time to create 1 rle with old method : 0.0009198188781738281 time for calcul the mask position with numpy : 0.0059244632720947266 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0012309551239013672 time for calcul the mask position with numpy : 0.00587916374206543 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002894401550292969 time for calcul the mask position with numpy : 0.005952119827270508 nb_pixel_total : 148 time to create 1 rle with old method : 0.00019931793212890625 time for calcul the mask position with numpy : 0.006017923355102539 nb_pixel_total : 66 time to create 1 rle with old method : 0.00010132789611816406 time for calcul the mask position with numpy : 0.006023883819580078 nb_pixel_total : 33 time to create 1 rle with old method : 8.320808410644531e-05 time for calcul the mask position with numpy : 0.006020307540893555 nb_pixel_total : 177 time to create 1 rle with old method : 0.00022721290588378906 create new chi : 1.2263984680175781 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016796588897705078 batch 1 Loaded 139 chid ids of type : 4230 Number RLEs to save : 11727 TO DO : save crop sub photo not yet done ! save time : 11.036692380905151 nb_obj : 143 nb_hashtags : 8 time to prepare the origin masks : 1.5972399711608887 time for calcul the mask position with numpy : 0.028263330459594727 nb_pixel_total : 1647837 time to create 1 rle with new method : 0.05488157272338867 time for calcul the mask position with numpy : 0.007681846618652344 nb_pixel_total : 1372 time to create 1 rle with old method : 0.0031697750091552734 time for calcul the mask position with numpy : 0.009680509567260742 nb_pixel_total : 3014 time to create 1 rle with old method : 0.0065042972564697266 time for calcul the mask position with numpy : 0.009006977081298828 nb_pixel_total : 519 time to create 1 rle with old method : 0.0006480216979980469 time for calcul the mask position with numpy : 0.0066449642181396484 nb_pixel_total : 446 time to create 1 rle with old method : 0.0005629062652587891 time for calcul the mask position with numpy : 0.01183176040649414 nb_pixel_total : 56553 time to create 1 rle with old method : 0.07724332809448242 time for calcul the mask position with numpy : 0.007096052169799805 nb_pixel_total : 82 time to create 1 rle with old method : 0.00019288063049316406 time for calcul the mask position with numpy : 0.0070953369140625 nb_pixel_total : 1761 time to create 1 rle with old method : 0.0030851364135742188 time for calcul the mask position with numpy : 0.008014440536499023 nb_pixel_total : 65 time to create 1 rle with old method : 0.0001735687255859375 time for calcul the mask position with numpy : 0.007394313812255859 nb_pixel_total : 330 time to create 1 rle with old method : 0.0005555152893066406 time for calcul the mask position with numpy : 0.0070514678955078125 nb_pixel_total : 741 time to create 1 rle with old method : 0.0013048648834228516 time for calcul the mask position with numpy : 0.006740570068359375 nb_pixel_total : 20 time to create 1 rle with old method : 4.57763671875e-05 time for calcul the mask position with numpy : 0.006593465805053711 nb_pixel_total : 30 time to create 1 rle with old method : 5.412101745605469e-05 time for calcul the mask position with numpy : 0.006762981414794922 nb_pixel_total : 34 time to create 1 rle with old method : 6.079673767089844e-05 time for calcul the mask position with numpy : 0.006752967834472656 nb_pixel_total : 164 time to create 1 rle with old method : 0.00023937225341796875 time for calcul the mask position with numpy : 0.0069658756256103516 nb_pixel_total : 7038 time to create 1 rle with old method : 0.008634567260742188 time for calcul the mask position with numpy : 0.0065419673919677734 nb_pixel_total : 177 time to create 1 rle with old method : 0.00033855438232421875 time for calcul the mask position with numpy : 0.0063173770904541016 nb_pixel_total : 6779 time to create 1 rle with old method : 0.007947206497192383 time for calcul the mask position with numpy : 0.0075626373291015625 nb_pixel_total : 370 time to create 1 rle with old method : 0.0007607936859130859 time for calcul the mask position with numpy : 0.007701873779296875 nb_pixel_total : 883 time to create 1 rle with old method : 0.0010514259338378906 time for calcul the mask position with numpy : 0.0062503814697265625 nb_pixel_total : 239 time to create 1 rle with old method : 0.00029468536376953125 time for calcul the mask position with numpy : 0.0062792301177978516 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002512931823730469 time for calcul the mask position with numpy : 0.006243705749511719 nb_pixel_total : 2069 time to create 1 rle with old method : 0.002506732940673828 time for calcul the mask position with numpy : 0.0062198638916015625 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0021762847900390625 time for calcul the mask position with numpy : 0.006329059600830078 nb_pixel_total : 986 time to create 1 rle with old method : 0.0011932849884033203 time for calcul the mask position with numpy : 0.008249998092651367 nb_pixel_total : 3 time to create 1 rle with old method : 3.147125244140625e-05 time for calcul the mask position with numpy : 0.0065572261810302734 nb_pixel_total : 63 time to create 1 rle with old method : 0.00012922286987304688 time for calcul the mask position with numpy : 0.0065729618072509766 nb_pixel_total : 3017 time to create 1 rle with old method : 0.0037467479705810547 time for calcul the mask position with numpy : 0.006565093994140625 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006432533264160156 time for calcul the mask position with numpy : 0.006522655487060547 nb_pixel_total : 9873 time to create 1 rle with old method : 0.011658668518066406 time for calcul the mask position with numpy : 0.006754159927368164 nb_pixel_total : 144 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.006574153900146484 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004456043243408203 time for calcul the mask position with numpy : 0.006619453430175781 nb_pixel_total : 571 time to create 1 rle with old method : 0.0006959438323974609 time for calcul the mask position with numpy : 0.006555318832397461 nb_pixel_total : 54 time to create 1 rle with old method : 0.00011563301086425781 time for calcul the mask position with numpy : 0.006765604019165039 nb_pixel_total : 32 time to create 1 rle with old method : 8.630752563476562e-05 time for calcul the mask position with numpy : 0.006710529327392578 nb_pixel_total : 666 time to create 1 rle with old method : 0.0009152889251708984 time for calcul the mask position with numpy : 0.0066606998443603516 nb_pixel_total : 137 time to create 1 rle with old method : 0.00019884109497070312 time for calcul the mask position with numpy : 0.007349491119384766 nb_pixel_total : 153215 time to create 1 rle with new method : 0.03999829292297363 time for calcul the mask position with numpy : 0.006242513656616211 nb_pixel_total : 1091 time to create 1 rle with old method : 0.0012979507446289062 time for calcul the mask position with numpy : 0.006397247314453125 nb_pixel_total : 4270 time to create 1 rle with old method : 0.005309343338012695 time for calcul the mask position with numpy : 0.006435871124267578 nb_pixel_total : 883 time to create 1 rle with old method : 0.0011096000671386719 time for calcul the mask position with numpy : 0.006403207778930664 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005888938903808594 time for calcul the mask position with numpy : 0.006532192230224609 nb_pixel_total : 1755 time to create 1 rle with old method : 0.0021638870239257812 time for calcul the mask position with numpy : 0.006623029708862305 nb_pixel_total : 966 time to create 1 rle with old method : 0.0013201236724853516 time for calcul the mask position with numpy : 0.0065805912017822266 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006866455078125 time for calcul the mask position with numpy : 0.006516218185424805 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006346702575683594 time for calcul the mask position with numpy : 0.0066983699798583984 nb_pixel_total : 3286 time to create 1 rle with old method : 0.004030704498291016 time for calcul the mask position with numpy : 0.006665229797363281 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006275177001953125 time for calcul the mask position with numpy : 0.006447553634643555 nb_pixel_total : 14 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.0063588619232177734 nb_pixel_total : 1177 time to create 1 rle with old method : 0.0014450550079345703 time for calcul the mask position with numpy : 0.006319999694824219 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005288124084472656 time for calcul the mask position with numpy : 0.006170988082885742 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005319118499755859 time for calcul the mask position with numpy : 0.0062024593353271484 nb_pixel_total : 837 time to create 1 rle with old method : 0.0010173320770263672 time for calcul the mask position with numpy : 0.006309032440185547 nb_pixel_total : 7 time to create 1 rle with old method : 2.7894973754882812e-05 time for calcul the mask position with numpy : 0.006177425384521484 nb_pixel_total : 556 time to create 1 rle with old method : 0.000690460205078125 time for calcul the mask position with numpy : 0.006283283233642578 nb_pixel_total : 4232 time to create 1 rle with old method : 0.005195140838623047 time for calcul the mask position with numpy : 0.00626826286315918 nb_pixel_total : 4067 time to create 1 rle with old method : 0.004985809326171875 time for calcul the mask position with numpy : 0.006661891937255859 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0014176368713378906 time for calcul the mask position with numpy : 0.010564565658569336 nb_pixel_total : 3180 time to create 1 rle with old method : 0.003846406936645508 time for calcul the mask position with numpy : 0.010549068450927734 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005052089691162109 time for calcul the mask position with numpy : 0.01017618179321289 nb_pixel_total : 832 time to create 1 rle with old method : 0.0010383129119873047 time for calcul the mask position with numpy : 0.010306119918823242 nb_pixel_total : 2253 time to create 1 rle with old method : 0.002696514129638672 time for calcul the mask position with numpy : 0.010011911392211914 nb_pixel_total : 878 time to create 1 rle with old method : 0.0010979175567626953 time for calcul the mask position with numpy : 0.010117292404174805 nb_pixel_total : 141 time to create 1 rle with old method : 0.00018548965454101562 time for calcul the mask position with numpy : 0.010125875473022461 nb_pixel_total : 569 time to create 1 rle with old method : 0.00069427490234375 time for calcul the mask position with numpy : 0.010089397430419922 nb_pixel_total : 248 time to create 1 rle with old method : 0.00032210350036621094 time for calcul the mask position with numpy : 0.010131359100341797 nb_pixel_total : 9 time to create 1 rle with old method : 4.506111145019531e-05 time for calcul the mask position with numpy : 0.010103225708007812 nb_pixel_total : 800 time to create 1 rle with old method : 0.0009779930114746094 time for calcul the mask position with numpy : 0.010330915451049805 nb_pixel_total : 323 time to create 1 rle with old method : 0.00046062469482421875 time for calcul the mask position with numpy : 0.010450601577758789 nb_pixel_total : 175 time to create 1 rle with old method : 0.000240325927734375 time for calcul the mask position with numpy : 0.010343074798583984 nb_pixel_total : 386 time to create 1 rle with old method : 0.0004782676696777344 time for calcul the mask position with numpy : 0.006943464279174805 nb_pixel_total : 1467 time to create 1 rle with old method : 0.0017459392547607422 time for calcul the mask position with numpy : 0.006444215774536133 nb_pixel_total : 387 time to create 1 rle with old method : 0.00048661231994628906 time for calcul the mask position with numpy : 0.0061168670654296875 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003020763397216797 time for calcul the mask position with numpy : 0.0062067508697509766 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005421638488769531 time for calcul the mask position with numpy : 0.00639653205871582 nb_pixel_total : 1 time to create 1 rle with old method : 2.2649765014648438e-05 time for calcul the mask position with numpy : 0.00629115104675293 nb_pixel_total : 133 time to create 1 rle with old method : 0.00018739700317382812 time for calcul the mask position with numpy : 0.0062389373779296875 nb_pixel_total : 322 time to create 1 rle with old method : 0.000400543212890625 time for calcul the mask position with numpy : 0.006131887435913086 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004432201385498047 time for calcul the mask position with numpy : 0.006616353988647461 nb_pixel_total : 106470 time to create 1 rle with old method : 0.12335777282714844 time for calcul the mask position with numpy : 0.006711006164550781 nb_pixel_total : 188 time to create 1 rle with old method : 0.00025534629821777344 time for calcul the mask position with numpy : 0.006098747253417969 nb_pixel_total : 119 time to create 1 rle with old method : 0.00017452239990234375 time for calcul the mask position with numpy : 0.006154775619506836 nb_pixel_total : 78 time to create 1 rle with old method : 0.00011682510375976562 time for calcul the mask position with numpy : 0.006610870361328125 nb_pixel_total : 636 time to create 1 rle with old method : 0.0012938976287841797 time for calcul the mask position with numpy : 0.008467435836791992 nb_pixel_total : 624 time to create 1 rle with old method : 0.0008006095886230469 time for calcul the mask position with numpy : 0.006381034851074219 nb_pixel_total : 206 time to create 1 rle with old method : 0.0003235340118408203 time for calcul the mask position with numpy : 0.006364107131958008 nb_pixel_total : 280 time to create 1 rle with old method : 0.00035691261291503906 time for calcul the mask position with numpy : 0.0063321590423583984 nb_pixel_total : 73 time to create 1 rle with old method : 0.00011491775512695312 time for calcul the mask position with numpy : 0.006722211837768555 nb_pixel_total : 619 time to create 1 rle with old method : 0.0007474422454833984 time for calcul the mask position with numpy : 0.0064241886138916016 nb_pixel_total : 987 time to create 1 rle with old method : 0.0011973381042480469 time for calcul the mask position with numpy : 0.006309986114501953 nb_pixel_total : 78 time to create 1 rle with old method : 0.00017070770263671875 time for calcul the mask position with numpy : 0.006642341613769531 nb_pixel_total : 300 time to create 1 rle with old method : 0.0005481243133544922 time for calcul the mask position with numpy : 0.006656646728515625 nb_pixel_total : 300 time to create 1 rle with old method : 0.0005373954772949219 time for calcul the mask position with numpy : 0.006609916687011719 nb_pixel_total : 61 time to create 1 rle with old method : 0.00018858909606933594 time for calcul the mask position with numpy : 0.006595611572265625 nb_pixel_total : 60 time to create 1 rle with old method : 0.0001316070556640625 time for calcul the mask position with numpy : 0.006520509719848633 nb_pixel_total : 1108 time to create 1 rle with old method : 0.001913309097290039 time for calcul the mask position with numpy : 0.00649571418762207 nb_pixel_total : 7 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.006428241729736328 nb_pixel_total : 296 time to create 1 rle with old method : 0.0005259513854980469 time for calcul the mask position with numpy : 0.006414651870727539 nb_pixel_total : 163 time to create 1 rle with old method : 0.00030112266540527344 time for calcul the mask position with numpy : 0.006466865539550781 nb_pixel_total : 38 time to create 1 rle with old method : 0.00010395050048828125 time for calcul the mask position with numpy : 0.006453990936279297 nb_pixel_total : 437 time to create 1 rle with old method : 0.0007786750793457031 time for calcul the mask position with numpy : 0.0063571929931640625 nb_pixel_total : 406 time to create 1 rle with old method : 0.0004999637603759766 time for calcul the mask position with numpy : 0.005930185317993164 nb_pixel_total : 126 time to create 1 rle with old method : 0.00016760826110839844 time for calcul the mask position with numpy : 0.005895137786865234 nb_pixel_total : 12 time to create 1 rle with old method : 3.719329833984375e-05 time for calcul the mask position with numpy : 0.0059604644775390625 nb_pixel_total : 1042 time to create 1 rle with old method : 0.0012292861938476562 time for calcul the mask position with numpy : 0.005944967269897461 nb_pixel_total : 17 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.0060672760009765625 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002434253692626953 time for calcul the mask position with numpy : 0.0059621334075927734 nb_pixel_total : 1166 time to create 1 rle with old method : 0.0014073848724365234 time for calcul the mask position with numpy : 0.00599217414855957 nb_pixel_total : 522 time to create 1 rle with old method : 0.0006439685821533203 time for calcul the mask position with numpy : 0.0059356689453125 nb_pixel_total : 286 time to create 1 rle with old method : 0.00034999847412109375 time for calcul the mask position with numpy : 0.006174564361572266 nb_pixel_total : 151 time to create 1 rle with old method : 0.00019359588623046875 time for calcul the mask position with numpy : 0.005846977233886719 nb_pixel_total : 506 time to create 1 rle with old method : 0.0006265640258789062 time for calcul the mask position with numpy : 0.006103992462158203 nb_pixel_total : 170 time to create 1 rle with old method : 0.0001976490020751953 time for calcul the mask position with numpy : 0.005867481231689453 nb_pixel_total : 1580 time to create 1 rle with old method : 0.001890420913696289 time for calcul the mask position with numpy : 0.005916595458984375 nb_pixel_total : 99 time to create 1 rle with old method : 0.00014352798461914062 time for calcul the mask position with numpy : 0.005936622619628906 nb_pixel_total : 757 time to create 1 rle with old method : 0.0008895397186279297 time for calcul the mask position with numpy : 0.005849599838256836 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004680156707763672 time for calcul the mask position with numpy : 0.006016731262207031 nb_pixel_total : 939 time to create 1 rle with old method : 0.0012192726135253906 time for calcul the mask position with numpy : 0.0061953067779541016 nb_pixel_total : 401 time to create 1 rle with old method : 0.0004961490631103516 time for calcul the mask position with numpy : 0.006066799163818359 nb_pixel_total : 48 time to create 1 rle with old method : 8.296966552734375e-05 time for calcul the mask position with numpy : 0.006079196929931641 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002589225769042969 time for calcul the mask position with numpy : 0.005900859832763672 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003781318664550781 time for calcul the mask position with numpy : 0.0068247318267822266 nb_pixel_total : 89 time to create 1 rle with old method : 0.00017547607421875 time for calcul the mask position with numpy : 0.0060956478118896484 nb_pixel_total : 725 time to create 1 rle with old method : 0.0008487701416015625 time for calcul the mask position with numpy : 0.006236076354980469 nb_pixel_total : 4 time to create 1 rle with old method : 3.504753112792969e-05 time for calcul the mask position with numpy : 0.005907535552978516 nb_pixel_total : 283 time to create 1 rle with old method : 0.00035858154296875 time for calcul the mask position with numpy : 0.005833864212036133 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007507801055908203 time for calcul the mask position with numpy : 0.0058710575103759766 nb_pixel_total : 16 time to create 1 rle with old method : 4.744529724121094e-05 time for calcul the mask position with numpy : 0.006820201873779297 nb_pixel_total : 988 time to create 1 rle with old method : 0.0011990070343017578 time for calcul the mask position with numpy : 0.006005048751831055 nb_pixel_total : 69 time to create 1 rle with old method : 0.00012946128845214844 time for calcul the mask position with numpy : 0.005921602249145508 nb_pixel_total : 118 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.005863666534423828 nb_pixel_total : 278 time to create 1 rle with old method : 0.00040149688720703125 time for calcul the mask position with numpy : 0.005952358245849609 nb_pixel_total : 494 time to create 1 rle with old method : 0.0005810260772705078 time for calcul the mask position with numpy : 0.00586247444152832 nb_pixel_total : 373 time to create 1 rle with old method : 0.00046181678771972656 time for calcul the mask position with numpy : 0.005837917327880859 nb_pixel_total : 13 time to create 1 rle with old method : 5.054473876953125e-05 time for calcul the mask position with numpy : 0.0058193206787109375 nb_pixel_total : 1491 time to create 1 rle with old method : 0.0017521381378173828 time for calcul the mask position with numpy : 0.005924701690673828 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005879402160644531 time for calcul the mask position with numpy : 0.008156538009643555 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004177093505859375 time for calcul the mask position with numpy : 0.00821375846862793 nb_pixel_total : 400 time to create 1 rle with old method : 0.00045228004455566406 time for calcul the mask position with numpy : 0.008219003677368164 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0013201236724853516 time for calcul the mask position with numpy : 0.008287906646728516 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002963542938232422 time for calcul the mask position with numpy : 0.008256912231445312 nb_pixel_total : 193 time to create 1 rle with old method : 0.00024008750915527344 time for calcul the mask position with numpy : 0.008322715759277344 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002448558807373047 time for calcul the mask position with numpy : 0.008296489715576172 nb_pixel_total : 80 time to create 1 rle with old method : 9.417533874511719e-05 create new chi : 1.47119140625 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001726388931274414 batch 1 Loaded 144 chid ids of type : 4230 Number RLEs to save : 12852 TO DO : save crop sub photo not yet done ! save time : 9.017421007156372 map_output_result : {1334935917: (0.0, 'Should be the crop_list due to order', 0.0), 1334935866: (0.0, 'Should be the crop_list due to order', 0.0), 1334935863: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1334935917, 1334935866, 1334935863] Looping around the photos to save general results len do output : 3 /1334935917.Didn't retrieve data . /1334935866.Didn't retrieve data . /1334935863.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935917', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935866', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935863', None, None, None, None, None, '2557296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.052597999572753906 save_final save missing photos in datou_result : time spend for datou_step_exec : 31.395929098129272 time spend to save output : 0.052916765213012695 total time spend for step 4 : 31.448845863342285 step5:crop_condition Thu Feb 6 05:21:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 438 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 147 About to insert : list_path_to_insert length 147 new photo from crops ! About to upload 147 photos upload in portfolio : 4869462 init cache_photo without model_param we have 147 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738815699_2189983 we have uploaded 147 photos in the portfolio 4869462 time of upload the photos Elapsed time : 35.6085319519043 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 78 About to insert : list_path_to_insert length 78 new photo from crops ! About to upload 78 photos upload in portfolio : 4869462 init cache_photo without model_param we have 78 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738815736_2189983 we have uploaded 78 photos in the portfolio 4869462 time of upload the photos Elapsed time : 20.248945713043213 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 4869462 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738815756_2189983 we have uploaded 7 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.8562731742858887 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738815758_2189983 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.256598711013794 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 4869462 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738815761_2189983 we have uploaded 47 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.621667861938477 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738815773_2189983 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5925986766815186 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1334935917, 1334935866, 1334935863] Looping around the photos to save general results len do output : 289 /1335123210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335123568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935917', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935866', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935863', None, None, None, None, None, '2557296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 870 time used for this insertion : 0.9288403987884521 save_final save missing photos in datou_result : time spend for datou_step_exec : 79.26710987091064 time spend to save output : 0.9364650249481201 total time spend for step 5 : 80.20357489585876 step6:thcl Thu Feb 6 05:22:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.022272825241088867 time to convert the images to numpy array : 0.08307623863220215 time to import caffe and check if the image exist : 0.017401456832885742 time to convert the images to numpy array : 0.10577988624572754 time to import caffe and check if the image exist : 0.028740882873535156 time to convert the images to numpy array : 0.09723544120788574 time to import caffe and check if the image exist : 0.01852130889892578 time to convert the images to numpy array : 0.10993289947509766 time to import caffe and check if the image exist : 0.016018390655517578 time to convert the images to numpy array : 0.11355328559875488 time to import caffe and check if the image exist : 0.021749496459960938 time to convert the images to numpy array : 0.10797429084777832 time to import caffe and check if the image exist : 0.017594099044799805 time to convert the images to numpy array : 0.11636853218078613 time to import caffe and check if the image exist : 0.03021693229675293 time to convert the images to numpy array : 0.10480380058288574 time to import caffe and check if the image exist : 0.03013896942138672 time to convert the images to numpy array : 0.10558700561523438 time to import caffe and check if the image exist : 0.02407670021057129 time to convert the images to numpy array : 0.11216115951538086 total time to convert the images to numpy array : 0.4301776885986328 list photo_ids error: [] list photo_ids correct : [1335123328, 1335123329, 1335123330, 1335123332, 1335123333, 1335123334, 1335123335, 1335123336, 1335123337, 1335123338, 1335123339, 1335123340, 1335123341, 1335123342, 1335123343, 1335123344, 1335123345, 1335123346, 1335123347, 1335123348, 1335123349, 1335123350, 1335123351, 1335123352, 1335123353, 1335123354, 1335123355, 1335123356, 1335123357, 1335123269, 1335123270, 1335123271, 1335123272, 1335123273, 1335123274, 1335123275, 1335123276, 1335123277, 1335123278, 1335123279, 1335123280, 1335123281, 1335123282, 1335123283, 1335123284, 1335123285, 1335123286, 1335123287, 1335123288, 1335123289, 1335123290, 1335123291, 1335123292, 1335123293, 1335123294, 1335123295, 1335123296, 1335123297, 1335123508, 1335123509, 1335123510, 1335123511, 1335123512, 1335123513, 1335123514, 1335123515, 1335123516, 1335123521, 1335123522, 1335123523, 1335123524, 1335123525, 1335123526, 1335123527, 1335123528, 1335123529, 1335123530, 1335123531, 1335123532, 1335123533, 1335123534, 1335123535, 1335123536, 1335123537, 1335123538, 1335123539, 1335123540, 1335123210, 1335123211, 1335123212, 1335123213, 1335123214, 1335123215, 1335123216, 1335123217, 1335123218, 1335123219, 1335123220, 1335123221, 1335123222, 1335123223, 1335123224, 1335123225, 1335123226, 1335123227, 1335123228, 1335123229, 1335123230, 1335123231, 1335123232, 1335123233, 1335123234, 1335123235, 1335123236, 1335123237, 1335123238, 1335123541, 1335123542, 1335123543, 1335123544, 1335123545, 1335123546, 1335123547, 1335123548, 1335123549, 1335123550, 1335123551, 1335123552, 1335123553, 1335123554, 1335123555, 1335123556, 1335123557, 1335123558, 1335123559, 1335123560, 1335123561, 1335123562, 1335123563, 1335123564, 1335123565, 1335123566, 1335123567, 1335123568, 1335123239, 1335123240, 1335123241, 1335123242, 1335123243, 1335123244, 1335123245, 1335123246, 1335123247, 1335123248, 1335123249, 1335123250, 1335123251, 1335123252, 1335123253, 1335123254, 1335123256, 1335123257, 1335123258, 1335123259, 1335123260, 1335123261, 1335123262, 1335123263, 1335123264, 1335123265, 1335123266, 1335123267, 1335123268, 1335123358, 1335123359, 1335123420, 1335123421, 1335123422, 1335123423, 1335123424, 1335123425, 1335123426, 1335123427, 1335123428, 1335123429, 1335123430, 1335123431, 1335123433, 1335123434, 1335123435, 1335123436, 1335123437, 1335123438, 1335123439, 1335123440, 1335123441, 1335123442, 1335123443, 1335123444, 1335123445, 1335123446, 1335123447, 1335123298, 1335123299, 1335123300, 1335123301, 1335123302, 1335123303, 1335123304, 1335123305, 1335123306, 1335123307, 1335123308, 1335123309, 1335123310, 1335123311, 1335123312, 1335123313, 1335123314, 1335123315, 1335123316, 1335123317, 1335123318, 1335123319, 1335123320, 1335123321, 1335123322, 1335123323, 1335123324, 1335123325, 1335123327, 1335123477, 1335123478, 1335123479, 1335123480, 1335123481, 1335123482, 1335123483, 1335123484, 1335123485, 1335123486, 1335123487, 1335123488, 1335123489, 1335123490, 1335123491, 1335123492, 1335123493, 1335123494, 1335123495, 1335123496, 1335123497, 1335123498, 1335123501, 1335123502, 1335123503, 1335123504, 1335123505, 1335123506, 1335123507, 1335123448, 1335123449, 1335123450, 1335123451, 1335123452, 1335123453, 1335123454, 1335123455, 1335123456, 1335123457, 1335123458, 1335123459, 1335123460, 1335123461, 1335123462, 1335123463, 1335123464, 1335123465, 1335123466, 1335123467, 1335123468, 1335123469, 1335123470, 1335123471, 1335123472, 1335123473, 1335123474, 1335123475, 1335123476] number of photos to traite : 289 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5485 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5266 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.4540045261383057 time used to do the prediction : 1.2202284336090088 save descriptor for thcl : 3237 time to traite the descriptors : 1.807204246520996 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1335123328 To insert : 1335123329 To insert : 1335123330 To insert : 1335123332 To insert : 1335123333 To insert : 1335123334 To insert : 1335123335 To insert : 1335123336 To insert : 1335123337 To insert : 1335123338 To insert : 1335123339 To insert : 1335123340 To insert : 1335123341 To insert : 1335123342 To insert : 1335123343 To insert : 1335123344 To insert : 1335123345 To insert : 1335123346 To insert : 1335123347 To insert : 1335123348 To insert : 1335123349 To insert : 1335123350 To insert : 1335123351 To insert : 1335123352 To insert : 1335123353 To insert : 1335123354 To insert : 1335123355 To insert : 1335123356 To insert : 1335123357 To insert : 1335123269 To insert : 1335123270 To insert : 1335123271 To insert : 1335123272 To insert : 1335123273 To insert : 1335123274 To insert : 1335123275 To insert : 1335123276 To insert : 1335123277 To insert : 1335123278 To insert : 1335123279 To insert : 1335123280 To insert : 1335123281 To insert : 1335123282 To insert : 1335123283 To insert : 1335123284 To insert : 1335123285 To insert : 1335123286 To insert : 1335123287 To insert : 1335123288 To insert : 1335123289 To insert : 1335123290 To insert : 1335123291 To insert : 1335123292 To insert : 1335123293 To insert : 1335123294 To insert : 1335123295 To insert : 1335123296 To insert : 1335123297 To insert : 1335123508 To insert : 1335123509 To insert : 1335123510 To insert : 1335123511 To insert : 1335123512 To insert : 1335123513 To insert : 1335123514 To insert : 1335123515 To insert : 1335123516 To insert : 1335123521 To insert : 1335123522 To insert : 1335123523 To insert : 1335123524 To insert : 1335123525 To insert : 1335123526 To insert : 1335123527 To insert : 1335123528 To insert : 1335123529 To insert : 1335123530 To insert : 1335123531 To insert : 1335123532 To insert : 1335123533 To insert : 1335123534 To insert : 1335123535 To insert : 1335123536 To insert : 1335123537 To insert : 1335123538 To insert : 1335123539 To insert : 1335123540 To insert : 1335123210 To insert : 1335123211 To insert : 1335123212 To insert : 1335123213 To insert : 1335123214 To insert : 1335123215 To insert : 1335123216 To insert : 1335123217 To insert : 1335123218 To insert : 1335123219 To insert : 1335123220 To insert : 1335123221 To insert : 1335123222 To insert : 1335123223 To insert : 1335123224 To insert : 1335123225 To insert : 1335123226 To insert : 1335123227 To insert : 1335123228 To insert : 1335123229 To insert : 1335123230 To insert : 1335123231 To insert : 1335123232 To insert : 1335123233 To insert : 1335123234 To insert : 1335123235 To insert : 1335123236 To insert : 1335123237 To insert : 1335123238 To insert : 1335123541 To insert : 1335123542 To insert : 1335123543 To insert : 1335123544 To insert : 1335123545 To insert : 1335123546 To insert : 1335123547 To insert : 1335123548 To insert : 1335123549 To insert : 1335123550 To insert : 1335123551 To insert : 1335123552 To insert : 1335123553 To insert : 1335123554 To insert : 1335123555 To insert : 1335123556 To insert : 1335123557 To insert : 1335123558 To insert : 1335123559 To insert : 1335123560 To insert : 1335123561 To insert : 1335123562 To insert : 1335123563 To insert : 1335123564 To insert : 1335123565 To insert : 1335123566 To insert : 1335123567 To insert : 1335123568 To insert : 1335123239 To insert : 1335123240 To insert : 1335123241 To insert : 1335123242 To insert : 1335123243 To insert : 1335123244 To insert : 1335123245 To insert : 1335123246 To insert : 1335123247 To insert : 1335123248 To insert : 1335123249 To insert : 1335123250 To insert : 1335123251 To insert : 1335123252 To insert : 1335123253 To insert : 1335123254 To insert : 1335123256 To insert : 1335123257 To insert : 1335123258 To insert : 1335123259 To insert : 1335123260 To insert : 1335123261 To insert : 1335123262 To insert : 1335123263 To insert : 1335123264 To insert : 1335123265 To insert : 1335123266 To insert : 1335123267 To insert : 1335123268 To insert : 1335123358 To insert : 1335123359 To insert : 1335123420 To insert : 1335123421 To insert : 1335123422 To insert : 1335123423 To insert : 1335123424 To insert : 1335123425 To insert : 1335123426 To insert : 1335123427 To insert : 1335123428 To insert : 1335123429 To insert : 1335123430 To insert : 1335123431 To insert : 1335123433 To insert : 1335123434 To insert : 1335123435 To insert : 1335123436 To insert : 1335123437 To insert : 1335123438 To insert : 1335123439 To insert : 1335123440 To insert : 1335123441 To insert : 1335123442 To insert : 1335123443 To insert : 1335123444 To insert : 1335123445 To insert : 1335123446 To insert : 1335123447 To insert : 1335123298 To insert : 1335123299 To insert : 1335123300 To insert : 1335123301 To insert : 1335123302 To insert : 1335123303 To insert : 1335123304 To insert : 1335123305 To insert : 1335123306 To insert : 1335123307 To insert : 1335123308 To insert : 1335123309 To insert : 1335123310 To insert : 1335123311 To insert : 1335123312 To insert : 1335123313 To insert : 1335123314 To insert : 1335123315 To insert : 1335123316 To insert : 1335123317 To insert : 1335123318 To insert : 1335123319 To insert : 1335123320 To insert : 1335123321 To insert : 1335123322 To insert : 1335123323 To insert : 1335123324 To insert : 1335123325 To insert : 1335123327 To insert : 1335123477 To insert : 1335123478 To insert : 1335123479 To insert : 1335123480 To insert : 1335123481 To insert : 1335123482 To insert : 1335123483 To insert : 1335123484 To insert : 1335123485 To insert : 1335123486 To insert : 1335123487 To insert : 1335123488 To insert : 1335123489 To insert : 1335123490 To insert : 1335123491 To insert : 1335123492 To insert : 1335123493 To insert : 1335123494 To insert : 1335123495 To insert : 1335123496 To insert : 1335123497 To insert : 1335123498 To insert : 1335123501 To insert : 1335123502 To insert : 1335123503 To insert : 1335123504 To insert : 1335123505 To insert : 1335123506 To insert : 1335123507 To insert : 1335123448 To insert : 1335123449 To insert : 1335123450 To insert : 1335123451 To insert : 1335123452 To insert : 1335123453 To insert : 1335123454 To insert : 1335123455 To insert : 1335123456 To insert : 1335123457 To insert : 1335123458 To insert : 1335123459 To insert : 1335123460 To insert : 1335123461 To insert : 1335123462 To insert : 1335123463 To insert : 1335123464 To insert : 1335123465 To insert : 1335123466 To insert : 1335123467 To insert : 1335123468 To insert : 1335123469 To insert : 1335123470 To insert : 1335123471 To insert : 1335123472 To insert : 1335123473 To insert : 1335123474 To insert : 1335123475 To insert : 1335123476 time to insert the descriptors : 58.54483461380005 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 456 time used for this insertion : 0.03115701675415039 save missing photos in datou_result : time spend for datou_step_exec : 67.30131673812866 time spend to save output : 0.08489990234375 total time spend for step 6 : 67.38621664047241 step7:ventilate_hashtags_in_portfolio Thu Feb 6 05:24:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20278471 get user id for portfolio 20278471 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20278471 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','Tetrapak','mal_croppe','pet_fonce','Film_plastique','autre','pet_clair','papier','refus','carton','Carton','PEHD','pehd','environnement','PET_fonce','flou','PET_clair','Papier')) AND mptpi.`min_score`=0.6 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20278471 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','Tetrapak','mal_croppe','pet_fonce','Film_plastique','autre','pet_clair','papier','refus','carton','Carton','PEHD','pehd','environnement','PET_fonce','flou','PET_clair','Papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20278804,20278788,20278803,20278790,20278794,20278793,20278795,20278799,20278797,20278798,20278800,20278801,20278802?tags=carton,metal,pet_fonce,flou,papier,pehd,autre,pet_clair,tetrapak,mal_croppe,environnement,refus,film_plastique&datou_id_consolidate=4235&port_consolidate=20278471 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1334935917, 1334935866, 1334935863] Looping around the photos to save general results len do output : 1 /20278471. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935917', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935866', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935863', None, None, None, None, None, '2557296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.015929460525512695 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.0957636833190918 time spend to save output : 0.016164779663085938 total time spend for step 7 : 1.1119284629821777 step8:final Thu Feb 6 05:24:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1334935917: ('0.20098993662470943',), 1334935866: ('0.20098993662470943',), 1334935863: ('0.20098993662470943',)} new output for save of step final : {1334935917: ('0.20098993662470943',), 1334935866: ('0.20098993662470943',), 1334935863: ('0.20098993662470943',)} [1334935917, 1334935866, 1334935863] Looping around the photos to save general results len do output : 3 /1334935917.Didn't retrieve data . /1334935866.Didn't retrieve data . /1334935863.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935917', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935866', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935863', None, None, None, None, None, '2557296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.12435698509216309 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13163399696350098 time spend to save output : 0.12465882301330566 total time spend for step 8 : 0.25629281997680664 step9:velours_tree Thu Feb 6 05:24:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20278804,20278788,20278803,20278790,20278794,20278793,20278795,20278799,20278797,20278798,20278800,20278801,20278802 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278804 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278788 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278803 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278790 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278794 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278793 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278795 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278799 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278797 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278798 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278800 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278801 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278802 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 5000 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [0 3 3 ... 0 0 0] Elapsed time: 17.268805265426636 graph_id used : 76455 - Beta version, working pretty good on 11-5-16 ! too many photos (6321 more than 5000) Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 298.9378535747528 time spend to save output : 0.14454960823059082 total time spend for step 9 : 299.0824031829834 step10:send_mail_cod Thu Feb 6 05:29:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20278471_06-02-2025_05_29_05.pdf 20278762 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202787621738816145 20278746 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202787461738816146 20278761 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202787611738816147 20278748 imagette202787481738816148 20278752 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202787521738816148 20278751 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202787511738816149 20278753 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202787531738816150 20278757 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202787571738816151 20278755 imagette202787551738816152 20278756 imagette202787561738816152 20278759 imagette202787591738816152 20278760 imagette202787601738816152 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20278471 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20278804,20278788,20278803,20278790,20278794,20278793,20278795,20278799,20278797,20278798,20278800,20278801,20278802?tags=carton,metal,pet_fonce,flou,papier,pehd,autre,pet_clair,tetrapak,mal_croppe,environnement,refus,film_plastique&datou_id_consolidate=4235&port_consolidate=20278471 your option no_mail is active, we will not send the real mail to your client args[1334935917] : ((1334935917, -7.827725084134799, 492609224), (1334935917, -0.3391314167679709, 496442774), '0.20098993662470943') apple ((1334935917, -7.827725084134799, 492609224), (1334935917, -0.3391314167679709, 496442774), '0.20098993662470943') We are sending mail with results at cod@fotonower.com args[1334935866] : ((1334935866, -7.821863523269276, 492609224), (1334935866, -0.3357251038310363, 496442774), '0.20098993662470943') apple ((1334935866, -7.821863523269276, 492609224), (1334935866, -0.3357251038310363, 496442774), '0.20098993662470943') We are sending mail with results at cod@fotonower.com args[1334935863] : ((1334935863, -7.835651359099072, 492609224), (1334935863, -0.3330210528539226, 496442774), '0.20098993662470943') apple ((1334935863, -7.835651359099072, 492609224), (1334935863, -0.3330210528539226, 496442774), '0.20098993662470943') We are sending mail with results at cod@fotonower.com refus_total : 0.20098993662470943 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20278471 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20278471_06-02-2025_05_29_05.pdf results_Qualipapia_P20278471_06-02-2025_05_29_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20278471_06-02-2025_05_29_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20278471','results_Qualipapia_P20278471_06-02-2025_05_29_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20278471_06-02-2025_05_29_05.pdf','pdf','','0.24','0.20098993662470943') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1334935917, 1334935866, 1334935863] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935917', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935866', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935863', None, None, None, None, None, '2557296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.09211015701293945 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.382342100143433 time spend to save output : 0.09261894226074219 total time spend for step 10 : 8.474961042404175 step11:split_time_score Thu Feb 6 05:29:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 76),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05022025 20278471 Nombre de photos uploadées : 76 / 23040 (0%) 05022025 20278471 Nombre de photos taguées (types de déchets): 76 / 76 (100%) 05022025 20278471 Nombre de photos taguées (volume) : 0 / 76 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ???????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0036361217498779297 elapsed_time : insert_dashboard_record_day_entry 0.07054948806762695 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20256405 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20256408 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20256411 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20256413 order by id desc limit 1 Qualite : 0.261680923423937 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20256415_05-02-2025_12_47_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20256415 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20256415 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257100 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257102 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257104 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257106 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257107 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257108 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257110 order by id desc limit 1 Qualite : 0.13910553763920894 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20257112_05-02-2025_15_47_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20257112 AND mptpi.`type`=4230 To do Qualite : 0.15447490550984141 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20257114_05-02-2025_13_34_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257114 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20257114 AND mptpi.`type`=4230 To do Qualite : 0.17537954361119074 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20257116_05-02-2025_15_37_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257116 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20257116 AND mptpi.`type`=4230 To do Qualite : 0.1755375447284788 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20257118_05-02-2025_13_30_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257118 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20257118 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257645 order by id desc limit 1 Qualite : 0.17035650420251705 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20257647_05-02-2025_13_49_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20257647 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20257647 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278457 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278458 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278459 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278460 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278461 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278462 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278463 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278464 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278465 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278466 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278467 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278468 order by id desc limit 1 Qualite : 0.2062742649183008 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20278469_06-02-2025_04_33_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278469 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20278469 AND mptpi.`type`=4230 To do Qualite : 0.15680992341547387 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20278470_06-02-2025_05_19_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278470 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20278470 AND mptpi.`type`=4230 To do Qualite : 0.2069992967936249 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20278471_06-02-2025_05_29_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278471 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20278471 AND mptpi.`type`=4230 To do Qualite : 0.21528493101295593 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20278472_06-02-2025_03_51_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20278472 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20278472 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277757 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277758 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277759 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277760 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277761 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277762 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277763 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277764 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277765 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277766 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277767 order by id desc limit 1 Qualite : 0.23715162778880738 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20277768_06-02-2025_01_53_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277768 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20277768 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277769 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277770 order by id desc limit 1 Qualite : 0.22131725176901046 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20277771_06-02-2025_01_43_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277771 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20277771 AND mptpi.`type`=4230 To do Qualite : 0.21245918088076682 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20277772_06-02-2025_01_47_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277772 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20277772 AND mptpi.`type`=4230 To do Qualite : 0.22435544944978084 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20277773_06-02-2025_01_37_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277773 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20277773 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277774 order by id desc limit 1 Qualite : 0.20813985501535712 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20277775_06-02-2025_01_18_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277775 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20277775 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20276983 order by id desc limit 1 Qualite : 0.2198451968715625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20276984_06-02-2025_00_19_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20276984 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20276984 AND mptpi.`type`=4230 To do Qualite : 0.23731855155668644 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20276985_06-02-2025_00_18_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20276985 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20276985 AND mptpi.`type`=4230 To do Qualite : 0.2400102231643009 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20276986_06-02-2025_00_11_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20276986 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20276986 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20273008 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20264776 order by id desc limit 1 Qualite : 0.2035277140763347 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20263670_05-02-2025_16_43_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20263670 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20263670 AND mptpi.`type`=4230 To do Qualite : 0.21553806376896342 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20263671_05-02-2025_16_07_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20263671 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20263671 AND mptpi.`type`=4230 To do Qualite : 0.19536132896941727 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20263672_05-02-2025_16_19_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20263672 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20263672 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20263673 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20264777 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20264778 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20264779 order by id desc limit 1 Qualite : 0.19859936113021315 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20264780_05-02-2025_16_49_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20264780 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20264780 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270375 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266804 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266805 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266806 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266807 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266808 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266037 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266039 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266041 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266043 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266045 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266047 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266049 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266054 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266056 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266058 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266060 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266062 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266064 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266066 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266069 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266071 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266072 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266073 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266074 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266809 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266810 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266811 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266812 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266814 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266817 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266075 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266077 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266078 order by id desc limit 1 Qualite : 0.1826699120141101 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20266080_05-02-2025_17_35_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266080 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20266080 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266082 order by id desc limit 1 Qualite : 0.17244981350823854 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20266084_05-02-2025_17_22_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266084 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20266084 AND mptpi.`type`=4230 To do Qualite : 0.20283218631561806 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20266086_05-02-2025_17_23_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266086 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20266086 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266819 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266821 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266823 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266825 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266827 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266830 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266832 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266834 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266836 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266838 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266840 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266842 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266844 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266846 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266848 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266849 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266850 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266851 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266852 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266853 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266854 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266855 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266856 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266857 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266858 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266859 order by id desc limit 1 Qualite : 0.16164896170193196 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20266860_05-02-2025_17_47_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20266860 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269217 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269218 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269220 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269221 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269223 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269224 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20268394 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20268395 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20268396 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20268397 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20268398 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20268400 order by id desc limit 1 Qualite : 0.21841476324960038 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20268402_05-02-2025_18_35_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20268402 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20268402 AND mptpi.`type`=4230 To do Qualite : 0.20653110844289468 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20268404_05-02-2025_18_24_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20268404 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20268404 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269226 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269228 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269231 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269233 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269235 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269238 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269240 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269242 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269244 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269246 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269250 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269252 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269256 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269258 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269260 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269263 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269264 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269265 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269266 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269267 order by id desc limit 1 Qualite : 0.19631321482695893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20269268_05-02-2025_18_36_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269268 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20269268 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269269 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269270 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269271 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269272 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269273 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269274 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269275 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269276 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269277 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269278 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269279 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269280 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269281 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269282 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269283 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269284 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269285 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269286 order by id desc limit 1 Qualite : 0.19416568531477388 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20269287_05-02-2025_18_48_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20269287 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20269287 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270376 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270377 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270378 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270380 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270381 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270382 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270383 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270384 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270387 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270389 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270391 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270393 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270395 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270397 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270399 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270402 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270822 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270824 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270825 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270827 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270828 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270830 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270831 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270834 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270835 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270837 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270838 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270840 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270841 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270844 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270846 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270848 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270850 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270852 order by id desc limit 1 Qualite : 0.21115191131550437 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20270854_05-02-2025_20_34_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270854 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20270854 AND mptpi.`type`=4230 To do Qualite : 0.2409974512120334 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20270856_05-02-2025_19_49_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270856 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20270856 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20273009 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20273010 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20273011 order by id desc limit 1 Qualite : 0.18861111480949674 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20273012_05-02-2025_22_14_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20273012 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20273012 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20273013 order by id desc limit 1 Qualite : 0.23446449536461855 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20273014_05-02-2025_21_23_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20273014 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20273014 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272195 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272212 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272213 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272215 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272216 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272218 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272243 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272245 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272246 order by id desc limit 1 Qualite : 0.20860887743709772 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20272248_05-02-2025_20_49_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20272248 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20272248 AND mptpi.`type`=4230 To do Qualite : 0.19640580274466415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20274810_05-02-2025_22_47_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20274810 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20274810 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05022025': {'nb_upload': 76, 'nb_taggue_class': 76, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1334935917, 1334935866, 1334935863] Looping around the photos to save general results len do output : 1 /20278471Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935917', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935866', None, None, None, None, None, '2557296') ('4234', None, None, None, None, None, None, None, '2557296') ('4234', None, '1334935863', None, None, None, None, None, '2557296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.04351377487182617 save_final save missing photos in datou_result : time spend for datou_step_exec : 170.1689703464508 time spend to save output : 0.043770551681518555 total time spend for step 11 : 170.21274089813232 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 75.99user 32.18system 11:42.98elapsed 15%CPU (0avgtext+0avgdata 2735872maxresident)k 932512inputs+58680outputs (18294major+2876163minor)pagefaults 0swaps