python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2486630 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 6>5 please execute split_portfolio.py -i 20196760 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2542844'] with mtr_portfolio_ids : ['20196760'] and first list_photo_ids : [] new path : /proc/2486630/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.7894775867462158 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Feb 4 03:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-04 03:20:31.758517: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-04 03:20:31.783050: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-04 03:20:31.785066: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0cac000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-04 03:20:31.785127: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-04 03:20:31.789136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-04 03:20:32.035696: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x21801c10 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-04 03:20:32.035751: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-04 03:20:32.037020: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-04 03:20:32.037449: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-04 03:20:32.040590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-04 03:20:32.043632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-04 03:20:32.044118: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-04 03:20:32.046877: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-04 03:20:32.048227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-04 03:20:32.053266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-04 03:20:32.054698: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-04 03:20:32.054768: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-04 03:20:32.055550: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-04 03:20:32.055569: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-04 03:20:32.055578: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-04 03:20:32.056933: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-04 03:20:32.320978: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-04 03:20:32.321105: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-04 03:20:32.321127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-04 03:20:32.321147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-04 03:20:32.321165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-04 03:20:32.321184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-04 03:20:32.321202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-04 03:20:32.321221: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-04 03:20:32.322774: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-04 03:20:32.324143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-04 03:20:32.324183: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-04 03:20:32.324203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-04 03:20:32.324221: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-04 03:20:32.324238: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-04 03:20:32.324256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-04 03:20:32.324273: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-04 03:20:32.324290: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-04 03:20:32.325821: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-04 03:20:32.325860: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-04 03:20:32.325871: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-04 03:20:32.325880: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-04 03:20:32.327510: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-04 03:20:38.950612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-04 03:20:39.123831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.54766 max: 149.89297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0005941390991210938 length of segment : 31 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.0015985965728759766 length of segment : 36 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 52 time to create 1 rle with old method : 0.00017023086547851562 length of segment : 15 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.0014908313751220703 length of segment : 34 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0006034374237060547 length of segment : 30 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 1732 time to create 1 rle with old method : 0.003109455108642578 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.42656 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 989 time to create 1 rle with old method : 0.0012679100036621094 length of segment : 31 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 952 time to create 1 rle with old method : 0.00124359130859375 length of segment : 33 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 775 time to create 1 rle with old method : 0.0009684562683105469 length of segment : 38 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 2684 time to create 1 rle with old method : 0.0032205581665039062 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.93438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 4836 time to create 1 rle with old method : 0.006586313247680664 length of segment : 131 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.09844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.0001125335693359375 nb_pixel_total : 4718 time to create 1 rle with old method : 0.005423069000244141 length of segment : 172 time for calcul the mask position with numpy : 0.0001418590545654297 nb_pixel_total : 9098 time to create 1 rle with old method : 0.010538101196289062 length of segment : 130 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0010635852813720703 length of segment : 49 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00028252601623535156 length of segment : 19 time for calcul the mask position with numpy : 0.0001385211944580078 nb_pixel_total : 9711 time to create 1 rle with old method : 0.011712312698364258 length of segment : 116 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0006244182586669922 length of segment : 24 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003476142883300781 length of segment : 21 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003521442413330078 length of segment : 19 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00030422210693359375 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.17422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.0006856918334960938 length of segment : 18 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1746 time to create 1 rle with old method : 0.002040863037109375 length of segment : 110 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006692409515380859 length of segment : 55 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.00040340423583984375 length of segment : 29 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1767 time to create 1 rle with old method : 0.002043008804321289 length of segment : 104 time for calcul the mask position with numpy : 0.00046443939208984375 nb_pixel_total : 46611 time to create 1 rle with old method : 0.05155014991760254 length of segment : 198 Processing 1 images image shape: (400, 400, 3) min: 20.00000 max: 211.00000 molded_images shape: (1, 640, 640, 3) min: -86.02031 max: 75.17266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.53203 max: 151.07656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002923011779785156 length of segment : 17 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 807 time to create 1 rle with old method : 0.0010254383087158203 length of segment : 32 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.0011124610900878906 length of segment : 52 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.00048732757568359375 length of segment : 32 time for calcul the mask position with numpy : 0.0001513957977294922 nb_pixel_total : 7101 time to create 1 rle with old method : 0.011383533477783203 length of segment : 127 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 885 time to create 1 rle with old method : 0.0016453266143798828 length of segment : 37 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0009555816650390625 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -99.12188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 741 time to create 1 rle with old method : 0.001131296157836914 length of segment : 62 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.00116729736328125 length of segment : 35 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0003027915954589844 length of segment : 9 time for calcul the mask position with numpy : 0.00026035308837890625 nb_pixel_total : 17186 time to create 1 rle with old method : 0.01997208595275879 length of segment : 145 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.75469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0007452964782714844 length of segment : 26 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0016341209411621094 length of segment : 33 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005810260772705078 length of segment : 54 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00030040740966796875 length of segment : 19 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00030994415283203125 length of segment : 25 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005338191986083984 length of segment : 38 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1180 time to create 1 rle with old method : 0.0016126632690429688 length of segment : 42 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 828 time to create 1 rle with old method : 0.0010325908660888672 length of segment : 36 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0007770061492919922 length of segment : 52 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006756782531738281 length of segment : 23 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006711483001708984 length of segment : 59 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00037288665771484375 length of segment : 32 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1318 time to create 1 rle with old method : 0.001642465591430664 length of segment : 42 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 40 time to create 1 rle with old method : 8.821487426757812e-05 length of segment : 14 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1327 time to create 1 rle with old method : 0.0017943382263183594 length of segment : 45 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1312 time to create 1 rle with old method : 0.0015747547149658203 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 250.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 123.52969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0005362033843994141 length of segment : 15 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1586 time to create 1 rle with old method : 0.0019316673278808594 length of segment : 82 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.0003712177276611328 length of segment : 28 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 848 time to create 1 rle with old method : 0.0010576248168945312 length of segment : 42 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 804 time to create 1 rle with old method : 0.0010557174682617188 length of segment : 42 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0009207725524902344 length of segment : 46 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 1664 time to create 1 rle with old method : 0.002122163772583008 length of segment : 52 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006432533264160156 length of segment : 30 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003352165222167969 length of segment : 28 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006594657897949219 length of segment : 28 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1216 time to create 1 rle with old method : 0.0014941692352294922 length of segment : 53 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 844 time to create 1 rle with old method : 0.001102447509765625 length of segment : 125 Processing 1 images image shape: (280, 400, 3) min: 16.00000 max: 184.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 61.11562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009341239929199219 nb_pixel_total : 106374 time to create 1 rle with old method : 0.11368918418884277 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 940 time to create 1 rle with old method : 0.0011959075927734375 length of segment : 56 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003941059112548828 length of segment : 22 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.0004227161407470703 length of segment : 18 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0002951622009277344 length of segment : 21 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.97109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00021529197692871094 length of segment : 10 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00014853477478027344 length of segment : 9 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001533031463623047 length of segment : 12 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.00024080276489257812 length of segment : 12 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005731582641601562 length of segment : 16 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002751350402832031 length of segment : 15 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.00025844573974609375 length of segment : 9 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002562999725341797 length of segment : 14 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.00039839744567871094 length of segment : 28 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.00017452239990234375 length of segment : 12 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00026106834411621094 length of segment : 15 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 63 time to create 1 rle with old method : 0.00011682510375976562 length of segment : 7 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004506111145019531 length of segment : 17 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003294944763183594 length of segment : 27 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0009796619415283203 length of segment : 31 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 808 time to create 1 rle with old method : 0.0010540485382080078 length of segment : 48 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 658 time to create 1 rle with old method : 0.0008494853973388672 length of segment : 41 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00025391578674316406 length of segment : 24 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00029587745666503906 length of segment : 16 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008826255798339844 length of segment : 31 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 19 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 39 time to create 1 rle with old method : 0.00013637542724609375 length of segment : 18 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006763935089111328 length of segment : 26 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0004410743713378906 length of segment : 18 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003516674041748047 length of segment : 23 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1106 time to create 1 rle with old method : 0.0013337135314941406 length of segment : 85 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003361701965332031 length of segment : 17 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.0002105236053466797 length of segment : 39 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0007128715515136719 length of segment : 39 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1206 time to create 1 rle with old method : 0.0014660358428955078 length of segment : 81 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.0007886886596679688 length of segment : 42 time for calcul the mask position with numpy : 0.00035881996154785156 nb_pixel_total : 24490 time to create 1 rle with old method : 0.02864670753479004 length of segment : 288 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.43828 max: 149.63125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.00040435791015625 length of segment : 28 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 8 time to create 1 rle with old method : 7.843971252441406e-05 length of segment : 6 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 896 time to create 1 rle with old method : 0.0011684894561767578 length of segment : 35 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.00040221214294433594 length of segment : 31 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0023527145385742188 length of segment : 48 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 899 time to create 1 rle with old method : 0.0011875629425048828 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.94219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 994 time to create 1 rle with old method : 0.0012655258178710938 length of segment : 32 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 810 time to create 1 rle with old method : 0.0010001659393310547 length of segment : 36 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 2317 time to create 1 rle with old method : 0.002931833267211914 length of segment : 50 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 2350 time to create 1 rle with old method : 0.0028362274169921875 length of segment : 48 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0013027191162109375 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.18828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 5021 time to create 1 rle with old method : 0.006411075592041016 length of segment : 147 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.65313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 5100 time to create 1 rle with old method : 0.005764961242675781 length of segment : 139 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0007920265197753906 length of segment : 66 time for calcul the mask position with numpy : 0.00013756752014160156 nb_pixel_total : 8885 time to create 1 rle with old method : 0.010728120803833008 length of segment : 119 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003514289855957031 length of segment : 22 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002658367156982422 length of segment : 17 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0006864070892333984 length of segment : 26 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.66641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006098747253417969 length of segment : 16 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 3618 time to create 1 rle with old method : 0.0042650699615478516 length of segment : 56 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 2054 time to create 1 rle with old method : 0.0024094581604003906 length of segment : 142 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00019979476928710938 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 19.00000 max: 206.00000 molded_images shape: (1, 640, 640, 3) min: -85.56328 max: 72.98125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.47344 max: 151.08047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00029659271240234375 nb_pixel_total : 17463 time to create 1 rle with old method : 0.027426958084106445 length of segment : 252 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005135536193847656 length of segment : 33 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 934 time to create 1 rle with old method : 0.0012209415435791016 length of segment : 79 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 838 time to create 1 rle with old method : 0.0010554790496826172 length of segment : 34 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003192424774169922 length of segment : 18 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.00020360946655273438 length of segment : 14 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005834102630615234 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.89922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.000766754150390625 length of segment : 52 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.00044226646423339844 length of segment : 23 time for calcul the mask position with numpy : 0.0002300739288330078 nb_pixel_total : 15817 time to create 1 rle with old method : 0.01852273941040039 length of segment : 159 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001895427703857422 length of segment : 12 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0008525848388671875 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.39531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.0009305477142333984 length of segment : 36 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0008292198181152344 length of segment : 22 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0005743503570556641 length of segment : 57 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004661083221435547 length of segment : 42 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0005426406860351562 length of segment : 30 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0008118152618408203 length of segment : 52 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0005552768707275391 length of segment : 42 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1165 time to create 1 rle with old method : 0.0015132427215576172 length of segment : 41 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002796649932861328 length of segment : 16 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0013861656188964844 length of segment : 80 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0006358623504638672 length of segment : 66 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0002903938293457031 length of segment : 20 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1073 time to create 1 rle with old method : 0.0013799667358398438 length of segment : 38 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1290 time to create 1 rle with old method : 0.0016088485717773438 length of segment : 41 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 249.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 122.51797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004878044128417969 length of segment : 15 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1652 time to create 1 rle with old method : 0.002015352249145508 length of segment : 83 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009002685546875 length of segment : 36 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003528594970703125 length of segment : 29 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 868 time to create 1 rle with old method : 0.0010399818420410156 length of segment : 47 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1352 time to create 1 rle with old method : 0.0016748905181884766 length of segment : 51 time for calcul the mask position with numpy : 0.0001876354217529297 nb_pixel_total : 1877 time to create 1 rle with old method : 0.002155780792236328 length of segment : 145 time for calcul the mask position with numpy : 0.00011467933654785156 nb_pixel_total : 2374 time to create 1 rle with old method : 0.002612590789794922 length of segment : 169 Processing 1 images image shape: (280, 400, 3) min: 12.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 63.16641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004630088806152344 length of segment : 17 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 994 time to create 1 rle with old method : 0.0012733936309814453 length of segment : 65 time for calcul the mask position with numpy : 0.00019741058349609375 nb_pixel_total : 3584 time to create 1 rle with old method : 0.004345417022705078 length of segment : 156 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007941722869873047 length of segment : 27 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.95937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00015544891357421875 length of segment : 12 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00023031234741210938 length of segment : 12 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 70 time to create 1 rle with old method : 0.0001342296600341797 length of segment : 7 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00022459030151367188 length of segment : 11 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004596710205078125 length of segment : 16 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00026535987854003906 length of segment : 11 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002529621124267578 length of segment : 12 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00019168853759765625 length of segment : 12 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002567768096923828 length of segment : 15 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.0002338886260986328 length of segment : 13 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00028133392333984375 length of segment : 15 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006089210510253906 length of segment : 32 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00041604042053222656 length of segment : 19 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00012540817260742188 length of segment : 10 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1494 time to create 1 rle with old method : 0.0018374919891357422 length of segment : 65 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.86562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 934 time to create 1 rle with old method : 0.0011997222900390625 length of segment : 51 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0010828971862792969 length of segment : 38 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0002422332763671875 length of segment : 24 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0005612373352050781 length of segment : 20 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003077983856201172 length of segment : 25 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00029730796813964844 length of segment : 40 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006489753723144531 length of segment : 25 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003199577331542969 length of segment : 17 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004131793975830078 length of segment : 18 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003762245178222656 length of segment : 30 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00028705596923828125 length of segment : 40 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0006225109100341797 length of segment : 30 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007328987121582031 length of segment : 33 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006706714630126953 length of segment : 32 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0004334449768066406 length of segment : 39 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.0009937286376953125 length of segment : 58 time for calcul the mask position with numpy : 0.0004284381866455078 nb_pixel_total : 36883 time to create 1 rle with old method : 0.04182767868041992 length of segment : 242 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.18438 max: 147.76406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0007596015930175781 length of segment : 25 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0018150806427001953 length of segment : 34 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 27 time to create 1 rle with old method : 0.00016927719116210938 length of segment : 14 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 32 time to create 1 rle with old method : 0.00012230873107910156 length of segment : 25 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 886 time to create 1 rle with old method : 0.002011537551879883 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.88359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 766 time to create 1 rle with old method : 0.0012004375457763672 length of segment : 36 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 33 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2383 time to create 1 rle with old method : 0.0040874481201171875 length of segment : 48 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0013480186462402344 length of segment : 52 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 718 time to create 1 rle with old method : 0.0009410381317138672 length of segment : 36 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 2584 time to create 1 rle with old method : 0.0032308101654052734 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.81719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 5883 time to create 1 rle with old method : 0.007538318634033203 length of segment : 125 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1125 time to create 1 rle with old method : 0.0014226436614990234 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.93828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 4973 time to create 1 rle with old method : 0.0078029632568359375 length of segment : 176 time for calcul the mask position with numpy : 0.00018095970153808594 nb_pixel_total : 9252 time to create 1 rle with old method : 0.011673450469970703 length of segment : 121 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002989768981933594 length of segment : 21 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 654 time to create 1 rle with old method : 0.0008199214935302734 length of segment : 57 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.00028014183044433594 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003724098205566406 length of segment : 18 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0006544589996337891 length of segment : 24 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 2075 time to create 1 rle with old method : 0.0023059844970703125 length of segment : 112 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00019598007202148438 length of segment : 8 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 2076 time to create 1 rle with old method : 0.0023877620697021484 length of segment : 56 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0006306171417236328 length of segment : 17 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1786 time to create 1 rle with old method : 0.0020830631256103516 length of segment : 135 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.0004017353057861328 length of segment : 30 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005171298980712891 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 15.00000 max: 204.00000 molded_images shape: (1, 640, 640, 3) min: -88.05156 max: 69.71953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.83672 max: 150.78359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.0011243820190429688 length of segment : 64 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0004897117614746094 length of segment : 32 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00031447410583496094 length of segment : 18 time for calcul the mask position with numpy : 2.6464462280273438e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00015783309936523438 length of segment : 12 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 853 time to create 1 rle with old method : 0.0009732246398925781 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.69219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.0002334117889404297 nb_pixel_total : 16673 time to create 1 rle with old method : 0.01868581771850586 length of segment : 130 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00036907196044921875 length of segment : 33 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.0002689361572265625 length of segment : 10 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.0009124279022216797 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.52813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 864 time to create 1 rle with old method : 0.001089334487915039 length of segment : 38 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 581 time to create 1 rle with old method : 0.0008549690246582031 length of segment : 24 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 864 time to create 1 rle with old method : 0.0010890960693359375 length of segment : 39 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003497600555419922 length of segment : 26 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 431 time to create 1 rle with old method : 0.0005474090576171875 length of segment : 42 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.00029921531677246094 length of segment : 19 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0008130073547363281 length of segment : 31 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 877 time to create 1 rle with old method : 0.0016133785247802734 length of segment : 34 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 601 time to create 1 rle with old method : 0.0007741451263427734 length of segment : 67 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0017507076263427734 length of segment : 44 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0006763935089111328 length of segment : 58 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 1349 time to create 1 rle with old method : 0.0017249584197998047 length of segment : 103 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002493858337402344 length of segment : 14 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1373 time to create 1 rle with old method : 0.0017244815826416016 length of segment : 42 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 239.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 117.09609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1608 time to create 1 rle with old method : 0.001971006393432617 length of segment : 82 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.000446319580078125 length of segment : 14 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003876686096191406 length of segment : 30 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 846 time to create 1 rle with old method : 0.0010561943054199219 length of segment : 45 time for calcul the mask position with numpy : 0.0001270771026611328 nb_pixel_total : 1099 time to create 1 rle with old method : 0.0013914108276367188 length of segment : 131 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 904 time to create 1 rle with old method : 0.0011184215545654297 length of segment : 43 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006244182586669922 length of segment : 25 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00035071372985839844 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 16.00000 max: 185.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 60.29141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013310909271240234 nb_pixel_total : 106504 time to create 1 rle with old method : 0.11867976188659668 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.67031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.00047969818115234375 length of segment : 17 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0009071826934814453 length of segment : 24 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.00038504600524902344 length of segment : 23 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 903 time to create 1 rle with old method : 0.0014269351959228516 length of segment : 57 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.00027179718017578125 length of segment : 18 time for calcul the mask position with numpy : 0.00035572052001953125 nb_pixel_total : 4853 time to create 1 rle with old method : 0.0058422088623046875 length of segment : 234 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.92422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002541542053222656 length of segment : 11 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001785755157470703 length of segment : 13 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001976490020751953 length of segment : 10 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002799034118652344 length of segment : 12 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005848407745361328 length of segment : 16 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00017690658569335938 length of segment : 12 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 577 time to create 1 rle with old method : 0.0007419586181640625 length of segment : 40 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00026726722717285156 length of segment : 14 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0005002021789550781 length of segment : 22 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00015163421630859375 length of segment : 8 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 784 time to create 1 rle with old method : 0.0010540485382080078 length of segment : 20 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.00014090538024902344 length of segment : 11 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.00023365020751953125 length of segment : 11 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.0010578632354736328 length of segment : 21 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006496906280517578 length of segment : 31 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.84609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.00014638900756835938 nb_pixel_total : 172 time to create 1 rle with old method : 0.00026488304138183594 length of segment : 25 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 676 time to create 1 rle with old method : 0.0009245872497558594 length of segment : 58 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 864 time to create 1 rle with old method : 0.001154184341430664 length of segment : 36 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005366802215576172 length of segment : 16 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.0012469291687011719 length of segment : 50 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.0002052783966064453 length of segment : 37 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1135 time to create 1 rle with old method : 0.001367330551147461 length of segment : 82 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004029273986816406 length of segment : 26 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005242824554443359 length of segment : 37 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00026345252990722656 length of segment : 21 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00026917457580566406 length of segment : 17 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004985332489013672 length of segment : 20 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008213520050048828 length of segment : 40 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006742477416992188 length of segment : 35 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0005681514739990234 length of segment : 43 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0004961490631103516 length of segment : 18 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 651 time to create 1 rle with old method : 0.0010421276092529297 length of segment : 52 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.71563 max: 148.83047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004978179931640625 length of segment : 38 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.0014009475708007812 length of segment : 39 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 46 time to create 1 rle with old method : 9.489059448242188e-05 length of segment : 14 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.0009884834289550781 length of segment : 38 time for calcul the mask position with numpy : 0.0003781318664550781 nb_pixel_total : 19682 time to create 1 rle with old method : 0.02341151237487793 length of segment : 160 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 14 time to create 1 rle with old method : 6.246566772460938e-05 length of segment : 9 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.46172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005390644073486328 length of segment : 32 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 794 time to create 1 rle with old method : 0.0009868144989013672 length of segment : 34 time for calcul the mask position with numpy : 0.0001068115234375 nb_pixel_total : 2146 time to create 1 rle with old method : 0.0027413368225097656 length of segment : 43 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 2535 time to create 1 rle with old method : 0.0031299591064453125 length of segment : 52 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 2277 time to create 1 rle with old method : 0.002833843231201172 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.67656 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 9.34600830078125e-05 nb_pixel_total : 4450 time to create 1 rle with old method : 0.005214691162109375 length of segment : 126 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.64141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00011134147644042969 nb_pixel_total : 4988 time to create 1 rle with old method : 0.005764961242675781 length of segment : 178 time for calcul the mask position with numpy : 0.00010800361633300781 nb_pixel_total : 884 time to create 1 rle with old method : 0.0011317729949951172 length of segment : 63 time for calcul the mask position with numpy : 0.00017786026000976562 nb_pixel_total : 8606 time to create 1 rle with old method : 0.011753082275390625 length of segment : 127 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00028228759765625 length of segment : 18 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003368854522705078 length of segment : 21 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003724098205566406 length of segment : 18 time for calcul the mask position with numpy : 0.00027942657470703125 nb_pixel_total : 5299 time to create 1 rle with old method : 0.006418704986572266 length of segment : 276 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.47891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1790 time to create 1 rle with old method : 0.002103090286254883 length of segment : 122 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0006592273712158203 length of segment : 17 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006842613220214844 length of segment : 56 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004603862762451172 length of segment : 34 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.00043392181396484375 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 212.00000 molded_images shape: (1, 640, 640, 3) min: -88.23906 max: 73.97344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.87578 max: 151.04531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003457069396972656 length of segment : 17 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 801 time to create 1 rle with old method : 0.0010077953338623047 length of segment : 33 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 15 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005514621734619141 length of segment : 32 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.000675201416015625 length of segment : 55 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.00047969818115234375 length of segment : 20 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.0009236335754394531 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.09063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00025963783264160156 nb_pixel_total : 17390 time to create 1 rle with old method : 0.020186185836791992 length of segment : 141 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0005471706390380859 length of segment : 39 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002377033233642578 length of segment : 8 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.84844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 1126 time to create 1 rle with old method : 0.0015370845794677734 length of segment : 42 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 825 time to create 1 rle with old method : 0.0010488033294677734 length of segment : 38 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0009357929229736328 length of segment : 26 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0007069110870361328 length of segment : 65 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 26 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0008122920989990234 length of segment : 40 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004658699035644531 length of segment : 39 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1381 time to create 1 rle with old method : 0.0018086433410644531 length of segment : 43 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.0008969306945800781 length of segment : 43 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005402565002441406 length of segment : 60 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006146430969238281 length of segment : 31 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00026226043701171875 length of segment : 18 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0014917850494384766 length of segment : 84 time for calcul the mask position with numpy : 0.000102996826171875 nb_pixel_total : 1203 time to create 1 rle with old method : 0.0015168190002441406 length of segment : 84 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1261 time to create 1 rle with old method : 0.0016837120056152344 length of segment : 34 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006337165832519531 length of segment : 39 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 252.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 126.36953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004930496215820312 length of segment : 16 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 1701 time to create 1 rle with old method : 0.002059459686279297 length of segment : 86 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003657341003417969 length of segment : 29 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.00049591064453125 length of segment : 37 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0013203620910644531 length of segment : 34 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 781 time to create 1 rle with old method : 0.0016880035400390625 length of segment : 82 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 938 time to create 1 rle with old method : 0.0011606216430664062 length of segment : 42 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 897 time to create 1 rle with old method : 0.0011420249938964844 length of segment : 43 time for calcul the mask position with numpy : 0.00017762184143066406 nb_pixel_total : 2410 time to create 1 rle with old method : 0.003093242645263672 length of segment : 170 time for calcul the mask position with numpy : 0.00024771690368652344 nb_pixel_total : 2050 time to create 1 rle with old method : 0.0025529861450195312 length of segment : 165 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 2513 time to create 1 rle with old method : 0.0028760433197021484 length of segment : 174 Processing 1 images image shape: (280, 400, 3) min: 14.00000 max: 187.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 69.81484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009546279907226562 nb_pixel_total : 106252 time to create 1 rle with old method : 0.1278975009918213 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.76797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0005586147308349609 length of segment : 17 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 946 time to create 1 rle with old method : 0.0011968612670898438 length of segment : 58 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003521442413330078 length of segment : 21 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003399848937988281 length of segment : 22 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1352 time to create 1 rle with old method : 0.0016126632690429688 length of segment : 88 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.09219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00024509429931640625 length of segment : 11 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002522468566894531 length of segment : 11 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001418590545654297 length of segment : 12 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005929470062255859 length of segment : 15 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.0001361370086669922 length of segment : 7 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00023627281188964844 length of segment : 12 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00026035308837890625 length of segment : 15 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.00039005279541015625 length of segment : 22 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002467632293701172 length of segment : 9 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00018715858459472656 length of segment : 13 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00011157989501953125 length of segment : 7 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005054473876953125 length of segment : 31 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00020360946655273438 length of segment : 13 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00018167495727539062 length of segment : 12 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.09219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 950 time to create 1 rle with old method : 0.001199960708618164 length of segment : 54 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002522468566894531 length of segment : 21 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.00048232078552246094 length of segment : 17 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0008230209350585938 length of segment : 28 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005743503570556641 length of segment : 19 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00027680397033691406 length of segment : 25 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005772113800048828 length of segment : 25 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003426074981689453 length of segment : 16 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00023865699768066406 length of segment : 15 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1669 time to create 1 rle with old method : 0.0020189285278320312 length of segment : 53 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.00045871734619140625 length of segment : 18 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003902912139892578 length of segment : 26 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0006775856018066406 length of segment : 43 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 740 time to create 1 rle with old method : 0.0009291172027587891 length of segment : 54 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.43047 max: 149.89297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0006747245788574219 length of segment : 27 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 35 time to create 1 rle with old method : 7.009506225585938e-05 length of segment : 15 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0010747909545898438 length of segment : 44 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 702 time to create 1 rle with old method : 0.0009596347808837891 length of segment : 52 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.00010848045349121094 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.13750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 955 time to create 1 rle with old method : 0.0012693405151367188 length of segment : 41 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006191730499267578 length of segment : 30 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 2393 time to create 1 rle with old method : 0.002916097640991211 length of segment : 50 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 2381 time to create 1 rle with old method : 0.0029959678649902344 length of segment : 51 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 2517 time to create 1 rle with old method : 0.003038644790649414 length of segment : 52 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1178 time to create 1 rle with old method : 0.001447439193725586 length of segment : 62 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1209 time to create 1 rle with old method : 0.0015568733215332031 length of segment : 65 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.75859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 5041 time to create 1 rle with old method : 0.005922794342041016 length of segment : 124 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0008630752563476562 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.50078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00011157989501953125 nb_pixel_total : 4825 time to create 1 rle with old method : 0.005522489547729492 length of segment : 143 time for calcul the mask position with numpy : 0.0001747608184814453 nb_pixel_total : 8473 time to create 1 rle with old method : 0.010341882705688477 length of segment : 131 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 993 time to create 1 rle with old method : 0.001201629638671875 length of segment : 68 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 2121 time to create 1 rle with old method : 0.0025110244750976562 length of segment : 112 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003254413604736328 length of segment : 18 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00032019615173339844 length of segment : 21 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003726482391357422 length of segment : 17 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.69375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006363391876220703 length of segment : 17 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1761 time to create 1 rle with old method : 0.0020542144775390625 length of segment : 120 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 657 time to create 1 rle with old method : 0.0008533000946044922 length of segment : 32 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004439353942871094 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 207.00000 molded_images shape: (1, 640, 640, 3) min: -87.84844 max: 73.22734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.88359 max: 151.04531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005884170532226562 length of segment : 33 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003294944763183594 length of segment : 17 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 953 time to create 1 rle with old method : 0.0012333393096923828 length of segment : 75 time for calcul the mask position with numpy : 0.00026917457580566406 nb_pixel_total : 15693 time to create 1 rle with old method : 0.01821422576904297 length of segment : 260 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002148151397705078 length of segment : 13 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 635 time to create 1 rle with old method : 0.0008945465087890625 length of segment : 39 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003180503845214844 length of segment : 15 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 785 time to create 1 rle with old method : 0.0010178089141845703 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.43438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1006 time to create 1 rle with old method : 0.001275777816772461 length of segment : 56 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 12368 time to create 1 rle with old method : 0.014600276947021484 length of segment : 203 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00024008750915527344 length of segment : 8 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 748 time to create 1 rle with old method : 0.000934600830078125 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.56328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1117 time to create 1 rle with old method : 0.001529693603515625 length of segment : 40 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.000637054443359375 length of segment : 27 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00033211708068847656 length of segment : 28 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.0009944438934326172 length of segment : 35 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0008318424224853516 length of segment : 21 time for calcul the mask position with numpy : 0.0001723766326904297 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006749629974365234 length of segment : 59 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 522 time to create 1 rle with old method : 0.0007255077362060547 length of segment : 45 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0011947154998779297 length of segment : 44 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1093 time to create 1 rle with old method : 0.0013427734375 length of segment : 80 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0014493465423583984 length of segment : 29 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0006859302520751953 length of segment : 64 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1333 time to create 1 rle with old method : 0.0016961097717285156 length of segment : 42 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0007982254028320312 length of segment : 61 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0017192363739013672 length of segment : 41 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 250.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 123.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004913806915283203 length of segment : 13 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 1640 time to create 1 rle with old method : 0.0019910335540771484 length of segment : 84 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 716 time to create 1 rle with old method : 0.0009486675262451172 length of segment : 32 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005888938903808594 length of segment : 26 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.00044989585876464844 length of segment : 41 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.00038814544677734375 length of segment : 29 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0012784004211425781 length of segment : 50 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.000415802001953125 length of segment : 28 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0011110305786132812 length of segment : 43 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0012981891632080078 length of segment : 90 time for calcul the mask position with numpy : 0.00016617774963378906 nb_pixel_total : 2466 time to create 1 rle with old method : 0.0029714107513427734 length of segment : 168 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 876 time to create 1 rle with old method : 0.001108407974243164 length of segment : 44 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 57.10391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009167194366455078 nb_pixel_total : 106658 time to create 1 rle with old method : 0.11485123634338379 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.76797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 870 time to create 1 rle with old method : 0.001104116439819336 length of segment : 59 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003643035888671875 length of segment : 23 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.00043845176696777344 length of segment : 18 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002644062042236328 length of segment : 18 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005352497100830078 length of segment : 22 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.94766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.000244140625 length of segment : 11 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001571178436279297 length of segment : 13 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00024628639221191406 length of segment : 12 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00012564659118652344 length of segment : 7 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004425048828125 length of segment : 15 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00025582313537597656 length of segment : 11 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.00010609626770019531 length of segment : 10 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002589225769042969 length of segment : 16 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002739429473876953 length of segment : 15 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 47 time to create 1 rle with old method : 0.00010943412780761719 length of segment : 8 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.0001239776611328125 length of segment : 8 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002491474151611328 length of segment : 15 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00016021728515625 length of segment : 10 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.24844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.001115560531616211 length of segment : 57 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004725456237792969 length of segment : 17 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0005166530609130859 length of segment : 19 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002684593200683594 length of segment : 27 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 733 time to create 1 rle with old method : 0.0009856224060058594 length of segment : 34 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1279 time to create 1 rle with old method : 0.0015795230865478516 length of segment : 75 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00030612945556640625 length of segment : 24 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00015544891357421875 length of segment : 19 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00018143653869628906 length of segment : 15 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0004036426544189453 length of segment : 60 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 837 time to create 1 rle with old method : 0.001077890396118164 length of segment : 36 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1383 time to create 1 rle with old method : 0.0016412734985351562 length of segment : 92 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0016369819641113281 length of segment : 81 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005984306335449219 length of segment : 30 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003979206085205078 length of segment : 21 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1761 time to create 1 rle with old method : 0.0021398067474365234 length of segment : 57 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0009210109710693359 length of segment : 75 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0009481906890869141 length of segment : 53 Detection mask done ! Trying to reset tf kernel 2487260 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4745 tf kernel not reseted sub process len(results) : 486 len(list_Values) 486 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 486 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 486 chid ids of type : 4228 Number RLEs to save : 22811 save missing photos in datou_result : time spend for datou_step_exec : 28.905562162399292 time spend to save output : 4.247312068939209 total time spend for step 1 : 33.1528742313385 step2:brightness Tue Feb 4 03:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738635628_2486630_1334217286_63f28516f60a6859462ccfccc9b4c8ee.jpg treat image : temp/1738635628_2486630_1334216556_01aef62ac8b12cebb0a3418b50a79db6.jpg treat image : temp/1738635628_2486630_1334216554_b43632da25c9c2eef608fca46a3c56bb.jpg treat image : temp/1738635628_2486630_1334216552_8bdd9d6a8b39edcfe4ef7351172ad9bc.jpg treat image : temp/1738635628_2486630_1334216549_cc6985e511912b62e06a6958711ccc58.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.01612067222595215 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.13169479370117188 save missing photos in datou_result : time spend for datou_step_exec : 1.1963798999786377 time spend to save output : 0.1524958610534668 total time spend for step 2 : 1.3488757610321045 step3:blur_detection Tue Feb 4 03:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738635628_2486630_1334217286_63f28516f60a6859462ccfccc9b4c8ee.jpg resize: (1080, 1920) 1334217286 -7.960085182726687 treat image : temp/1738635628_2486630_1334216556_01aef62ac8b12cebb0a3418b50a79db6.jpg resize: (1080, 1920) 1334216556 -7.956346478412187 treat image : temp/1738635628_2486630_1334216554_b43632da25c9c2eef608fca46a3c56bb.jpg resize: (1080, 1920) 1334216554 -7.948476159060896 treat image : temp/1738635628_2486630_1334216552_8bdd9d6a8b39edcfe4ef7351172ad9bc.jpg resize: (1080, 1920) 1334216552 -7.945079271240314 treat image : temp/1738635628_2486630_1334216549_cc6985e511912b62e06a6958711ccc58.jpg resize: (1080, 1920) 1334216549 -7.946252598374099 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.012611865997314453 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.012529373168945312 save missing photos in datou_result : time spend for datou_step_exec : 4.357000112533569 time spend to save output : 0.030435562133789062 total time spend for step 3 : 4.387435674667358 step4:rle_unique_nms_with_priority Tue Feb 4 03:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 486 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 101 nb_hashtags : 6 time to prepare the origin masks : 1.062720775604248 time for calcul the mask position with numpy : 0.18317222595214844 nb_pixel_total : 1807911 time to create 1 rle with new method : 0.18240141868591309 time for calcul the mask position with numpy : 0.008709907531738281 nb_pixel_total : 256 time to create 1 rle with old method : 0.00032591819763183594 time for calcul the mask position with numpy : 0.009784460067749023 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0024929046630859375 time for calcul the mask position with numpy : 0.00860285758972168 nb_pixel_total : 92 time to create 1 rle with old method : 0.00013136863708496094 time for calcul the mask position with numpy : 0.008460044860839844 nb_pixel_total : 4718 time to create 1 rle with old method : 0.005751848220825195 time for calcul the mask position with numpy : 0.008606672286987305 nb_pixel_total : 989 time to create 1 rle with old method : 0.0011873245239257812 time for calcul the mask position with numpy : 0.00850367546081543 nb_pixel_total : 952 time to create 1 rle with old method : 0.0011632442474365234 time for calcul the mask position with numpy : 0.008459806442260742 nb_pixel_total : 873 time to create 1 rle with old method : 0.0010464191436767578 time for calcul the mask position with numpy : 0.008878469467163086 nb_pixel_total : 1732 time to create 1 rle with old method : 0.0020635128021240234 time for calcul the mask position with numpy : 0.008527040481567383 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003724098205566406 time for calcul the mask position with numpy : 0.008510828018188477 nb_pixel_total : 12 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.008552312850952148 nb_pixel_total : 52 time to create 1 rle with old method : 0.00010251998901367188 time for calcul the mask position with numpy : 0.008676290512084961 nb_pixel_total : 50 time to create 1 rle with old method : 0.0001087188720703125 time for calcul the mask position with numpy : 0.009351491928100586 nb_pixel_total : 2684 time to create 1 rle with old method : 0.0031414031982421875 time for calcul the mask position with numpy : 0.009039878845214844 nb_pixel_total : 46611 time to create 1 rle with old method : 0.05056142807006836 time for calcul the mask position with numpy : 0.008506536483764648 nb_pixel_total : 866 time to create 1 rle with old method : 0.0010151863098144531 time for calcul the mask position with numpy : 0.00845646858215332 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006222724914550781 time for calcul the mask position with numpy : 0.008387327194213867 nb_pixel_total : 20 time to create 1 rle with old method : 3.9577484130859375e-05 time for calcul the mask position with numpy : 0.008362531661987305 nb_pixel_total : 241 time to create 1 rle with old method : 0.0002739429473876953 time for calcul the mask position with numpy : 0.008098363876342773 nb_pixel_total : 277 time to create 1 rle with old method : 0.0002980232238769531 time for calcul the mask position with numpy : 0.008099079132080078 nb_pixel_total : 775 time to create 1 rle with old method : 0.0008397102355957031 time for calcul the mask position with numpy : 0.008426189422607422 nb_pixel_total : 191 time to create 1 rle with old method : 0.00028324127197265625 time for calcul the mask position with numpy : 0.008377790451049805 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005185604095458984 time for calcul the mask position with numpy : 0.00843954086303711 nb_pixel_total : 4836 time to create 1 rle with old method : 0.005553483963012695 time for calcul the mask position with numpy : 0.008171319961547852 nb_pixel_total : 9098 time to create 1 rle with old method : 0.010370016098022461 time for calcul the mask position with numpy : 0.008223533630371094 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0012421607971191406 time for calcul the mask position with numpy : 0.008211612701416016 nb_pixel_total : 478 time to create 1 rle with old method : 0.0005784034729003906 time for calcul the mask position with numpy : 0.008128166198730469 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004546642303466797 time for calcul the mask position with numpy : 0.008227109909057617 nb_pixel_total : 501 time to create 1 rle with old method : 0.0005311965942382812 time for calcul the mask position with numpy : 0.008125543594360352 nb_pixel_total : 226 time to create 1 rle with old method : 0.00026679039001464844 time for calcul the mask position with numpy : 0.008163928985595703 nb_pixel_total : 828 time to create 1 rle with old method : 0.0009326934814453125 time for calcul the mask position with numpy : 0.007893085479736328 nb_pixel_total : 620 time to create 1 rle with old method : 0.0007166862487792969 time for calcul the mask position with numpy : 0.007910490036010742 nb_pixel_total : 167 time to create 1 rle with old method : 0.00021457672119140625 time for calcul the mask position with numpy : 0.00801396369934082 nb_pixel_total : 16697 time to create 1 rle with old method : 0.018798828125 time for calcul the mask position with numpy : 0.008170604705810547 nb_pixel_total : 1318 time to create 1 rle with old method : 0.0014233589172363281 time for calcul the mask position with numpy : 0.00812673568725586 nb_pixel_total : 848 time to create 1 rle with old method : 0.0009729862213134766 time for calcul the mask position with numpy : 0.008058547973632812 nb_pixel_total : 57 time to create 1 rle with old method : 9.5367431640625e-05 time for calcul the mask position with numpy : 0.008044719696044922 nb_pixel_total : 40 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.008050680160522461 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005588531494140625 time for calcul the mask position with numpy : 0.008193016052246094 nb_pixel_total : 4 time to create 1 rle with old method : 2.1696090698242188e-05 time for calcul the mask position with numpy : 0.008012533187866211 nb_pixel_total : 285 time to create 1 rle with old method : 0.00032448768615722656 time for calcul the mask position with numpy : 0.008028507232666016 nb_pixel_total : 807 time to create 1 rle with old method : 0.0009136199951171875 time for calcul the mask position with numpy : 0.007956266403198242 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005898475646972656 time for calcul the mask position with numpy : 0.008063077926635742 nb_pixel_total : 202 time to create 1 rle with old method : 0.00022673606872558594 time for calcul the mask position with numpy : 0.008178234100341797 nb_pixel_total : 402 time to create 1 rle with old method : 0.00047206878662109375 time for calcul the mask position with numpy : 0.008179903030395508 nb_pixel_total : 804 time to create 1 rle with old method : 0.0009191036224365234 time for calcul the mask position with numpy : 0.008412361145019531 nb_pixel_total : 6605 time to create 1 rle with old method : 0.007496356964111328 time for calcul the mask position with numpy : 0.008290290832519531 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0014307498931884766 time for calcul the mask position with numpy : 0.008157014846801758 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005984306335449219 time for calcul the mask position with numpy : 0.00815892219543457 nb_pixel_total : 1664 time to create 1 rle with old method : 0.0018811225891113281 time for calcul the mask position with numpy : 0.00815439224243164 nb_pixel_total : 734 time to create 1 rle with old method : 0.0008499622344970703 time for calcul the mask position with numpy : 0.008115291595458984 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005533695220947266 time for calcul the mask position with numpy : 0.008193016052246094 nb_pixel_total : 741 time to create 1 rle with old method : 0.0008835792541503906 time for calcul the mask position with numpy : 0.008179664611816406 nb_pixel_total : 836 time to create 1 rle with old method : 0.0009014606475830078 time for calcul the mask position with numpy : 0.00806570053100586 nb_pixel_total : 1216 time to create 1 rle with old method : 0.0014183521270751953 time for calcul the mask position with numpy : 0.0080413818359375 nb_pixel_total : 60 time to create 1 rle with old method : 0.00010228157043457031 time for calcul the mask position with numpy : 0.008273124694824219 nb_pixel_total : 447 time to create 1 rle with old method : 0.0005333423614501953 time for calcul the mask position with numpy : 0.00832366943359375 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002586841583251953 time for calcul the mask position with numpy : 0.008300542831420898 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002276897430419922 time for calcul the mask position with numpy : 0.008063077926635742 nb_pixel_total : 1180 time to create 1 rle with old method : 0.0013616085052490234 time for calcul the mask position with numpy : 0.008031129837036133 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005609989166259766 time for calcul the mask position with numpy : 0.008127212524414062 nb_pixel_total : 865 time to create 1 rle with old method : 0.0009152889251708984 time for calcul the mask position with numpy : 0.008257389068603516 nb_pixel_total : 372 time to create 1 rle with old method : 0.00045943260192871094 time for calcul the mask position with numpy : 0.008034229278564453 nb_pixel_total : 1586 time to create 1 rle with old method : 0.0017993450164794922 time for calcul the mask position with numpy : 0.008167743682861328 nb_pixel_total : 335 time to create 1 rle with old method : 0.0003991127014160156 time for calcul the mask position with numpy : 0.00858163833618164 nb_pixel_total : 106374 time to create 1 rle with old method : 0.1114356517791748 time for calcul the mask position with numpy : 0.008044958114624023 nb_pixel_total : 582 time to create 1 rle with old method : 0.0006406307220458984 time for calcul the mask position with numpy : 0.008102655410766602 nb_pixel_total : 104 time to create 1 rle with old method : 0.00012564659118652344 time for calcul the mask position with numpy : 0.008052825927734375 nb_pixel_total : 712 time to create 1 rle with old method : 0.0007717609405517578 time for calcul the mask position with numpy : 0.008051872253417969 nb_pixel_total : 149 time to create 1 rle with old method : 0.0001804828643798828 time for calcul the mask position with numpy : 0.00801992416381836 nb_pixel_total : 24490 time to create 1 rle with old method : 0.02544093132019043 time for calcul the mask position with numpy : 0.00795888900756836 nb_pixel_total : 328 time to create 1 rle with old method : 0.00035881996154785156 time for calcul the mask position with numpy : 0.007943868637084961 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002143383026123047 time for calcul the mask position with numpy : 0.008008718490600586 nb_pixel_total : 295 time to create 1 rle with old method : 0.00032448768615722656 time for calcul the mask position with numpy : 0.00820779800415039 nb_pixel_total : 144 time to create 1 rle with old method : 0.00018453598022460938 time for calcul the mask position with numpy : 0.007925271987915039 nb_pixel_total : 122 time to create 1 rle with old method : 0.00014710426330566406 time for calcul the mask position with numpy : 0.008012533187866211 nb_pixel_total : 118 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.007914304733276367 nb_pixel_total : 201 time to create 1 rle with old method : 0.000225067138671875 time for calcul the mask position with numpy : 0.008050918579101562 nb_pixel_total : 158 time to create 1 rle with old method : 0.00018477439880371094 time for calcul the mask position with numpy : 0.007926225662231445 nb_pixel_total : 667 time to create 1 rle with old method : 0.0007207393646240234 time for calcul the mask position with numpy : 0.007978439331054688 nb_pixel_total : 1106 time to create 1 rle with old method : 0.0012807846069335938 time for calcul the mask position with numpy : 0.008173227310180664 nb_pixel_total : 267 time to create 1 rle with old method : 0.00031495094299316406 time for calcul the mask position with numpy : 0.00805354118347168 nb_pixel_total : 93 time to create 1 rle with old method : 0.00011444091796875 time for calcul the mask position with numpy : 0.008159399032592773 nb_pixel_total : 166 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.007955789566040039 nb_pixel_total : 134 time to create 1 rle with old method : 0.00017380714416503906 time for calcul the mask position with numpy : 0.007977962493896484 nb_pixel_total : 39 time to create 1 rle with old method : 6.580352783203125e-05 time for calcul the mask position with numpy : 0.008018255233764648 nb_pixel_total : 940 time to create 1 rle with old method : 0.0010387897491455078 time for calcul the mask position with numpy : 0.008227825164794922 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001728534698486328 time for calcul the mask position with numpy : 0.008114099502563477 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006129741668701172 time for calcul the mask position with numpy : 0.008413314819335938 nb_pixel_total : 305 time to create 1 rle with old method : 0.0005276203155517578 time for calcul the mask position with numpy : 0.009611368179321289 nb_pixel_total : 658 time to create 1 rle with old method : 0.001081705093383789 time for calcul the mask position with numpy : 0.009670019149780273 nb_pixel_total : 63 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.009662628173828125 nb_pixel_total : 408 time to create 1 rle with old method : 0.000682830810546875 time for calcul the mask position with numpy : 0.009610414505004883 nb_pixel_total : 193 time to create 1 rle with old method : 0.0003249645233154297 time for calcul the mask position with numpy : 0.009612083435058594 nb_pixel_total : 282 time to create 1 rle with old method : 0.00046896934509277344 time for calcul the mask position with numpy : 0.00966334342956543 nb_pixel_total : 239 time to create 1 rle with old method : 0.00040793418884277344 time for calcul the mask position with numpy : 0.009649991989135742 nb_pixel_total : 82 time to create 1 rle with old method : 0.00015020370483398438 time for calcul the mask position with numpy : 0.009262323379516602 nb_pixel_total : 278 time to create 1 rle with old method : 0.0002944469451904297 time for calcul the mask position with numpy : 0.008303165435791016 nb_pixel_total : 209 time to create 1 rle with old method : 0.0002243518829345703 time for calcul the mask position with numpy : 0.00823354721069336 nb_pixel_total : 142 time to create 1 rle with old method : 0.00018286705017089844 time for calcul the mask position with numpy : 0.008173942565917969 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002357959747314453 time for calcul the mask position with numpy : 0.008152246475219727 nb_pixel_total : 75 time to create 1 rle with old method : 9.465217590332031e-05 create new chi : 1.5125994682312012 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.009855508804321289 batch 1 Loaded 102 chid ids of type : 4230 Number RLEs to save : 9670 TO DO : save crop sub photo not yet done ! save time : 1.9479169845581055 nb_obj : 92 nb_hashtags : 4 time to prepare the origin masks : 2.02046537399292 time for calcul the mask position with numpy : 0.0457911491394043 nb_pixel_total : 1932450 time to create 1 rle with new method : 0.07774066925048828 time for calcul the mask position with numpy : 0.007527351379394531 nb_pixel_total : 2054 time to create 1 rle with old method : 0.0023877620697021484 time for calcul the mask position with numpy : 0.007268190383911133 nb_pixel_total : 5100 time to create 1 rle with old method : 0.007028341293334961 time for calcul the mask position with numpy : 0.008211374282836914 nb_pixel_total : 994 time to create 1 rle with old method : 0.0013275146484375 time for calcul the mask position with numpy : 0.007864713668823242 nb_pixel_total : 896 time to create 1 rle with old method : 0.001280069351196289 time for calcul the mask position with numpy : 0.008272886276245117 nb_pixel_total : 36 time to create 1 rle with old method : 0.0001246929168701172 time for calcul the mask position with numpy : 0.007650852203369141 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0025339126586914062 time for calcul the mask position with numpy : 0.007748842239379883 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004036426544189453 time for calcul the mask position with numpy : 0.00715327262878418 nb_pixel_total : 49 time to create 1 rle with old method : 0.00011849403381347656 time for calcul the mask position with numpy : 0.0077855587005615234 nb_pixel_total : 8 time to create 1 rle with old method : 5.2928924560546875e-05 time for calcul the mask position with numpy : 0.00805211067199707 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001723766326904297 time for calcul the mask position with numpy : 0.007731199264526367 nb_pixel_total : 2317 time to create 1 rle with old method : 0.003197193145751953 time for calcul the mask position with numpy : 0.007382869720458984 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003917217254638672 time for calcul the mask position with numpy : 0.007089376449584961 nb_pixel_total : 636 time to create 1 rle with old method : 0.0007517337799072266 time for calcul the mask position with numpy : 0.007058858871459961 nb_pixel_total : 243 time to create 1 rle with old method : 0.00036144256591796875 time for calcul the mask position with numpy : 0.007012128829956055 nb_pixel_total : 810 time to create 1 rle with old method : 0.0010650157928466797 time for calcul the mask position with numpy : 0.00775599479675293 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003223419189453125 time for calcul the mask position with numpy : 0.007467985153198242 nb_pixel_total : 427 time to create 1 rle with old method : 0.0006930828094482422 time for calcul the mask position with numpy : 0.007411003112792969 nb_pixel_total : 3618 time to create 1 rle with old method : 0.003925323486328125 time for calcul the mask position with numpy : 0.006165027618408203 nb_pixel_total : 5021 time to create 1 rle with old method : 0.005522489547729492 time for calcul the mask position with numpy : 0.006325244903564453 nb_pixel_total : 8885 time to create 1 rle with old method : 0.009454488754272461 time for calcul the mask position with numpy : 0.006239414215087891 nb_pixel_total : 113 time to create 1 rle with old method : 0.00015354156494140625 time for calcul the mask position with numpy : 0.0064847469329833984 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005333423614501953 time for calcul the mask position with numpy : 0.006273508071899414 nb_pixel_total : 636 time to create 1 rle with old method : 0.0007166862487792969 time for calcul the mask position with numpy : 0.007371425628662109 nb_pixel_total : 407 time to create 1 rle with old method : 0.000598907470703125 time for calcul the mask position with numpy : 0.007602691650390625 nb_pixel_total : 361 time to create 1 rle with old method : 0.0007143020629882812 time for calcul the mask position with numpy : 0.008758306503295898 nb_pixel_total : 682 time to create 1 rle with old method : 0.0013530254364013672 time for calcul the mask position with numpy : 0.008626461029052734 nb_pixel_total : 1134 time to create 1 rle with old method : 0.002301931381225586 time for calcul the mask position with numpy : 0.008101224899291992 nb_pixel_total : 50 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.007021188735961914 nb_pixel_total : 816 time to create 1 rle with old method : 0.0013508796691894531 time for calcul the mask position with numpy : 0.007338047027587891 nb_pixel_total : 501 time to create 1 rle with old method : 0.000843048095703125 time for calcul the mask position with numpy : 0.006696224212646484 nb_pixel_total : 15817 time to create 1 rle with old method : 0.02409529685974121 time for calcul the mask position with numpy : 0.0065479278564453125 nb_pixel_total : 1290 time to create 1 rle with old method : 0.0014545917510986328 time for calcul the mask position with numpy : 0.00650334358215332 nb_pixel_total : 868 time to create 1 rle with old method : 0.0010318756103515625 time for calcul the mask position with numpy : 0.006455421447753906 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005850791931152344 time for calcul the mask position with numpy : 0.00676274299621582 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007121562957763672 time for calcul the mask position with numpy : 0.0070438385009765625 nb_pixel_total : 280 time to create 1 rle with old method : 0.00031256675720214844 time for calcul the mask position with numpy : 0.007010936737060547 nb_pixel_total : 211 time to create 1 rle with old method : 0.00036215782165527344 time for calcul the mask position with numpy : 0.008238077163696289 nb_pixel_total : 17463 time to create 1 rle with old method : 0.023206233978271484 time for calcul the mask position with numpy : 0.007724285125732422 nb_pixel_total : 223 time to create 1 rle with old method : 0.0002646446228027344 time for calcul the mask position with numpy : 0.0076751708984375 nb_pixel_total : 472 time to create 1 rle with old method : 0.0007050037384033203 time for calcul the mask position with numpy : 0.0072553157806396484 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009660720825195312 time for calcul the mask position with numpy : 0.007685184478759766 nb_pixel_total : 741 time to create 1 rle with old method : 0.0010983943939208984 time for calcul the mask position with numpy : 0.008045196533203125 nb_pixel_total : 1073 time to create 1 rle with old method : 0.0016551017761230469 time for calcul the mask position with numpy : 0.00795745849609375 nb_pixel_total : 1877 time to create 1 rle with old method : 0.0025479793548583984 time for calcul the mask position with numpy : 0.007231473922729492 nb_pixel_total : 587 time to create 1 rle with old method : 0.0008459091186523438 time for calcul the mask position with numpy : 0.007391691207885742 nb_pixel_total : 1352 time to create 1 rle with old method : 0.001894235610961914 time for calcul the mask position with numpy : 0.007348537445068359 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003032684326171875 time for calcul the mask position with numpy : 0.007372856140136719 nb_pixel_total : 1165 time to create 1 rle with old method : 0.0015625953674316406 time for calcul the mask position with numpy : 0.007642507553100586 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005064010620117188 time for calcul the mask position with numpy : 0.007639646530151367 nb_pixel_total : 934 time to create 1 rle with old method : 0.0012183189392089844 time for calcul the mask position with numpy : 0.007668018341064453 nb_pixel_total : 1652 time to create 1 rle with old method : 0.0022954940795898438 time for calcul the mask position with numpy : 0.007841348648071289 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002033710479736328 time for calcul the mask position with numpy : 0.007831573486328125 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005879402160644531 time for calcul the mask position with numpy : 0.008333683013916016 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004787445068359375 time for calcul the mask position with numpy : 0.00830698013305664 nb_pixel_total : 142 time to create 1 rle with old method : 0.00023818016052246094 time for calcul the mask position with numpy : 0.009264469146728516 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004761219024658203 time for calcul the mask position with numpy : 0.011142492294311523 nb_pixel_total : 522 time to create 1 rle with old method : 0.0008180141448974609 time for calcul the mask position with numpy : 0.01012730598449707 nb_pixel_total : 325 time to create 1 rle with old method : 0.0003871917724609375 time for calcul the mask position with numpy : 0.014541149139404297 nb_pixel_total : 3584 time to create 1 rle with old method : 0.004778623580932617 time for calcul the mask position with numpy : 0.009833812713623047 nb_pixel_total : 112 time to create 1 rle with old method : 0.0002079010009765625 time for calcul the mask position with numpy : 0.007682323455810547 nb_pixel_total : 934 time to create 1 rle with old method : 0.001371145248413086 time for calcul the mask position with numpy : 0.007561206817626953 nb_pixel_total : 149 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.0076940059661865234 nb_pixel_total : 36883 time to create 1 rle with old method : 0.04772615432739258 time for calcul the mask position with numpy : 0.007634401321411133 nb_pixel_total : 604 time to create 1 rle with old method : 0.0009474754333496094 time for calcul the mask position with numpy : 0.008331298828125 nb_pixel_total : 435 time to create 1 rle with old method : 0.0006399154663085938 time for calcul the mask position with numpy : 0.008014202117919922 nb_pixel_total : 185 time to create 1 rle with old method : 0.00031876564025878906 time for calcul the mask position with numpy : 0.007848024368286133 nb_pixel_total : 320 time to create 1 rle with old method : 0.00042819976806640625 time for calcul the mask position with numpy : 0.007558345794677734 nb_pixel_total : 154 time to create 1 rle with old method : 0.00025582313537597656 time for calcul the mask position with numpy : 0.0072021484375 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004563331604003906 time for calcul the mask position with numpy : 0.008009910583496094 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004372596740722656 time for calcul the mask position with numpy : 0.008012056350708008 nb_pixel_total : 132 time to create 1 rle with old method : 0.00023674964904785156 time for calcul the mask position with numpy : 0.0134124755859375 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002605915069580078 time for calcul the mask position with numpy : 0.012866497039794922 nb_pixel_total : 216 time to create 1 rle with old method : 0.00034999847412109375 time for calcul the mask position with numpy : 0.012812376022338867 nb_pixel_total : 866 time to create 1 rle with old method : 0.001127004623413086 time for calcul the mask position with numpy : 0.011624574661254883 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005681514739990234 time for calcul the mask position with numpy : 0.009859800338745117 nb_pixel_total : 268 time to create 1 rle with old method : 0.00035762786865234375 time for calcul the mask position with numpy : 0.00983285903930664 nb_pixel_total : 90 time to create 1 rle with old method : 0.00012946128845214844 time for calcul the mask position with numpy : 0.009444952011108398 nb_pixel_total : 158 time to create 1 rle with old method : 0.00020599365234375 time for calcul the mask position with numpy : 0.009924173355102539 nb_pixel_total : 71 time to create 1 rle with old method : 0.00010538101196289062 time for calcul the mask position with numpy : 0.009655475616455078 nb_pixel_total : 170 time to create 1 rle with old method : 0.00020837783813476562 time for calcul the mask position with numpy : 0.009716987609863281 nb_pixel_total : 1494 time to create 1 rle with old method : 0.00168609619140625 time for calcul the mask position with numpy : 0.010444402694702148 nb_pixel_total : 994 time to create 1 rle with old method : 0.0012822151184082031 time for calcul the mask position with numpy : 0.012113332748413086 nb_pixel_total : 434 time to create 1 rle with old method : 0.0006031990051269531 time for calcul the mask position with numpy : 0.011579036712646484 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006620883941650391 time for calcul the mask position with numpy : 0.01058053970336914 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007817745208740234 time for calcul the mask position with numpy : 0.01348423957824707 nb_pixel_total : 326 time to create 1 rle with old method : 0.00048279762268066406 time for calcul the mask position with numpy : 0.012207269668579102 nb_pixel_total : 14 time to create 1 rle with old method : 4.982948303222656e-05 time for calcul the mask position with numpy : 0.008279085159301758 nb_pixel_total : 196 time to create 1 rle with old method : 0.00029349327087402344 time for calcul the mask position with numpy : 0.007101774215698242 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003750324249267578 time for calcul the mask position with numpy : 0.007311582565307617 nb_pixel_total : 70 time to create 1 rle with old method : 0.00011515617370605469 time for calcul the mask position with numpy : 0.007358551025390625 nb_pixel_total : 207 time to create 1 rle with old method : 0.000255584716796875 time for calcul the mask position with numpy : 0.006100893020629883 nb_pixel_total : 134 time to create 1 rle with old method : 0.00016736984252929688 create new chi : 1.080824375152588 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0012867450714111328 batch 1 Loaded 93 chid ids of type : 4230 Number RLEs to save : 9268 TO DO : save crop sub photo not yet done ! save time : 1.3130080699920654 nb_obj : 96 nb_hashtags : 6 time to prepare the origin masks : 1.2272577285766602 time for calcul the mask position with numpy : 0.02817535400390625 nb_pixel_total : 1878242 time to create 1 rle with new method : 0.12566447257995605 time for calcul the mask position with numpy : 0.00645136833190918 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002474784851074219 time for calcul the mask position with numpy : 0.006270647048950195 nb_pixel_total : 1786 time to create 1 rle with old method : 0.0020399093627929688 time for calcul the mask position with numpy : 0.006463289260864258 nb_pixel_total : 4973 time to create 1 rle with old method : 0.0059664249420166016 time for calcul the mask position with numpy : 0.0064182281494140625 nb_pixel_total : 509 time to create 1 rle with old method : 0.0007681846618652344 time for calcul the mask position with numpy : 0.006052494049072266 nb_pixel_total : 887 time to create 1 rle with old method : 0.001055002212524414 time for calcul the mask position with numpy : 0.006189823150634766 nb_pixel_total : 32 time to create 1 rle with old method : 6.723403930664062e-05 time for calcul the mask position with numpy : 0.0063018798828125 nb_pixel_total : 370 time to create 1 rle with old method : 0.00045013427734375 time for calcul the mask position with numpy : 0.0074918270111083984 nb_pixel_total : 27 time to create 1 rle with old method : 7.581710815429688e-05 time for calcul the mask position with numpy : 0.006958484649658203 nb_pixel_total : 33 time to create 1 rle with old method : 0.00011301040649414062 time for calcul the mask position with numpy : 0.006402015686035156 nb_pixel_total : 230 time to create 1 rle with old method : 0.00036525726318359375 time for calcul the mask position with numpy : 0.0062901973724365234 nb_pixel_total : 2383 time to create 1 rle with old method : 0.002650022506713867 time for calcul the mask position with numpy : 0.0060710906982421875 nb_pixel_total : 654 time to create 1 rle with old method : 0.0007586479187011719 time for calcul the mask position with numpy : 0.006163358688354492 nb_pixel_total : 217 time to create 1 rle with old method : 0.000270843505859375 time for calcul the mask position with numpy : 0.006480693817138672 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0012297630310058594 time for calcul the mask position with numpy : 0.006024837493896484 nb_pixel_total : 210 time to create 1 rle with old method : 0.00024628639221191406 time for calcul the mask position with numpy : 0.0061571598052978516 nb_pixel_total : 2075 time to create 1 rle with old method : 0.0022454261779785156 time for calcul the mask position with numpy : 0.0062427520751953125 nb_pixel_total : 766 time to create 1 rle with old method : 0.000926971435546875 time for calcul the mask position with numpy : 0.0065729618072509766 nb_pixel_total : 5 time to create 1 rle with old method : 6.031990051269531e-05 time for calcul the mask position with numpy : 0.0065250396728515625 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002429485321044922 time for calcul the mask position with numpy : 0.010048627853393555 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005140304565429688 time for calcul the mask position with numpy : 0.010126352310180664 nb_pixel_total : 5883 time to create 1 rle with old method : 0.00638890266418457 time for calcul the mask position with numpy : 0.010084152221679688 nb_pixel_total : 9252 time to create 1 rle with old method : 0.010114669799804688 time for calcul the mask position with numpy : 0.009920358657836914 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001552104949951172 time for calcul the mask position with numpy : 0.010494470596313477 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005333423614501953 time for calcul the mask position with numpy : 0.007236957550048828 nb_pixel_total : 2076 time to create 1 rle with old method : 0.0023267269134521484 time for calcul the mask position with numpy : 0.006983518600463867 nb_pixel_total : 1125 time to create 1 rle with old method : 0.0012912750244140625 time for calcul the mask position with numpy : 0.0068399906158447266 nb_pixel_total : 439 time to create 1 rle with old method : 0.0004992485046386719 time for calcul the mask position with numpy : 0.0067555904388427734 nb_pixel_total : 864 time to create 1 rle with old method : 0.0010485649108886719 time for calcul the mask position with numpy : 0.007400035858154297 nb_pixel_total : 475 time to create 1 rle with old method : 0.0007312297821044922 time for calcul the mask position with numpy : 0.00808572769165039 nb_pixel_total : 223 time to create 1 rle with old method : 0.00026106834411621094 time for calcul the mask position with numpy : 0.0059566497802734375 nb_pixel_total : 723 time to create 1 rle with old method : 0.0008397102355957031 time for calcul the mask position with numpy : 0.005730152130126953 nb_pixel_total : 141 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.0061113834381103516 nb_pixel_total : 864 time to create 1 rle with old method : 0.0009829998016357422 time for calcul the mask position with numpy : 0.006097078323364258 nb_pixel_total : 148 time to create 1 rle with old method : 0.0001926422119140625 time for calcul the mask position with numpy : 0.0063784122467041016 nb_pixel_total : 541 time to create 1 rle with old method : 0.0005745887756347656 time for calcul the mask position with numpy : 0.006166219711303711 nb_pixel_total : 16673 time to create 1 rle with old method : 0.017433643341064453 time for calcul the mask position with numpy : 0.0066912174224853516 nb_pixel_total : 1373 time to create 1 rle with old method : 0.001500844955444336 time for calcul the mask position with numpy : 0.006677865982055664 nb_pixel_total : 846 time to create 1 rle with old method : 0.0009257793426513672 time for calcul the mask position with numpy : 0.0059070587158203125 nb_pixel_total : 78 time to create 1 rle with old method : 0.00014090538024902344 time for calcul the mask position with numpy : 0.006017446517944336 nb_pixel_total : 601 time to create 1 rle with old method : 0.00072479248046875 time for calcul the mask position with numpy : 0.0069234371185302734 nb_pixel_total : 23 time to create 1 rle with old method : 5.364418029785156e-05 time for calcul the mask position with numpy : 0.005956411361694336 nb_pixel_total : 290 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.005846261978149414 nb_pixel_total : 581 time to create 1 rle with old method : 0.0006704330444335938 time for calcul the mask position with numpy : 0.006021738052368164 nb_pixel_total : 853 time to create 1 rle with old method : 0.0009596347808837891 time for calcul the mask position with numpy : 0.0059773921966552734 nb_pixel_total : 205 time to create 1 rle with old method : 0.00026726722717285156 time for calcul the mask position with numpy : 0.006119489669799805 nb_pixel_total : 431 time to create 1 rle with old method : 0.0004591941833496094 time for calcul the mask position with numpy : 0.0060765743255615234 nb_pixel_total : 1040 time to create 1 rle with old method : 0.0011479854583740234 time for calcul the mask position with numpy : 0.005980491638183594 nb_pixel_total : 877 time to create 1 rle with old method : 0.0010213851928710938 time for calcul the mask position with numpy : 0.006922721862792969 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005300045013427734 time for calcul the mask position with numpy : 0.005892276763916016 nb_pixel_total : 1349 time to create 1 rle with old method : 0.0015022754669189453 time for calcul the mask position with numpy : 0.0057544708251953125 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003006458282470703 time for calcul the mask position with numpy : 0.0059757232666015625 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002589225769042969 time for calcul the mask position with numpy : 0.005957603454589844 nb_pixel_total : 1302 time to create 1 rle with old method : 0.001434326171875 time for calcul the mask position with numpy : 0.005827188491821289 nb_pixel_total : 407 time to create 1 rle with old method : 0.000431060791015625 time for calcul the mask position with numpy : 0.005827426910400391 nb_pixel_total : 879 time to create 1 rle with old method : 0.0010616779327392578 time for calcul the mask position with numpy : 0.005734920501708984 nb_pixel_total : 1608 time to create 1 rle with old method : 0.0017533302307128906 time for calcul the mask position with numpy : 0.005780935287475586 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001308917999267578 time for calcul the mask position with numpy : 0.005743265151977539 nb_pixel_total : 284 time to create 1 rle with old method : 0.0004208087921142578 time for calcul the mask position with numpy : 0.0063250064849853516 nb_pixel_total : 106504 time to create 1 rle with old method : 0.11032605171203613 time for calcul the mask position with numpy : 0.006265163421630859 nb_pixel_total : 348 time to create 1 rle with old method : 0.0003960132598876953 time for calcul the mask position with numpy : 0.005812406539916992 nb_pixel_total : 127 time to create 1 rle with old method : 0.00015974044799804688 time for calcul the mask position with numpy : 0.00614619255065918 nb_pixel_total : 4853 time to create 1 rle with old method : 0.005370378494262695 time for calcul the mask position with numpy : 0.00595402717590332 nb_pixel_total : 282 time to create 1 rle with old method : 0.00036525726318359375 time for calcul the mask position with numpy : 0.006002902984619141 nb_pixel_total : 105 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.006043672561645508 nb_pixel_total : 676 time to create 1 rle with old method : 0.0007829666137695312 time for calcul the mask position with numpy : 0.0061321258544921875 nb_pixel_total : 655 time to create 1 rle with old method : 0.0007679462432861328 time for calcul the mask position with numpy : 0.006053447723388672 nb_pixel_total : 372 time to create 1 rle with old method : 0.0003876686096191406 time for calcul the mask position with numpy : 0.006135225296020508 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002219676971435547 time for calcul the mask position with numpy : 0.005963563919067383 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003402233123779297 time for calcul the mask position with numpy : 0.005845546722412109 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002033710479736328 time for calcul the mask position with numpy : 0.005917072296142578 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001475811004638672 time for calcul the mask position with numpy : 0.0057315826416015625 nb_pixel_total : 105 time to create 1 rle with old method : 0.000152587890625 time for calcul the mask position with numpy : 0.005778074264526367 nb_pixel_total : 864 time to create 1 rle with old method : 0.0009534358978271484 time for calcul the mask position with numpy : 0.005968570709228516 nb_pixel_total : 430 time to create 1 rle with old method : 0.00047779083251953125 time for calcul the mask position with numpy : 0.006161928176879883 nb_pixel_total : 1135 time to create 1 rle with old method : 0.0012691020965576172 time for calcul the mask position with numpy : 0.006112098693847656 nb_pixel_total : 577 time to create 1 rle with old method : 0.0006508827209472656 time for calcul the mask position with numpy : 0.006392002105712891 nb_pixel_total : 291 time to create 1 rle with old method : 0.0005195140838623047 time for calcul the mask position with numpy : 0.006460666656494141 nb_pixel_total : 94 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.00668644905090332 nb_pixel_total : 141 time to create 1 rle with old method : 0.00026154518127441406 time for calcul the mask position with numpy : 0.006731986999511719 nb_pixel_total : 73 time to create 1 rle with old method : 0.00019741058349609375 time for calcul the mask position with numpy : 0.00677490234375 nb_pixel_total : 345 time to create 1 rle with old method : 0.0006024837493896484 time for calcul the mask position with numpy : 0.006515979766845703 nb_pixel_total : 784 time to create 1 rle with old method : 0.0013015270233154297 time for calcul the mask position with numpy : 0.006489276885986328 nb_pixel_total : 74 time to create 1 rle with old method : 0.00019288063049316406 time for calcul the mask position with numpy : 0.006567239761352539 nb_pixel_total : 903 time to create 1 rle with old method : 0.0015282630920410156 time for calcul the mask position with numpy : 0.006609439849853516 nb_pixel_total : 905 time to create 1 rle with old method : 0.0015256404876708984 time for calcul the mask position with numpy : 0.00669550895690918 nb_pixel_total : 337 time to create 1 rle with old method : 0.0005867481231689453 time for calcul the mask position with numpy : 0.006564617156982422 nb_pixel_total : 667 time to create 1 rle with old method : 0.0007810592651367188 time for calcul the mask position with numpy : 0.005997657775878906 nb_pixel_total : 66 time to create 1 rle with old method : 9.369850158691406e-05 time for calcul the mask position with numpy : 0.006014585494995117 nb_pixel_total : 419 time to create 1 rle with old method : 0.0004680156707763672 time for calcul the mask position with numpy : 0.0059010982513427734 nb_pixel_total : 389 time to create 1 rle with old method : 0.00045490264892578125 time for calcul the mask position with numpy : 0.005948305130004883 nb_pixel_total : 172 time to create 1 rle with old method : 0.00020360946655273438 time for calcul the mask position with numpy : 0.0057220458984375 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003197193145751953 time for calcul the mask position with numpy : 0.005938291549682617 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002033710479736328 time for calcul the mask position with numpy : 0.00624537467956543 nb_pixel_total : 179 time to create 1 rle with old method : 0.00020194053649902344 time for calcul the mask position with numpy : 0.006108999252319336 nb_pixel_total : 165 time to create 1 rle with old method : 0.00022101402282714844 time for calcul the mask position with numpy : 0.006058454513549805 nb_pixel_total : 146 time to create 1 rle with old method : 0.00017523765563964844 create new chi : 0.9902989864349365 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0012447834014892578 batch 1 Loaded 97 chid ids of type : 4230 Number RLEs to save : 9143 TO DO : save crop sub photo not yet done ! save time : 1.9086997509002686 nb_obj : 95 nb_hashtags : 7 time to prepare the origin masks : 1.2585854530334473 time for calcul the mask position with numpy : 0.24316859245300293 nb_pixel_total : 1866726 time to create 1 rle with new method : 0.0898439884185791 time for calcul the mask position with numpy : 0.006400585174560547 nb_pixel_total : 231 time to create 1 rle with old method : 0.00030159950256347656 time for calcul the mask position with numpy : 0.006329059600830078 nb_pixel_total : 6 time to create 1 rle with old method : 3.743171691894531e-05 time for calcul the mask position with numpy : 0.006352901458740234 nb_pixel_total : 1790 time to create 1 rle with old method : 0.0021407604217529297 time for calcul the mask position with numpy : 0.006459474563598633 nb_pixel_total : 4988 time to create 1 rle with old method : 0.0058519840240478516 time for calcul the mask position with numpy : 0.006537914276123047 nb_pixel_total : 816 time to create 1 rle with old method : 0.0009584426879882812 time for calcul the mask position with numpy : 0.006390571594238281 nb_pixel_total : 14 time to create 1 rle with old method : 4.38690185546875e-05 time for calcul the mask position with numpy : 0.008453130722045898 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005340576171875 time for calcul the mask position with numpy : 0.00662684440612793 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004584789276123047 time for calcul the mask position with numpy : 0.006577014923095703 nb_pixel_total : 39 time to create 1 rle with old method : 0.0001049041748046875 time for calcul the mask position with numpy : 0.006567955017089844 nb_pixel_total : 46 time to create 1 rle with old method : 9.012222290039062e-05 time for calcul the mask position with numpy : 0.006650447845458984 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005424022674560547 time for calcul the mask position with numpy : 0.006272077560424805 nb_pixel_total : 2146 time to create 1 rle with old method : 0.002475261688232422 time for calcul the mask position with numpy : 0.006371259689331055 nb_pixel_total : 10 time to create 1 rle with old method : 4.601478576660156e-05 time for calcul the mask position with numpy : 0.006237506866455078 nb_pixel_total : 884 time to create 1 rle with old method : 0.0011489391326904297 time for calcul the mask position with numpy : 0.006437063217163086 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006546974182128906 time for calcul the mask position with numpy : 0.006630897521972656 nb_pixel_total : 19682 time to create 1 rle with old method : 0.026802778244018555 time for calcul the mask position with numpy : 0.0068209171295166016 nb_pixel_total : 2507 time to create 1 rle with old method : 0.004117250442504883 time for calcul the mask position with numpy : 0.006770133972167969 nb_pixel_total : 247 time to create 1 rle with old method : 0.0004222393035888672 time for calcul the mask position with numpy : 0.007013797760009766 nb_pixel_total : 175 time to create 1 rle with old method : 0.00032138824462890625 time for calcul the mask position with numpy : 0.0070438385009765625 nb_pixel_total : 794 time to create 1 rle with old method : 0.0012938976287841797 time for calcul the mask position with numpy : 0.00709223747253418 nb_pixel_total : 196 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.00709080696105957 nb_pixel_total : 4450 time to create 1 rle with old method : 0.00731205940246582 time for calcul the mask position with numpy : 0.0076563358306884766 nb_pixel_total : 8606 time to create 1 rle with old method : 0.01144552230834961 time for calcul the mask position with numpy : 0.0064661502838134766 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005941390991210938 time for calcul the mask position with numpy : 0.006684064865112305 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007376670837402344 time for calcul the mask position with numpy : 0.0069522857666015625 nb_pixel_total : 34 time to create 1 rle with old method : 8.988380432128906e-05 time for calcul the mask position with numpy : 0.006681919097900391 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005400180816650391 time for calcul the mask position with numpy : 0.006690025329589844 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002887248992919922 time for calcul the mask position with numpy : 0.006496429443359375 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0014417171478271484 time for calcul the mask position with numpy : 0.0065460205078125 nb_pixel_total : 825 time to create 1 rle with old method : 0.0009865760803222656 time for calcul the mask position with numpy : 0.0067408084869384766 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001819133758544922 time for calcul the mask position with numpy : 0.006439685821533203 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001373291015625 time for calcul the mask position with numpy : 0.0067594051361083984 nb_pixel_total : 17390 time to create 1 rle with old method : 0.019763469696044922 time for calcul the mask position with numpy : 0.007010459899902344 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004608631134033203 time for calcul the mask position with numpy : 0.006830930709838867 nb_pixel_total : 1381 time to create 1 rle with old method : 0.0017170906066894531 time for calcul the mask position with numpy : 0.007539033889770508 nb_pixel_total : 16 time to create 1 rle with old method : 6.67572021484375e-05 time for calcul the mask position with numpy : 0.006659507751464844 nb_pixel_total : 938 time to create 1 rle with old method : 0.001069784164428711 time for calcul the mask position with numpy : 0.006317853927612305 nb_pixel_total : 526 time to create 1 rle with old method : 0.0006504058837890625 time for calcul the mask position with numpy : 0.006134510040283203 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007576942443847656 time for calcul the mask position with numpy : 0.006158590316772461 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003464221954345703 time for calcul the mask position with numpy : 0.006170511245727539 nb_pixel_total : 801 time to create 1 rle with old method : 0.0009672641754150391 time for calcul the mask position with numpy : 0.006524801254272461 nb_pixel_total : 183 time to create 1 rle with old method : 0.00023055076599121094 time for calcul the mask position with numpy : 0.006427288055419922 nb_pixel_total : 487 time to create 1 rle with old method : 0.00057220458984375 time for calcul the mask position with numpy : 0.006105899810791016 nb_pixel_total : 711 time to create 1 rle with old method : 0.0008649826049804688 time for calcul the mask position with numpy : 0.006163597106933594 nb_pixel_total : 781 time to create 1 rle with old method : 0.0009357929229736328 time for calcul the mask position with numpy : 0.006234884262084961 nb_pixel_total : 213 time to create 1 rle with old method : 0.00031065940856933594 time for calcul the mask position with numpy : 0.0061914920806884766 nb_pixel_total : 118 time to create 1 rle with old method : 0.00020432472229003906 time for calcul the mask position with numpy : 0.0059549808502197266 nb_pixel_total : 2407 time to create 1 rle with old method : 0.002867460250854492 time for calcul the mask position with numpy : 0.006296634674072266 nb_pixel_total : 1261 time to create 1 rle with old method : 0.0014996528625488281 time for calcul the mask position with numpy : 0.005964040756225586 nb_pixel_total : 291 time to create 1 rle with old method : 0.00034356117248535156 time for calcul the mask position with numpy : 0.005972862243652344 nb_pixel_total : 1203 time to create 1 rle with old method : 0.0014014244079589844 time for calcul the mask position with numpy : 0.0060727596282958984 nb_pixel_total : 686 time to create 1 rle with old method : 0.0007665157318115234 time for calcul the mask position with numpy : 0.006056785583496094 nb_pixel_total : 211 time to create 1 rle with old method : 0.00028824806213378906 time for calcul the mask position with numpy : 0.005988597869873047 nb_pixel_total : 1126 time to create 1 rle with old method : 0.0012433528900146484 time for calcul the mask position with numpy : 0.0060999393463134766 nb_pixel_total : 352 time to create 1 rle with old method : 0.00041961669921875 time for calcul the mask position with numpy : 0.00589442253112793 nb_pixel_total : 410 time to create 1 rle with old method : 0.0004417896270751953 time for calcul the mask position with numpy : 0.006093740463256836 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006358623504638672 time for calcul the mask position with numpy : 0.006276607513427734 nb_pixel_total : 1701 time to create 1 rle with old method : 0.0019986629486083984 time for calcul the mask position with numpy : 0.006281614303588867 nb_pixel_total : 321 time to create 1 rle with old method : 0.00039649009704589844 time for calcul the mask position with numpy : 0.0064656734466552734 nb_pixel_total : 140 time to create 1 rle with old method : 0.0001881122589111328 time for calcul the mask position with numpy : 0.006175994873046875 nb_pixel_total : 314 time to create 1 rle with old method : 0.00039386749267578125 time for calcul the mask position with numpy : 0.00690150260925293 nb_pixel_total : 106252 time to create 1 rle with old method : 0.111358642578125 time for calcul the mask position with numpy : 0.007525920867919922 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005600452423095703 time for calcul the mask position with numpy : 0.009162187576293945 nb_pixel_total : 381 time to create 1 rle with old method : 0.0007729530334472656 time for calcul the mask position with numpy : 0.007330894470214844 nb_pixel_total : 114 time to create 1 rle with old method : 0.000164031982421875 time for calcul the mask position with numpy : 0.007080554962158203 nb_pixel_total : 20 time to create 1 rle with old method : 0.00017976760864257812 time for calcul the mask position with numpy : 0.006804943084716797 nb_pixel_total : 950 time to create 1 rle with old method : 0.001131296157836914 time for calcul the mask position with numpy : 0.006872892379760742 nb_pixel_total : 344 time to create 1 rle with old method : 0.000446319580078125 time for calcul the mask position with numpy : 0.0069887638092041016 nb_pixel_total : 178 time to create 1 rle with old method : 0.00024175643920898438 time for calcul the mask position with numpy : 0.0070536136627197266 nb_pixel_total : 313 time to create 1 rle with old method : 0.0003941059112548828 time for calcul the mask position with numpy : 0.007012605667114258 nb_pixel_total : 145 time to create 1 rle with old method : 0.00019979476928710938 time for calcul the mask position with numpy : 0.006788969039916992 nb_pixel_total : 241 time to create 1 rle with old method : 0.0002880096435546875 time for calcul the mask position with numpy : 0.007212638854980469 nb_pixel_total : 135 time to create 1 rle with old method : 0.00018477439880371094 time for calcul the mask position with numpy : 0.0068094730377197266 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0018944740295410156 time for calcul the mask position with numpy : 0.006951570510864258 nb_pixel_total : 617 time to create 1 rle with old method : 0.0007059574127197266 time for calcul the mask position with numpy : 0.007108449935913086 nb_pixel_total : 384 time to create 1 rle with old method : 0.00047850608825683594 time for calcul the mask position with numpy : 0.007046222686767578 nb_pixel_total : 87 time to create 1 rle with old method : 0.00014328956604003906 time for calcul the mask position with numpy : 0.0070149898529052734 nb_pixel_total : 148 time to create 1 rle with old method : 0.00021767616271972656 time for calcul the mask position with numpy : 0.007086992263793945 nb_pixel_total : 1352 time to create 1 rle with old method : 0.001524209976196289 time for calcul the mask position with numpy : 0.0076198577880859375 nb_pixel_total : 55 time to create 1 rle with old method : 9.298324584960938e-05 time for calcul the mask position with numpy : 0.007097005844116211 nb_pixel_total : 271 time to create 1 rle with old method : 0.000354766845703125 time for calcul the mask position with numpy : 0.006916522979736328 nb_pixel_total : 946 time to create 1 rle with old method : 0.0011570453643798828 time for calcul the mask position with numpy : 0.006975889205932617 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004966259002685547 time for calcul the mask position with numpy : 0.006909370422363281 nb_pixel_total : 303 time to create 1 rle with old method : 0.0003662109375 time for calcul the mask position with numpy : 0.006977081298828125 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004096031188964844 time for calcul the mask position with numpy : 0.007022380828857422 nb_pixel_total : 268 time to create 1 rle with old method : 0.00041747093200683594 time for calcul the mask position with numpy : 0.007041215896606445 nb_pixel_total : 168 time to create 1 rle with old method : 0.00022363662719726562 time for calcul the mask position with numpy : 0.00799560546875 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002434253692626953 time for calcul the mask position with numpy : 0.008030414581298828 nb_pixel_total : 255 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.00818490982055664 nb_pixel_total : 66 time to create 1 rle with old method : 8.654594421386719e-05 time for calcul the mask position with numpy : 0.0081329345703125 nb_pixel_total : 262 time to create 1 rle with old method : 0.0002830028533935547 time for calcul the mask position with numpy : 0.008171558380126953 nb_pixel_total : 156 time to create 1 rle with old method : 0.0001780986785888672 time for calcul the mask position with numpy : 0.008124113082885742 nb_pixel_total : 147 time to create 1 rle with old method : 0.0001804828643798828 time for calcul the mask position with numpy : 0.008400440216064453 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.008310794830322266 nb_pixel_total : 4 time to create 1 rle with old method : 2.4318695068359375e-05 create new chi : 1.2340035438537598 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.002025127410888672 batch 1 Loaded 96 chid ids of type : 4230 Number RLEs to save : 9230 TO DO : save crop sub photo not yet done ! save time : 0.6282916069030762 nb_obj : 100 nb_hashtags : 6 time to prepare the origin masks : 1.547170877456665 time for calcul the mask position with numpy : 0.21021080017089844 nb_pixel_total : 1870885 time to create 1 rle with new method : 0.11969995498657227 time for calcul the mask position with numpy : 0.007670402526855469 nb_pixel_total : 170 time to create 1 rle with old method : 0.00023746490478515625 time for calcul the mask position with numpy : 0.007450580596923828 nb_pixel_total : 1761 time to create 1 rle with old method : 0.002059459686279297 time for calcul the mask position with numpy : 0.0074574947357177734 nb_pixel_total : 4825 time to create 1 rle with old method : 0.005721092224121094 time for calcul the mask position with numpy : 0.007652997970581055 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006401538848876953 time for calcul the mask position with numpy : 0.007292032241821289 nb_pixel_total : 61 time to create 1 rle with old method : 0.00012636184692382812 time for calcul the mask position with numpy : 0.008253097534179688 nb_pixel_total : 819 time to create 1 rle with old method : 0.0010008811950683594 time for calcul the mask position with numpy : 0.00835871696472168 nb_pixel_total : 410 time to create 1 rle with old method : 0.00049591064453125 time for calcul the mask position with numpy : 0.008028745651245117 nb_pixel_total : 35 time to create 1 rle with old method : 7.367134094238281e-05 time for calcul the mask position with numpy : 0.009662151336669922 nb_pixel_total : 14 time to create 1 rle with old method : 8.0108642578125e-05 time for calcul the mask position with numpy : 0.007831096649169922 nb_pixel_total : 54 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.008331060409545898 nb_pixel_total : 2393 time to create 1 rle with old method : 0.00279998779296875 time for calcul the mask position with numpy : 0.0074427127838134766 nb_pixel_total : 90 time to create 1 rle with old method : 0.00018787384033203125 time for calcul the mask position with numpy : 0.0075910091400146484 nb_pixel_total : 993 time to create 1 rle with old method : 0.0012006759643554688 time for calcul the mask position with numpy : 0.00747370719909668 nb_pixel_total : 229 time to create 1 rle with old method : 0.000301361083984375 time for calcul the mask position with numpy : 0.00737762451171875 nb_pixel_total : 955 time to create 1 rle with old method : 0.0011970996856689453 time for calcul the mask position with numpy : 0.00706171989440918 nb_pixel_total : 1178 time to create 1 rle with old method : 0.001417398452758789 time for calcul the mask position with numpy : 0.0073337554931640625 nb_pixel_total : 125 time to create 1 rle with old method : 0.0002079010009765625 time for calcul the mask position with numpy : 0.007246255874633789 nb_pixel_total : 110 time to create 1 rle with old method : 0.00017261505126953125 time for calcul the mask position with numpy : 0.007517576217651367 nb_pixel_total : 2121 time to create 1 rle with old method : 0.0026192665100097656 time for calcul the mask position with numpy : 0.007401227951049805 nb_pixel_total : 189 time to create 1 rle with old method : 0.00024318695068359375 time for calcul the mask position with numpy : 0.012535333633422852 nb_pixel_total : 488 time to create 1 rle with old method : 0.0006289482116699219 time for calcul the mask position with numpy : 0.012679338455200195 nb_pixel_total : 5041 time to create 1 rle with old method : 0.005824089050292969 time for calcul the mask position with numpy : 0.012698173522949219 nb_pixel_total : 8473 time to create 1 rle with old method : 0.009292125701904297 time for calcul the mask position with numpy : 0.011982917785644531 nb_pixel_total : 657 time to create 1 rle with old method : 0.0007767677307128906 time for calcul the mask position with numpy : 0.012413740158081055 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005726814270019531 time for calcul the mask position with numpy : 0.012752771377563477 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006737709045410156 time for calcul the mask position with numpy : 0.012488365173339844 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005826950073242188 time for calcul the mask position with numpy : 0.012371301651000977 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003192424774169922 time for calcul the mask position with numpy : 0.01304006576538086 nb_pixel_total : 748 time to create 1 rle with old method : 0.0013840198516845703 time for calcul the mask position with numpy : 0.014732837677001953 nb_pixel_total : 1093 time to create 1 rle with old method : 0.0012753009796142578 time for calcul the mask position with numpy : 0.012749671936035156 nb_pixel_total : 815 time to create 1 rle with old method : 0.0009961128234863281 time for calcul the mask position with numpy : 0.011939048767089844 nb_pixel_total : 135 time to create 1 rle with old method : 0.00019550323486328125 time for calcul the mask position with numpy : 0.007585048675537109 nb_pixel_total : 503 time to create 1 rle with old method : 0.000644683837890625 time for calcul the mask position with numpy : 0.007815361022949219 nb_pixel_total : 12368 time to create 1 rle with old method : 0.018749475479125977 time for calcul the mask position with numpy : 0.015048027038574219 nb_pixel_total : 1333 time to create 1 rle with old method : 0.0035190582275390625 time for calcul the mask position with numpy : 0.012042999267578125 nb_pixel_total : 19 time to create 1 rle with old method : 0.0001049041748046875 time for calcul the mask position with numpy : 0.011605262756347656 nb_pixel_total : 16 time to create 1 rle with old method : 9.226799011230469e-05 time for calcul the mask position with numpy : 0.007864952087402344 nb_pixel_total : 887 time to create 1 rle with old method : 0.0010707378387451172 time for calcul the mask position with numpy : 0.00740504264831543 nb_pixel_total : 506 time to create 1 rle with old method : 0.0006401538848876953 time for calcul the mask position with numpy : 0.0071086883544921875 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007212162017822266 time for calcul the mask position with numpy : 0.007038116455078125 nb_pixel_total : 15 time to create 1 rle with old method : 6.079673767089844e-05 time for calcul the mask position with numpy : 0.006817817687988281 nb_pixel_total : 290 time to create 1 rle with old method : 0.00035762786865234375 time for calcul the mask position with numpy : 0.006243705749511719 nb_pixel_total : 276 time to create 1 rle with old method : 0.00034618377685546875 time for calcul the mask position with numpy : 0.006089210510253906 nb_pixel_total : 61 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.00606226921081543 nb_pixel_total : 15693 time to create 1 rle with old method : 0.017273664474487305 time for calcul the mask position with numpy : 0.006234645843505859 nb_pixel_total : 522 time to create 1 rle with old method : 0.0006153583526611328 time for calcul the mask position with numpy : 0.0061299800872802734 nb_pixel_total : 716 time to create 1 rle with old method : 0.0008723735809326172 time for calcul the mask position with numpy : 0.006220579147338867 nb_pixel_total : 911 time to create 1 rle with old method : 0.0011036396026611328 time for calcul the mask position with numpy : 0.006517648696899414 nb_pixel_total : 2466 time to create 1 rle with old method : 0.0028824806213378906 time for calcul the mask position with numpy : 0.006694793701171875 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0012080669403076172 time for calcul the mask position with numpy : 0.006394147872924805 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005075931549072266 time for calcul the mask position with numpy : 0.006481647491455078 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0011730194091796875 time for calcul the mask position with numpy : 0.006200551986694336 nb_pixel_total : 635 time to create 1 rle with old method : 0.0007727146148681641 time for calcul the mask position with numpy : 0.006175041198730469 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0012979507446289062 time for calcul the mask position with numpy : 0.007421731948852539 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003745555877685547 time for calcul the mask position with numpy : 0.0066928863525390625 nb_pixel_total : 1117 time to create 1 rle with old method : 0.001325368881225586 time for calcul the mask position with numpy : 0.006157636642456055 nb_pixel_total : 52 time to create 1 rle with old method : 9.608268737792969e-05 time for calcul the mask position with numpy : 0.006227254867553711 nb_pixel_total : 352 time to create 1 rle with old method : 0.0004017353057861328 time for calcul the mask position with numpy : 0.006121397018432617 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005583763122558594 time for calcul the mask position with numpy : 0.006040096282958984 nb_pixel_total : 953 time to create 1 rle with old method : 0.0011191368103027344 time for calcul the mask position with numpy : 0.005869388580322266 nb_pixel_total : 1640 time to create 1 rle with old method : 0.0017330646514892578 time for calcul the mask position with numpy : 0.006268739700317383 nb_pixel_total : 129 time to create 1 rle with old method : 0.00015997886657714844 time for calcul the mask position with numpy : 0.0059757232666015625 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003514289855957031 time for calcul the mask position with numpy : 0.006335258483886719 nb_pixel_total : 106658 time to create 1 rle with old method : 0.110870361328125 time for calcul the mask position with numpy : 0.005784749984741211 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005183219909667969 time for calcul the mask position with numpy : 0.00605320930480957 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006339550018310547 time for calcul the mask position with numpy : 0.006109952926635742 nb_pixel_total : 92 time to create 1 rle with old method : 0.00012803077697753906 time for calcul the mask position with numpy : 0.00616455078125 nb_pixel_total : 10 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.006304740905761719 nb_pixel_total : 862 time to create 1 rle with old method : 0.0010228157043457031 time for calcul the mask position with numpy : 0.006338357925415039 nb_pixel_total : 323 time to create 1 rle with old method : 0.00039005279541015625 time for calcul the mask position with numpy : 0.0063092708587646484 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002193450927734375 time for calcul the mask position with numpy : 0.0062046051025390625 nb_pixel_total : 311 time to create 1 rle with old method : 0.0003669261932373047 time for calcul the mask position with numpy : 0.006412506103515625 nb_pixel_total : 149 time to create 1 rle with old method : 0.000202178955078125 time for calcul the mask position with numpy : 0.00639796257019043 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003631114959716797 time for calcul the mask position with numpy : 0.006289958953857422 nb_pixel_total : 134 time to create 1 rle with old method : 0.00017523765563964844 time for calcul the mask position with numpy : 0.00629878044128418 nb_pixel_total : 1761 time to create 1 rle with old method : 0.002009868621826172 time for calcul the mask position with numpy : 0.006611824035644531 nb_pixel_total : 733 time to create 1 rle with old method : 0.000885009765625 time for calcul the mask position with numpy : 0.006499052047729492 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004584789276123047 time for calcul the mask position with numpy : 0.006371259689331055 nb_pixel_total : 1383 time to create 1 rle with old method : 0.0016207695007324219 time for calcul the mask position with numpy : 0.006518840789794922 nb_pixel_total : 105 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.006837129592895508 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001201629638671875 time for calcul the mask position with numpy : 0.006555080413818359 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001347064971923828 time for calcul the mask position with numpy : 0.006530046463012695 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002396106719970703 time for calcul the mask position with numpy : 0.006684541702270508 nb_pixel_total : 61 time to create 1 rle with old method : 0.00011277198791503906 time for calcul the mask position with numpy : 0.0070569515228271484 nb_pixel_total : 1279 time to create 1 rle with old method : 0.0015382766723632812 time for calcul the mask position with numpy : 0.006691694259643555 nb_pixel_total : 47 time to create 1 rle with old method : 8.153915405273438e-05 time for calcul the mask position with numpy : 0.0066394805908203125 nb_pixel_total : 175 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.006325483322143555 nb_pixel_total : 837 time to create 1 rle with old method : 0.0009551048278808594 time for calcul the mask position with numpy : 0.006423234939575195 nb_pixel_total : 870 time to create 1 rle with old method : 0.0010120868682861328 time for calcul the mask position with numpy : 0.0066738128662109375 nb_pixel_total : 349 time to create 1 rle with old method : 0.00044798851013183594 time for calcul the mask position with numpy : 0.0063207149505615234 nb_pixel_total : 66 time to create 1 rle with old method : 0.00010228157043457031 time for calcul the mask position with numpy : 0.006232023239135742 nb_pixel_total : 317 time to create 1 rle with old method : 0.00038695335388183594 time for calcul the mask position with numpy : 0.00701141357421875 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003447532653808594 time for calcul the mask position with numpy : 0.006783723831176758 nb_pixel_total : 204 time to create 1 rle with old method : 0.00025916099548339844 time for calcul the mask position with numpy : 0.006792545318603516 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003001689910888672 time for calcul the mask position with numpy : 0.006301403045654297 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003154277801513672 time for calcul the mask position with numpy : 0.008863449096679688 nb_pixel_total : 59 time to create 1 rle with old method : 0.00011682510375976562 time for calcul the mask position with numpy : 0.008636236190795898 nb_pixel_total : 183 time to create 1 rle with old method : 0.00023627281188964844 time for calcul the mask position with numpy : 0.008738517761230469 nb_pixel_total : 153 time to create 1 rle with old method : 0.00019741058349609375 time for calcul the mask position with numpy : 0.008681774139404297 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001621246337890625 create new chi : 1.351975917816162 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001781463623046875 batch 1 Loaded 101 chid ids of type : 4230 Number RLEs to save : 9865 TO DO : save crop sub photo not yet done ! save time : 1.2755751609802246 map_output_result : {1334217286: (0.0, 'Should be the crop_list due to order', 0.0), 1334216556: (0.0, 'Should be the crop_list due to order', 0.0), 1334216554: (0.0, 'Should be the crop_list due to order', 0.0), 1334216552: (0.0, 'Should be the crop_list due to order', 0.0), 1334216549: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1334217286, 1334216556, 1334216554, 1334216552, 1334216549] Looping around the photos to save general results len do output : 5 /1334217286.Didn't retrieve data . /1334216556.Didn't retrieve data . /1334216554.Didn't retrieve data . /1334216552.Didn't retrieve data . /1334216549.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334217286', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216556', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216554', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216552', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216549', None, None, None, None, None, '2542844') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013190746307373047 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.917474508285522 time spend to save output : 0.013633966445922852 total time spend for step 4 : 20.931108474731445 step5:crop_condition Tue Feb 4 03:21:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 489 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 211 About to insert : list_path_to_insert length 211 new photo from crops ! About to upload 211 photos upload in portfolio : 4869462 init cache_photo without model_param we have 211 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738635692_2486630 we have uploaded 211 photos in the portfolio 4869462 time of upload the photos Elapsed time : 58.612157344818115 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 4869462 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738635752_2486630 we have uploaded 45 photos in the portfolio 4869462 time of upload the photos Elapsed time : 10.897075414657593 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738635763_2486630 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5367705821990967 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 4869462 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738635764_2486630 we have uploaded 29 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.296910047531128 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 4869462 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738635772_2486630 we have uploaded 54 photos in the portfolio 4869462 time of upload the photos Elapsed time : 16.428924560546875 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1334217286, 1334216556, 1334216554, 1334216552, 1334216549] Looping around the photos to save general results len do output : 340 /1334413657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334413999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334414107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334217286', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216556', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216554', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216552', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216549', None, None, None, None, None, '2542844') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1025 time used for this insertion : 0.16007208824157715 save_final save missing photos in datou_result : time spend for datou_step_exec : 100.93801832199097 time spend to save output : 0.1691882610321045 total time spend for step 5 : 101.10720658302307 step6:thcl Tue Feb 4 03:23:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.015223503112792969 time to convert the images to numpy array : 0.10346078872680664 time to import caffe and check if the image exist : 0.018406152725219727 time to convert the images to numpy array : 0.10101103782653809 time to import caffe and check if the image exist : 0.02889704704284668 time to convert the images to numpy array : 0.09203100204467773 time to import caffe and check if the image exist : 0.028301477432250977 time to convert the images to numpy array : 0.10913395881652832 time to import caffe and check if the image exist : 0.035780906677246094 time to convert the images to numpy array : 0.10121321678161621 time to import caffe and check if the image exist : 0.026091337203979492 time to convert the images to numpy array : 0.11125063896179199 time to import caffe and check if the image exist : 0.021796703338623047 time to convert the images to numpy array : 0.1168980598449707 time to import caffe and check if the image exist : 0.03377580642700195 time to convert the images to numpy array : 0.10602188110351562 time to import caffe and check if the image exist : 0.03516077995300293 time to convert the images to numpy array : 0.1048433780670166 time to import caffe and check if the image exist : 0.05199575424194336 time to convert the images to numpy array : 0.09054970741271973 total time to convert the images to numpy array : 0.34414076805114746 list photo_ids error: [] list photo_ids correct : [1334413883, 1334413884, 1334413885, 1334413886, 1334413887, 1334413888, 1334413889, 1334413920, 1334413921, 1334413923, 1334413924, 1334413925, 1334413926, 1334413927, 1334413930, 1334413931, 1334413932, 1334413933, 1334413934, 1334413935, 1334413936, 1334413937, 1334413938, 1334413939, 1334413940, 1334413941, 1334413942, 1334413943, 1334413944, 1334413945, 1334413946, 1334413947, 1334413948, 1334413949, 1334413802, 1334413803, 1334413804, 1334413805, 1334413806, 1334413807, 1334413808, 1334413809, 1334413810, 1334413811, 1334413812, 1334413813, 1334413814, 1334413815, 1334413816, 1334413817, 1334413818, 1334413819, 1334413820, 1334413824, 1334413825, 1334413826, 1334413827, 1334413828, 1334413829, 1334413830, 1334413831, 1334413832, 1334413834, 1334413835, 1334413836, 1334413837, 1334413838, 1334413839, 1334413840, 1334413841, 1334413842, 1334413843, 1334413844, 1334413845, 1334413846, 1334413847, 1334413848, 1334413849, 1334413850, 1334413851, 1334413852, 1334413853, 1334413854, 1334413855, 1334413856, 1334413857, 1334413858, 1334413859, 1334413860, 1334413861, 1334413862, 1334413863, 1334413864, 1334413865, 1334413866, 1334413867, 1334413869, 1334413873, 1334413876, 1334413879, 1334413881, 1334413882, 1334413657, 1334413658, 1334413659, 1334413660, 1334413661, 1334413662, 1334413663, 1334413664, 1334413665, 1334413666, 1334413669, 1334413670, 1334413671, 1334413672, 1334413673, 1334413674, 1334413675, 1334413676, 1334413677, 1334413678, 1334413679, 1334413680, 1334413681, 1334413682, 1334413683, 1334413684, 1334413685, 1334413686, 1334413687, 1334413688, 1334413689, 1334413690, 1334413691, 1334413692, 1334414044, 1334414045, 1334414046, 1334414047, 1334414048, 1334414049, 1334414050, 1334414051, 1334414052, 1334414053, 1334414054, 1334414055, 1334414056, 1334414057, 1334414058, 1334414059, 1334414060, 1334414061, 1334414062, 1334414063, 1334414064, 1334414068, 1334414071, 1334414075, 1334414078, 1334414081, 1334414085, 1334414089, 1334414092, 1334414095, 1334414097, 1334414100, 1334414104, 1334414107, 1334414004, 1334414005, 1334414006, 1334414007, 1334414008, 1334414009, 1334414010, 1334414011, 1334414012, 1334414013, 1334414014, 1334414015, 1334414016, 1334414017, 1334414024, 1334414025, 1334414026, 1334414027, 1334414028, 1334414029, 1334414030, 1334414031, 1334414032, 1334414033, 1334414034, 1334414035, 1334414036, 1334414037, 1334414038, 1334414039, 1334414040, 1334414041, 1334414042, 1334414043, 1334413953, 1334413956, 1334413957, 1334413958, 1334413959, 1334413960, 1334413961, 1334413962, 1334413963, 1334413964, 1334413965, 1334413966, 1334413967, 1334413968, 1334413969, 1334413970, 1334413971, 1334413972, 1334413973, 1334413989, 1334413990, 1334413991, 1334413992, 1334413993, 1334413994, 1334413995, 1334413996, 1334413997, 1334413998, 1334413999, 1334414000, 1334414001, 1334414002, 1334414003, 1334413763, 1334413764, 1334413765, 1334413766, 1334413769, 1334413772, 1334413774, 1334413775, 1334413776, 1334413777, 1334413778, 1334413779, 1334413780, 1334413781, 1334413782, 1334413783, 1334413784, 1334413785, 1334413786, 1334413787, 1334413788, 1334413789, 1334413790, 1334413791, 1334413792, 1334413793, 1334413794, 1334413795, 1334413796, 1334413797, 1334413798, 1334413799, 1334413800, 1334413801, 1334413727, 1334413728, 1334413729, 1334413730, 1334413731, 1334413732, 1334413733, 1334413734, 1334413735, 1334413737, 1334413738, 1334413739, 1334413740, 1334413741, 1334413742, 1334413743, 1334413744, 1334413745, 1334413746, 1334413748, 1334413749, 1334413750, 1334413751, 1334413752, 1334413753, 1334413754, 1334413755, 1334413756, 1334413757, 1334413758, 1334413759, 1334413760, 1334413761, 1334413762, 1334413693, 1334413694, 1334413695, 1334413696, 1334413697, 1334413698, 1334413699, 1334413700, 1334413701, 1334413702, 1334413703, 1334413704, 1334413705, 1334413706, 1334413707, 1334413708, 1334413709, 1334413710, 1334413711, 1334413712, 1334413713, 1334413714, 1334413715, 1334413716, 1334413717, 1334413718, 1334413719, 1334413720, 1334413721, 1334413722, 1334413723, 1334413724, 1334413725, 1334413726] number of photos to traite : 340 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10776 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.5961599349975586 time used to do the prediction : 1.2428150177001953 save descriptor for thcl : 3237 time to traite the descriptors : 2.021415948867798 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1334413883 To insert : 1334413884 To insert : 1334413885 To insert : 1334413886 To insert : 1334413887 To insert : 1334413888 To insert : 1334413889 To insert : 1334413920 To insert : 1334413921 To insert : 1334413923 To insert : 1334413924 To insert : 1334413925 To insert : 1334413926 To insert : 1334413927 To insert : 1334413930 To insert : 1334413931 To insert : 1334413932 To insert : 1334413933 To insert : 1334413934 To insert : 1334413935 To insert : 1334413936 To insert : 1334413937 To insert : 1334413938 To insert : 1334413939 To insert : 1334413940 To insert : 1334413941 To insert : 1334413942 To insert : 1334413943 To insert : 1334413944 To insert : 1334413945 To insert : 1334413946 To insert : 1334413947 To insert : 1334413948 To insert : 1334413949 To insert : 1334413802 To insert : 1334413803 To insert : 1334413804 To insert : 1334413805 To insert : 1334413806 To insert : 1334413807 To insert : 1334413808 To insert : 1334413809 To insert : 1334413810 To insert : 1334413811 To insert : 1334413812 To insert : 1334413813 To insert : 1334413814 To insert : 1334413815 To insert : 1334413816 To insert : 1334413817 To insert : 1334413818 To insert : 1334413819 To insert : 1334413820 To insert : 1334413824 To insert : 1334413825 To insert : 1334413826 To insert : 1334413827 To insert : 1334413828 To insert : 1334413829 To insert : 1334413830 To insert : 1334413831 To insert : 1334413832 To insert : 1334413834 To insert : 1334413835 To insert : 1334413836 To insert : 1334413837 To insert : 1334413838 To insert : 1334413839 To insert : 1334413840 To insert : 1334413841 To insert : 1334413842 To insert : 1334413843 To insert : 1334413844 To insert : 1334413845 To insert : 1334413846 To insert : 1334413847 To insert : 1334413848 To insert : 1334413849 To insert : 1334413850 To insert : 1334413851 To insert : 1334413852 To insert : 1334413853 To insert : 1334413854 To insert : 1334413855 To insert : 1334413856 To insert : 1334413857 To insert : 1334413858 To insert : 1334413859 To insert : 1334413860 To insert : 1334413861 To insert : 1334413862 To insert : 1334413863 To insert : 1334413864 To insert : 1334413865 To insert : 1334413866 To insert : 1334413867 To insert : 1334413869 To insert : 1334413873 To insert : 1334413876 To insert : 1334413879 To insert : 1334413881 To insert : 1334413882 To insert : 1334413657 To insert : 1334413658 To insert : 1334413659 To insert : 1334413660 To insert : 1334413661 To insert : 1334413662 To insert : 1334413663 To insert : 1334413664 To insert : 1334413665 To insert : 1334413666 To insert : 1334413669 To insert : 1334413670 To insert : 1334413671 To insert : 1334413672 To insert : 1334413673 To insert : 1334413674 To insert : 1334413675 To insert : 1334413676 To insert : 1334413677 To insert : 1334413678 To insert : 1334413679 To insert : 1334413680 To insert : 1334413681 To insert : 1334413682 To insert : 1334413683 To insert : 1334413684 To insert : 1334413685 To insert : 1334413686 To insert : 1334413687 To insert : 1334413688 To insert : 1334413689 To insert : 1334413690 To insert : 1334413691 To insert : 1334413692 To insert : 1334414044 To insert : 1334414045 To insert : 1334414046 To insert : 1334414047 To insert : 1334414048 To insert : 1334414049 To insert : 1334414050 To insert : 1334414051 To insert : 1334414052 To insert : 1334414053 To insert : 1334414054 To insert : 1334414055 To insert : 1334414056 To insert : 1334414057 To insert : 1334414058 To insert : 1334414059 To insert : 1334414060 To insert : 1334414061 To insert : 1334414062 To insert : 1334414063 To insert : 1334414064 To insert : 1334414068 To insert : 1334414071 To insert : 1334414075 To insert : 1334414078 To insert : 1334414081 To insert : 1334414085 To insert : 1334414089 To insert : 1334414092 To insert : 1334414095 To insert : 1334414097 To insert : 1334414100 To insert : 1334414104 To insert : 1334414107 To insert : 1334414004 To insert : 1334414005 To insert : 1334414006 To insert : 1334414007 To insert : 1334414008 To insert : 1334414009 To insert : 1334414010 To insert : 1334414011 To insert : 1334414012 To insert : 1334414013 To insert : 1334414014 To insert : 1334414015 To insert : 1334414016 To insert : 1334414017 To insert : 1334414024 To insert : 1334414025 To insert : 1334414026 To insert : 1334414027 To insert : 1334414028 To insert : 1334414029 To insert : 1334414030 To insert : 1334414031 To insert : 1334414032 To insert : 1334414033 To insert : 1334414034 To insert : 1334414035 To insert : 1334414036 To insert : 1334414037 To insert : 1334414038 To insert : 1334414039 To insert : 1334414040 To insert : 1334414041 To insert : 1334414042 To insert : 1334414043 To insert : 1334413953 To insert : 1334413956 To insert : 1334413957 To insert : 1334413958 To insert : 1334413959 To insert : 1334413960 To insert : 1334413961 To insert : 1334413962 To insert : 1334413963 To insert : 1334413964 To insert : 1334413965 To insert : 1334413966 To insert : 1334413967 To insert : 1334413968 To insert : 1334413969 To insert : 1334413970 To insert : 1334413971 To insert : 1334413972 To insert : 1334413973 To insert : 1334413989 To insert : 1334413990 To insert : 1334413991 To insert : 1334413992 To insert : 1334413993 To insert : 1334413994 To insert : 1334413995 To insert : 1334413996 To insert : 1334413997 To insert : 1334413998 To insert : 1334413999 To insert : 1334414000 To insert : 1334414001 To insert : 1334414002 To insert : 1334414003 To insert : 1334413763 To insert : 1334413764 To insert : 1334413765 To insert : 1334413766 To insert : 1334413769 To insert : 1334413772 To insert : 1334413774 To insert : 1334413775 To insert : 1334413776 To insert : 1334413777 To insert : 1334413778 To insert : 1334413779 To insert : 1334413780 To insert : 1334413781 To insert : 1334413782 To insert : 1334413783 To insert : 1334413784 To insert : 1334413785 To insert : 1334413786 To insert : 1334413787 To insert : 1334413788 To insert : 1334413789 To insert : 1334413790 To insert : 1334413791 To insert : 1334413792 To insert : 1334413793 To insert : 1334413794 To insert : 1334413795 To insert : 1334413796 To insert : 1334413797 To insert : 1334413798 To insert : 1334413799 To insert : 1334413800 To insert : 1334413801 To insert : 1334413727 To insert : 1334413728 To insert : 1334413729 To insert : 1334413730 To insert : 1334413731 To insert : 1334413732 To insert : 1334413733 To insert : 1334413734 To insert : 1334413735 To insert : 1334413737 To insert : 1334413738 To insert : 1334413739 To insert : 1334413740 To insert : 1334413741 To insert : 1334413742 To insert : 1334413743 To insert : 1334413744 To insert : 1334413745 To insert : 1334413746 To insert : 1334413748 To insert : 1334413749 To insert : 1334413750 To insert : 1334413751 To insert : 1334413752 To insert : 1334413753 To insert : 1334413754 To insert : 1334413755 To insert : 1334413756 To insert : 1334413757 To insert : 1334413758 To insert : 1334413759 To insert : 1334413760 To insert : 1334413761 To insert : 1334413762 To insert : 1334413693 To insert : 1334413694 To insert : 1334413695 To insert : 1334413696 To insert : 1334413697 To insert : 1334413698 To insert : 1334413699 To insert : 1334413700 To insert : 1334413701 To insert : 1334413702 To insert : 1334413703 To insert : 1334413704 To insert : 1334413705 To insert : 1334413706 To insert : 1334413707 To insert : 1334413708 To insert : 1334413709 To insert : 1334413710 To insert : 1334413711 To insert : 1334413712 To insert : 1334413713 To insert : 1334413714 To insert : 1334413715 To insert : 1334413716 To insert : 1334413717 To insert : 1334413718 To insert : 1334413719 To insert : 1334413720 To insert : 1334413721 To insert : 1334413722 To insert : 1334413723 To insert : 1334413724 To insert : 1334413725 To insert : 1334413726 time to insert the descriptors : 55.25994944572449 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 527 time used for this insertion : 0.38886475563049316 save missing photos in datou_result : time spend for datou_step_exec : 64.55548572540283 time spend to save output : 0.443023681640625 total time spend for step 6 : 64.99850940704346 step7:ventilate_hashtags_in_portfolio Tue Feb 4 03:24:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20196760 get user id for portfolio 20196760 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196760 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Film_plastique','carton','papier','PEHD','Tetrapak','flou','mal_croppe','autre','Carton','PET_fonce','metal','environnement','refus','PET_clair','pet_fonce','Papier','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196760 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Film_plastique','carton','papier','PEHD','Tetrapak','flou','mal_croppe','autre','Carton','PET_fonce','metal','environnement','refus','PET_clair','pet_fonce','Papier','pet_clair')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196760 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Film_plastique','carton','papier','PEHD','Tetrapak','flou','mal_croppe','autre','Carton','PET_fonce','metal','environnement','refus','PET_clair','pet_fonce','Papier','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196760 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Film_plastique','carton','papier','PEHD','Tetrapak','flou','mal_croppe','autre','Carton','PET_fonce','metal','environnement','refus','PET_clair','pet_fonce','Papier','pet_clair')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20197127,20197124,20197132,20197139,20197128,20197129,20197130,20197131,20197138,20197134,20197135,20197136,20197140?tags=pehd,film_plastique,carton,papier,tetrapak,flou,mal_croppe,autre,pet_fonce,metal,environnement,refus,pet_clair&datou_id_consolidate=4235&port_consolidate=20196760 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1334217286, 1334216556, 1334216554, 1334216552, 1334216549] Looping around the photos to save general results len do output : 1 /20196760. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334217286', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216556', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216554', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216552', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216549', None, None, None, None, None, '2542844') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014811515808105469 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.500328302383423 time spend to save output : 0.015176773071289062 total time spend for step 7 : 2.515505075454712 step8:final Tue Feb 4 03:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1334217286: ('0.1508543991833287',), 1334216556: ('0.1508543991833287',), 1334216554: ('0.1508543991833287',), 1334216552: ('0.1508543991833287',), 1334216549: ('0.1508543991833287',)} new output for save of step final : {1334217286: ('0.1508543991833287',), 1334216556: ('0.1508543991833287',), 1334216554: ('0.1508543991833287',), 1334216552: ('0.1508543991833287',), 1334216549: ('0.1508543991833287',)} [1334217286, 1334216556, 1334216554, 1334216552, 1334216549] Looping around the photos to save general results len do output : 5 /1334217286.Didn't retrieve data . /1334216556.Didn't retrieve data . /1334216554.Didn't retrieve data . /1334216552.Didn't retrieve data . /1334216549.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334217286', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216556', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216554', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216552', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216549', None, None, None, None, None, '2542844') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01247715950012207 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12215948104858398 time spend to save output : 0.012981653213500977 total time spend for step 8 : 0.13514113426208496 step9:velours_tree Tue Feb 4 03:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20197127,20197124,20197132,20197139,20197128,20197129,20197130,20197131,20197138,20197134,20197135,20197136,20197140 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197127 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197124 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197132 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197139 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197128 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197129 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197130 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197131 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197138 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197134 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197135 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197136 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20197140 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 340 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 4 5 2 3 5 2 2 2 1 1 1 1 1 1 0 1 0 1 0 2 0 1 1 2 0 0 1 0 2 2 4 0 0 2 2 4 4 5 5 5 5 2 0 5 4 4 0 0 2 2 2 1 1 1 1 1 2 0 1 2 1 0 0 1 1 1 2 1 0 1 0 0 2 4 4 0 2 2 4 4 5 5 5 5 2 0 0 4 5 2 0 2 2 2 1 1 1 1 1 2 0 1 1 0 0 0 1 1 1 0 1 0 2 4 4 2 2 4 5 4 5 5 5 0 2 5 5 4 5 2 2 2 2 1 2 1 1 1 1 1 0 1 1 2 1 0 0 0 1 1 1 1 0 4 4 5 0 0 2 4 4 5 5 5 2 4 4 2 2 2 2 1 1 1 1 1 1 1 1 1 0 1 1 2 1 0 2 0 0 1 1 1 1 1 0 4 4 0 0 2 2 4 4 5 0 5 5 5 5 2 3 0 0 0 5 4 5 5 5 3 3 1 0 0 0 2 5 5 0 3 2 0 0 0 2 5 5 0 3 5 3 1 0 0 0 5 5 3 0 0 0 0 5 5 5 4 5 2 1 4 1 2 4 4 0 5 2 2 5 4 5 2 2 2 4 5 2 1 2 4 2 1 4 2 2 0 3 0 0 3 0 2 2 0 5 0 5 0 3 0 3 1 0 2 5 0 5 3 0 3 5 1 0 2 0 0 0 0 3 0 3 1 0 2 2 0 0 0 5 0 3 0 1 0 2 5 0 0 5] Elapsed time: 0.0721280574798584 graph_id used : 75861 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20197127,20197124,20197132,20197139,20197128,20197129,20197130,20197131,20197138,20197134,20197135,20197136,20197140?tags=pehd,film_plastique,carton,papier,tetrapak,flou,mal_croppe,autre,pet_fonce,metal,environnement,refus,pet_clair&datou_id_consolidate=4235&port_consolidate=20196760&tree_id=75861 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1334217286, 1334216556, 1334216554, 1334216552, 1334216549] Looping around the photos to save general results len do output : 1 /20196760Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334217286', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216556', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216554', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216552', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216549', None, None, None, None, None, '2542844') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012934684753417969 save_final save missing photos in datou_result : time spend for datou_step_exec : 25.851351976394653 time spend to save output : 0.013177871704101562 total time spend for step 9 : 25.864529848098755 step10:send_mail_cod Tue Feb 4 03:24:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20196760_04-02-2025_03_24_43.pdf 20197109 imagette201971091738635883 20197106 imagette201971061738635883 20197114 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201971141738635883 20197121 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201971211738635884 20197110 imagette201971101738635885 20197111 imagette201971111738635885 20197112 imagette201971121738635885 20197113 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201971131738635885 20197120 imagette201971201738635886 20197116 change filename to text .imagette201971161738635886 20197118 imagette201971181738635886 20197122 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201971221738635886 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20196760 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20197127,20197124,20197132,20197139,20197128,20197129,20197130,20197131,20197138,20197134,20197135,20197136,20197140?tags=pehd,film_plastique,carton,papier,tetrapak,flou,mal_croppe,autre,pet_fonce,metal,environnement,refus,pet_clair&datou_id_consolidate=4235&port_consolidate=20196760&tree_id=75861 your option no_mail is active, we will not send the real mail to your client args[1334217286] : ((1334217286, -7.960085182726687, 492609224), (1334217286, -0.41441028429062093, 496442774), '0.1508543991833287') We are sending mail with results at cod@fotonower.com args[1334216556] : ((1334216556, -7.956346478412187, 492609224), (1334216556, -0.41407080045425615, 496442774), '0.1508543991833287') We are sending mail with results at cod@fotonower.com args[1334216554] : ((1334216554, -7.948476159060896, 492609224), (1334216554, -0.4273386951330898, 496442774), '0.1508543991833287') We are sending mail with results at cod@fotonower.com args[1334216552] : ((1334216552, -7.945079271240314, 492609224), (1334216552, -0.4351045999408367, 496442774), '0.1508543991833287') We are sending mail with results at cod@fotonower.com args[1334216549] : ((1334216549, -7.946252598374099, 492609224), (1334216549, -0.44302575142788825, 496442774), '0.1508543991833287') We are sending mail with results at cod@fotonower.com refus_total : 0.1508543991833287 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20196760 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196760_04-02-2025_03_24_43.pdf results_Qualipapia_P20196760_04-02-2025_03_24_43.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196760_04-02-2025_03_24_43.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20196760','results_Qualipapia_P20196760_04-02-2025_03_24_43.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196760_04-02-2025_03_24_43.pdf','pdf','','0.18','0.1508543991833287') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1334217286, 1334216556, 1334216554, 1334216552, 1334216549] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334217286', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216556', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216554', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216552', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216549', None, None, None, None, None, '2542844') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.015227794647216797 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.855613470077515 time spend to save output : 0.015497922897338867 total time spend for step 10 : 4.8711113929748535 step11:split_time_score Tue Feb 4 03:24:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03022025 20196760 Nombre de photos uploadées : 6 / 23040 (0%) 03022025 20196760 Nombre de photos taguées (types de déchets): 6 / 6 (100%) 03022025 20196760 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.0003337860107421875 elapsed_time : insert_dashboard_record_day_entry 0.025619029998779297 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176367 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176369 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176371 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176372 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176373 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177132 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177536 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177537 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177538 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177540 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177542 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177544 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177136 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177137 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177139 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177141 order by id desc limit 1 Qualite : 0.21292892814622896 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20177143_03-02-2025_13_38_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177143 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20177143 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177145 order by id desc limit 1 Qualite : 0.2424867140556751 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20177147_03-02-2025_13_17_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177147 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20177147 AND mptpi.`type`=4230 To do Qualite : 0.19451837294234825 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20177148_03-02-2025_13_22_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177148 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20177148 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177546 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177548 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196659 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196660 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196661 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178445 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178447 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178449 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177550 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177551 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177552 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177553 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177554 order by id desc limit 1 Qualite : 0.2145365304915854 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20177555_03-02-2025_13_50_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20177555 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178451 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178453 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178454 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178455 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178456 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178457 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178458 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178459 order by id desc limit 1 Qualite : 0.2040980434753746 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20178460_03-02-2025_15_34_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178460 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20178460 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178461 order by id desc limit 1 Qualite : 0.18915657544982803 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20178463_03-02-2025_15_49_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178463 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20178463 AND mptpi.`type`=4230 To do Qualite : 0.1316372178669276 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20178464_03-02-2025_14_18_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20178464 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196674 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196675 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196676 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196677 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196678 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196679 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196680 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196681 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196682 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196683 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196684 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196685 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196686 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196687 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196688 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196689 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196690 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196691 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196692 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196693 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196694 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196695 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196696 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196697 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196698 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196699 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196734 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196753 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196754 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196755 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196756 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196757 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196758 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196759 order by id desc limit 1 Qualite : 0.1508543991833287 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196760_04-02-2025_03_24_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196760 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196760 AND mptpi.`type`=4230 To do Qualite : 0.1633757293295666 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196761_04-02-2025_03_12_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196761 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196761 AND mptpi.`type`=4230 To do Qualite : 0.15382133591622987 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196762_04-02-2025_03_18_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196762 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196762 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182947 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182948 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182949 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182950 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182951 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182952 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182953 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182954 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182955 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182956 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182957 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182958 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182959 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182960 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182961 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182962 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182963 order by id desc limit 1 Qualite : 0.17741188572002212 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20182964_03-02-2025_16_42_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182964 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20182964 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182965 order by id desc limit 1 Qualite : 0.17337574359014693 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20182966_03-02-2025_16_51_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182966 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20182966 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195963 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195982 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196001 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196002 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196003 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196004 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196005 order by id desc limit 1 Qualite : 0.22031956872303599 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196006_04-02-2025_02_55_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196006 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196006 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196007 order by id desc limit 1 Qualite : 0.2081495019131404 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196008_04-02-2025_02_19_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196008 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196008 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196009 order by id desc limit 1 Qualite : 0.17369673605767658 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196010_04-02-2025_02_43_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196010 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196010 AND mptpi.`type`=4230 To do Qualite : 0.19649604863611195 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196011_04-02-2025_02_26_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196011 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196011 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195286 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195287 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195288 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195289 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195290 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195291 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195292 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195293 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195294 order by id desc limit 1 Qualite : 0.2590217849133118 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20195295_04-02-2025_02_13_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195295 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20195295 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195296 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195297 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185147 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185148 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185149 order by id desc limit 1 Qualite : 0.19514078321323755 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20185150_03-02-2025_17_56_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185150 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20185150 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185151 order by id desc limit 1 Qualite : 0.2109236656958151 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20185152_03-02-2025_17_34_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185152 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20185152 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185153 order by id desc limit 1 Qualite : 0.2058590485936177 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20195298_04-02-2025_01_33_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195298 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20195298 AND mptpi.`type`=4230 To do Qualite : 0.16358385040964132 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20195299_04-02-2025_01_20_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195299 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20195299 AND mptpi.`type`=4230 To do Qualite : 0.16237848895335452 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20195300_04-02-2025_01_12_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195300 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20195300 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187883 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187885 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187886 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187906 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187925 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187927 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187928 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187930 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187931 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187957 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187958 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187960 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187961 order by id desc limit 1 Qualite : 0.22976580988085368 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187963_03-02-2025_21_52_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187963 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187963 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187237 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187239 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187241 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187242 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187243 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187244 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187245 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187246 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187249 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187250 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187252 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187253 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187255 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187256 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187257 order by id desc limit 1 Qualite : 0.19365526838404737 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187258_03-02-2025_18_41_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187258 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187258 AND mptpi.`type`=4230 To do Qualite : 0.19095206134394982 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187964_03-02-2025_19_33_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187964 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187964 AND mptpi.`type`=4230 To do Qualite : 0.19225791186413807 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187966_03-02-2025_18_56_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187966 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187966 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187261 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187262 order by id desc limit 1 Qualite : 0.18675850133235133 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187263_03-02-2025_18_23_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187263 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187263 AND mptpi.`type`=4230 To do Qualite : 0.2120167913685455 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20194589_04-02-2025_00_32_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20194589 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20194589 AND mptpi.`type`=4230 To do Qualite : 0.2088999932101745 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20190513_03-02-2025_20_33_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20190513 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20190513 AND mptpi.`type`=4230 To do Qualite : 0.18671028645624485 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20190539_03-02-2025_21_38_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20190539 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20190539 AND mptpi.`type`=4230 To do Qualite : 0.17408052439626492 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20190542_03-02-2025_19_48_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20190542 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20190542 AND mptpi.`type`=4230 To do Qualite : 0.20425164642167953 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20194590_04-02-2025_00_11_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20194590 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20194590 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03022025': {'nb_upload': 6, 'nb_taggue_class': 6, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1334217286, 1334216556, 1334216554, 1334216552, 1334216549] Looping around the photos to save general results len do output : 1 /20196760Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334217286', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216556', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216554', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216552', None, None, None, None, None, '2542844') ('4234', None, None, None, None, None, None, None, '2542844') ('4234', '20196760', '1334216549', None, None, None, None, None, '2542844') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.04908394813537598 save_final save missing photos in datou_result : time spend for datou_step_exec : 119.85284090042114 time spend to save output : 0.04926657676696777 total time spend for step 11 : 119.90210747718811 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 57.09user 34.83system 6:23.40elapsed 23%CPU (0avgtext+0avgdata 2530184maxresident)k 712288inputs+23048outputs (648major+2760490minor)pagefaults 0swaps