python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1222209 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 13>5 please execute split_portfolio.py -i 20162680 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2538711'] with mtr_portfolio_ids : ['20162680'] and first list_photo_ids : [] new path : /proc/1222209/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.7832789421081543 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Feb 3 04:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-03 04:20:32.689433: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-03 04:20:32.715473: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-03 04:20:32.717274: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f91ac000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-03 04:20:32.717335: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-03 04:20:32.720885: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-03 04:20:32.966570: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x22e965f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-03 04:20:32.966652: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-03 04:20:32.968023: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-03 04:20:32.968539: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 04:20:32.971531: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 04:20:32.974109: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-03 04:20:32.974609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-03 04:20:32.977688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-03 04:20:32.979382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-03 04:20:32.985645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-03 04:20:32.987705: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-03 04:20:32.987828: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 04:20:32.988662: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-03 04:20:32.988678: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-03 04:20:32.988688: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-03 04:20:32.990020: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-03 04:20:33.253682: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-03 04:20:33.253781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 04:20:33.253805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 04:20:33.253827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-03 04:20:33.253848: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-03 04:20:33.253869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-03 04:20:33.253888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-03 04:20:33.253909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-03 04:20:33.255515: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-03 04:20:33.256779: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-03 04:20:33.256814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 04:20:33.256833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 04:20:33.256850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-03 04:20:33.256867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-03 04:20:33.256884: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-03 04:20:33.256900: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-03 04:20:33.256917: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-03 04:20:33.258465: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-03 04:20:33.258494: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-03 04:20:33.258504: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-03 04:20:33.258514: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-03 04:20:33.260137: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-03 04:20:40.359388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 04:20:40.544770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.91484 max: 145.24844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0008807182312011719 length of segment : 29 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 925 time to create 1 rle with old method : 0.001819610595703125 length of segment : 40 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 909 time to create 1 rle with old method : 0.001859426498413086 length of segment : 39 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0016973018646240234 length of segment : 34 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0014159679412841797 length of segment : 36 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004475116729736328 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.74688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.0011475086212158203 length of segment : 35 time for calcul the mask position with numpy : 0.00010442733764648438 nb_pixel_total : 3427 time to create 1 rle with old method : 0.0043680667877197266 length of segment : 68 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0007188320159912109 length of segment : 36 time for calcul the mask position with numpy : 0.00017452239990234375 nb_pixel_total : 101 time to create 1 rle with old method : 0.00014972686767578125 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -93.00078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00013875961303710938 nb_pixel_total : 2609 time to create 1 rle with old method : 0.003526926040649414 length of segment : 168 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1903 time to create 1 rle with old method : 0.0025305747985839844 length of segment : 58 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.24688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0007731914520263672 length of segment : 27 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003409385681152344 length of segment : 22 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004608631134033203 length of segment : 20 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.56875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 903 time to create 1 rle with old method : 0.0011785030364990234 length of segment : 43 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0007047653198242188 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 26.00000 max: 207.00000 molded_images shape: (1, 640, 640, 3) min: -82.28594 max: 78.22891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.99297 max: 150.67812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 922 time to create 1 rle with old method : 0.0012054443359375 length of segment : 58 time for calcul the mask position with numpy : 0.00014925003051757812 nb_pixel_total : 8730 time to create 1 rle with old method : 0.010278463363647461 length of segment : 141 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004799365997314453 length of segment : 27 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00024771690368652344 length of segment : 12 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001780986785888672 length of segment : 11 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00020265579223632812 length of segment : 14 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.00028824806213378906 length of segment : 19 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003349781036376953 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.77813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 949 time to create 1 rle with old method : 0.0013918876647949219 length of segment : 43 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 734 time to create 1 rle with old method : 0.0009262561798095703 length of segment : 63 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005726814270019531 length of segment : 27 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006973743438720703 length of segment : 37 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00029087066650390625 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.84453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 2018 time to create 1 rle with old method : 0.002481698989868164 length of segment : 138 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0007700920104980469 length of segment : 17 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0016071796417236328 length of segment : 41 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 1987 time to create 1 rle with old method : 0.0025370121002197266 length of segment : 100 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.00043892860412597656 length of segment : 27 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1491 time to create 1 rle with old method : 0.0019397735595703125 length of segment : 115 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1345 time to create 1 rle with old method : 0.0017240047454833984 length of segment : 50 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 37 time to create 1 rle with old method : 9.655952453613281e-05 length of segment : 10 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1420 time to create 1 rle with old method : 0.0017559528350830078 length of segment : 49 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0014231204986572266 length of segment : 36 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 883 time to create 1 rle with old method : 0.001077890396118164 length of segment : 37 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 823 time to create 1 rle with old method : 0.001039743423461914 length of segment : 37 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.27969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0005385875701904297 length of segment : 39 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004279613494873047 length of segment : 30 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1864 time to create 1 rle with old method : 0.0022804737091064453 length of segment : 89 time for calcul the mask position with numpy : 0.0001518726348876953 nb_pixel_total : 4229 time to create 1 rle with old method : 0.005548238754272461 length of segment : 197 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 651 time to create 1 rle with old method : 0.0008778572082519531 length of segment : 40 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 897 time to create 1 rle with old method : 0.00116729736328125 length of segment : 36 time for calcul the mask position with numpy : 0.0002155303955078125 nb_pixel_total : 4188 time to create 1 rle with old method : 0.005025625228881836 length of segment : 197 Processing 1 images image shape: (280, 400, 3) min: 29.00000 max: 189.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 68.36172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0011527538299560547 nb_pixel_total : 105612 time to create 1 rle with old method : 0.11848068237304688 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.00039505958557128906 length of segment : 34 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0004763603210449219 length of segment : 22 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1546 time to create 1 rle with old method : 0.0018379688262939453 length of segment : 87 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.001104116439819336 length of segment : 52 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1422 time to create 1 rle with old method : 0.0017573833465576172 length of segment : 56 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 2344 time to create 1 rle with old method : 0.002832651138305664 length of segment : 62 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.00046372413635253906 length of segment : 11 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.07266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 2123 time to create 1 rle with old method : 0.002610445022583008 length of segment : 48 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00015044212341308594 length of segment : 10 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00016164779663085938 length of segment : 16 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 3266 time to create 1 rle with old method : 0.004157066345214844 length of segment : 108 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 2421 time to create 1 rle with old method : 0.003013134002685547 length of segment : 80 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00018930435180664062 length of segment : 11 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 911 time to create 1 rle with old method : 0.0011196136474609375 length of segment : 44 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003466606140136719 length of segment : 21 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1160 time to create 1 rle with old method : 0.0015261173248291016 length of segment : 51 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 50 time to create 1 rle with old method : 0.00010251998901367188 length of segment : 8 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.90859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005092620849609375 length of segment : 24 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.00016880035400390625 length of segment : 11 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00031304359436035156 length of segment : 32 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1635 time to create 1 rle with old method : 0.002007722854614258 length of segment : 63 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003383159637451172 length of segment : 51 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00015020370483398438 length of segment : 9 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00018072128295898438 length of segment : 18 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00027298927307128906 length of segment : 24 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 41 time to create 1 rle with old method : 9.036064147949219e-05 length of segment : 6 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 718 time to create 1 rle with old method : 0.0009303092956542969 length of segment : 38 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00022864341735839844 length of segment : 40 time for calcul the mask position with numpy : 0.0004074573516845703 nb_pixel_total : 35924 time to create 1 rle with old method : 0.04070019721984863 length of segment : 271 time for calcul the mask position with numpy : 0.0004210472106933594 nb_pixel_total : 32257 time to create 1 rle with old method : 0.0357666015625 length of segment : 225 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.53984 max: 144.97891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 886 time to create 1 rle with old method : 0.0016694068908691406 length of segment : 32 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 908 time to create 1 rle with old method : 0.001718282699584961 length of segment : 32 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 823 time to create 1 rle with old method : 0.0015645027160644531 length of segment : 43 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0007739067077636719 length of segment : 28 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 835 time to create 1 rle with old method : 0.0015840530395507812 length of segment : 32 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1194 time to create 1 rle with old method : 0.002287149429321289 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.85625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0009305477142333984 length of segment : 36 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2075 time to create 1 rle with old method : 0.002607583999633789 length of segment : 48 time for calcul the mask position with numpy : 0.00043582916259765625 nb_pixel_total : 20968 time to create 1 rle with old method : 0.024208545684814453 length of segment : 538 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -90.99688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 2633 time to create 1 rle with old method : 0.003430604934692383 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.16328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00032806396484375 length of segment : 21 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0007588863372802734 length of segment : 26 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004963874816894531 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.15469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0008795261383056641 length of segment : 18 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0003032684326171875 length of segment : 12 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0003235340118408203 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 31.00000 max: 230.00000 molded_images shape: (1, 640, 640, 3) min: -77.46172 max: 98.26016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.60625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1348 time to create 1 rle with old method : 0.0016677379608154297 length of segment : 46 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005643367767333984 length of segment : 24 time for calcul the mask position with numpy : 0.00017261505126953125 nb_pixel_total : 10595 time to create 1 rle with old method : 0.012868165969848633 length of segment : 123 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.000331878662109375 length of segment : 23 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001914501190185547 length of segment : 12 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005817413330078125 length of segment : 26 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002505779266357422 length of segment : 13 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00023102760314941406 length of segment : 14 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0007007122039794922 length of segment : 20 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001747608184814453 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00013685226440429688 length of segment : 9 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 863 time to create 1 rle with old method : 0.0012543201446533203 length of segment : 38 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007548332214355469 length of segment : 47 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005581378936767578 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006155967712402344 length of segment : 35 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 979 time to create 1 rle with old method : 0.0013020038604736328 length of segment : 29 time for calcul the mask position with numpy : 0.00031280517578125 nb_pixel_total : 15652 time to create 1 rle with old method : 0.018686532974243164 length of segment : 163 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003228187561035156 length of segment : 19 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005636215209960938 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.20000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 2146 time to create 1 rle with old method : 0.002795696258544922 length of segment : 150 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 1808 time to create 1 rle with old method : 0.002432107925415039 length of segment : 88 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008695125579833984 length of segment : 20 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 1262 time to create 1 rle with old method : 0.001603841781616211 length of segment : 33 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.00044918060302734375 length of segment : 29 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 826 time to create 1 rle with old method : 0.001026153564453125 length of segment : 35 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005085468292236328 length of segment : 24 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0016794204711914062 length of segment : 41 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 916 time to create 1 rle with old method : 0.001220703125 length of segment : 35 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0009582042694091797 length of segment : 19 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0016086101531982422 length of segment : 41 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.63125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0006020069122314453 length of segment : 39 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004456043243408203 length of segment : 30 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 684 time to create 1 rle with old method : 0.00091552734375 length of segment : 37 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1749 time to create 1 rle with old method : 0.0021445751190185547 length of segment : 86 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007996559143066406 length of segment : 43 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 3994 time to create 1 rle with old method : 0.004891157150268555 length of segment : 215 time for calcul the mask position with numpy : 0.00019502639770507812 nb_pixel_total : 4709 time to create 1 rle with old method : 0.005859851837158203 length of segment : 240 time for calcul the mask position with numpy : 0.0001723766326904297 nb_pixel_total : 3816 time to create 1 rle with old method : 0.004992961883544922 length of segment : 195 Processing 1 images image shape: (280, 400, 3) min: 33.00000 max: 201.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 88.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009076595306396484 nb_pixel_total : 102886 time to create 1 rle with old method : 0.1220545768737793 length of segment : 273 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003407001495361328 length of segment : 21 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005359649658203125 length of segment : 22 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.0001316070556640625 length of segment : 11 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 4013 time to create 1 rle with old method : 0.004930973052978516 length of segment : 63 time for calcul the mask position with numpy : 0.0002205371856689453 nb_pixel_total : 6571 time to create 1 rle with old method : 0.00791478157043457 length of segment : 154 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1525 time to create 1 rle with old method : 0.0018842220306396484 length of segment : 89 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.18203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 610 time to create 1 rle with old method : 0.0008404254913330078 length of segment : 29 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005214214324951172 length of segment : 20 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 2117 time to create 1 rle with old method : 0.0026450157165527344 length of segment : 45 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1220 time to create 1 rle with old method : 0.0015778541564941406 length of segment : 53 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002574920654296875 length of segment : 14 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.0011749267578125 length of segment : 44 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 2725 time to create 1 rle with old method : 0.0032989978790283203 length of segment : 64 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00029921531677246094 length of segment : 21 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00015282630920410156 length of segment : 14 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 2550 time to create 1 rle with old method : 0.0030629634857177734 length of segment : 55 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1131 time to create 1 rle with old method : 0.0014622211456298828 length of segment : 55 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.40078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1304 time to create 1 rle with old method : 0.0017085075378417969 length of segment : 55 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00016880035400390625 length of segment : 12 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004360675811767578 length of segment : 69 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.00018262863159179688 length of segment : 14 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00034546852111816406 length of segment : 36 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00033664703369140625 length of segment : 23 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.0001468658447265625 length of segment : 12 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.00011038780212402344 length of segment : 8 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1509 time to create 1 rle with old method : 0.0019507408142089844 length of segment : 54 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.00011110305786132812 length of segment : 8 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.000339508056640625 length of segment : 50 time for calcul the mask position with numpy : 0.0004096031188964844 nb_pixel_total : 33618 time to create 1 rle with old method : 0.03824257850646973 length of segment : 293 time for calcul the mask position with numpy : 0.0004100799560546875 nb_pixel_total : 35021 time to create 1 rle with old method : 0.04065680503845215 length of segment : 247 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.55156 max: 145.08437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 902 time to create 1 rle with old method : 0.0012617111206054688 length of segment : 32 time for calcul the mask position with numpy : 0.0002830028533935547 nb_pixel_total : 12740 time to create 1 rle with old method : 0.015157222747802734 length of segment : 216 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005469322204589844 length of segment : 27 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0004935264587402344 length of segment : 29 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 893 time to create 1 rle with old method : 0.0011799335479736328 length of segment : 36 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 702 time to create 1 rle with old method : 0.0009810924530029297 length of segment : 36 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0007178783416748047 length of segment : 40 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.000993490219116211 length of segment : 60 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 784 time to create 1 rle with old method : 0.0010759830474853516 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.11406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 902 time to create 1 rle with old method : 0.0011637210845947266 length of segment : 41 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 2767 time to create 1 rle with old method : 0.0033693313598632812 length of segment : 54 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 2139 time to create 1 rle with old method : 0.002748727798461914 length of segment : 37 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 2375 time to create 1 rle with old method : 0.0029115676879882812 length of segment : 49 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 2143 time to create 1 rle with old method : 0.0026504993438720703 length of segment : 48 Processing 1 images image shape: (400, 400, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -99.27422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0005972385406494141 nb_pixel_total : 26809 time to create 1 rle with old method : 0.031380653381347656 length of segment : 442 time for calcul the mask position with numpy : 0.00013327598571777344 nb_pixel_total : 7139 time to create 1 rle with old method : 0.008172750473022461 length of segment : 110 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.85625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00032448768615722656 length of segment : 22 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0007905960083007812 length of segment : 27 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005266666412353516 length of segment : 23 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0014853477478027344 length of segment : 68 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.26797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0008034706115722656 length of segment : 17 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00021719932556152344 length of segment : 13 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00022125244140625 length of segment : 13 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0005371570587158203 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 26.00000 max: 222.00000 molded_images shape: (1, 640, 640, 3) min: -77.58672 max: 92.62734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.92266 max: 150.78359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005657672882080078 length of segment : 25 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002384185791015625 length of segment : 14 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00028228759765625 length of segment : 22 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006811618804931641 length of segment : 20 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003337860107421875 length of segment : 11 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.00018310546875 length of segment : 11 time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 7363 time to create 1 rle with old method : 0.008776426315307617 length of segment : 141 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0006353855133056641 length of segment : 26 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.0011196136474609375 length of segment : 38 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002002716064453125 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.66484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005071163177490234 length of segment : 45 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 68 time to create 1 rle with old method : 0.00012350082397460938 length of segment : 9 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0004892349243164062 length of segment : 22 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0004279613494873047 length of segment : 19 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0009477138519287109 length of segment : 36 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0009539127349853516 length of segment : 36 time for calcul the mask position with numpy : 0.00023221969604492188 nb_pixel_total : 12300 time to create 1 rle with old method : 0.014416694641113281 length of segment : 104 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 534 time to create 1 rle with old method : 0.0007066726684570312 length of segment : 29 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 985 time to create 1 rle with old method : 0.0013294219970703125 length of segment : 42 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003235340118408203 length of segment : 18 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 37 time to create 1 rle with old method : 9.775161743164062e-05 length of segment : 5 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 11249 time to create 1 rle with old method : 0.013182640075683594 length of segment : 96 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.0012049674987792969 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.74688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 2205 time to create 1 rle with old method : 0.0027532577514648438 length of segment : 157 time for calcul the mask position with numpy : 0.0001347064971923828 nb_pixel_total : 2229 time to create 1 rle with old method : 0.002791881561279297 length of segment : 134 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0007457733154296875 length of segment : 18 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.000823974609375 length of segment : 19 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 2520 time to create 1 rle with old method : 0.003133058547973633 length of segment : 55 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1289 time to create 1 rle with old method : 0.001861572265625 length of segment : 45 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0021829605102539062 length of segment : 41 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 2790 time to create 1 rle with old method : 0.00726771354675293 length of segment : 68 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 812 time to create 1 rle with old method : 0.0014438629150390625 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.92812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0006015300750732422 length of segment : 38 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.00046706199645996094 length of segment : 31 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1839 time to create 1 rle with old method : 0.0022313594818115234 length of segment : 87 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.0008149147033691406 length of segment : 40 time for calcul the mask position with numpy : 0.00015783309936523438 nb_pixel_total : 4176 time to create 1 rle with old method : 0.004994630813598633 length of segment : 217 time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 4550 time to create 1 rle with old method : 0.005618095397949219 length of segment : 211 Processing 1 images image shape: (280, 400, 3) min: 33.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 80.29531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009138584136962891 nb_pixel_total : 102513 time to create 1 rle with old method : 0.11511468887329102 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.95937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.000457763671875 length of segment : 20 time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 7183 time to create 1 rle with old method : 0.008491992950439453 length of segment : 209 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00012922286987304688 length of segment : 11 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003228187561035156 length of segment : 21 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 38 time to create 1 rle with old method : 8.749961853027344e-05 length of segment : 9 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1523 time to create 1 rle with old method : 0.0018396377563476562 length of segment : 84 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.29922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.00047206878662109375 length of segment : 18 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 2014 time to create 1 rle with old method : 0.002476215362548828 length of segment : 44 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00013518333435058594 length of segment : 9 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0008685588836669922 length of segment : 29 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 2094 time to create 1 rle with old method : 0.002705812454223633 length of segment : 46 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 2708 time to create 1 rle with old method : 0.0033767223358154297 length of segment : 64 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0011706352233886719 length of segment : 45 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 936 time to create 1 rle with old method : 0.0011510848999023438 length of segment : 44 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00016832351684570312 length of segment : 17 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00018286705017089844 length of segment : 10 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0014674663543701172 length of segment : 42 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.86562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 931 time to create 1 rle with old method : 0.0012493133544921875 length of segment : 60 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004439353942871094 length of segment : 54 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003972053527832031 length of segment : 37 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00016355514526367188 length of segment : 11 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.00038743019104003906 length of segment : 29 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00022482872009277344 length of segment : 22 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1202 time to create 1 rle with old method : 0.001580953598022461 length of segment : 54 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 45 time to create 1 rle with old method : 9.393692016601562e-05 length of segment : 7 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 23 time to create 1 rle with old method : 0.00013518333435058594 length of segment : 17 time for calcul the mask position with numpy : 0.0005910396575927734 nb_pixel_total : 36209 time to create 1 rle with old method : 0.04443550109863281 length of segment : 245 time for calcul the mask position with numpy : 0.0004336833953857422 nb_pixel_total : 35582 time to create 1 rle with old method : 0.03991866111755371 length of segment : 242 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.55156 max: 145.61953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 894 time to create 1 rle with old method : 0.0012090206146240234 length of segment : 36 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 822 time to create 1 rle with old method : 0.0011048316955566406 length of segment : 49 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0005648136138916016 length of segment : 28 time for calcul the mask position with numpy : 0.0002982616424560547 nb_pixel_total : 13477 time to create 1 rle with old method : 0.016202211380004883 length of segment : 193 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.0011103153228759766 length of segment : 39 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.88750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1206 time to create 1 rle with old method : 0.0015921592712402344 length of segment : 33 time for calcul the mask position with numpy : 0.0002968311309814453 nb_pixel_total : 16084 time to create 1 rle with old method : 0.018517494201660156 length of segment : 296 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 2845 time to create 1 rle with old method : 0.0035665035247802734 length of segment : 70 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -93.52422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 4582 time to create 1 rle with old method : 0.005640745162963867 length of segment : 99 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.63750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0004162788391113281 length of segment : 22 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00036072731018066406 length of segment : 14 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.31484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0006799697875976562 length of segment : 17 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 878 time to create 1 rle with old method : 0.0010945796966552734 length of segment : 52 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002300739288330078 length of segment : 13 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002624988555908203 length of segment : 14 time for calcul the mask position with numpy : 0.000698089599609375 nb_pixel_total : 65729 time to create 1 rle with old method : 0.07417774200439453 length of segment : 331 Processing 1 images image shape: (400, 400, 3) min: 29.00000 max: 225.00000 molded_images shape: (1, 640, 640, 3) min: -79.82500 max: 97.59609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.33281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003631114959716797 length of segment : 20 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00021529197692871094 length of segment : 13 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00027060508728027344 length of segment : 13 time for calcul the mask position with numpy : 0.000152587890625 nb_pixel_total : 8985 time to create 1 rle with old method : 0.010740518569946289 length of segment : 143 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003027915954589844 length of segment : 22 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002491474151611328 length of segment : 15 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001976490020751953 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.09844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0005595684051513672 length of segment : 48 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00011873245239257812 length of segment : 9 time for calcul the mask position with numpy : 0.00023603439331054688 nb_pixel_total : 12362 time to create 1 rle with old method : 0.014554023742675781 length of segment : 111 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 874 time to create 1 rle with old method : 0.0012173652648925781 length of segment : 41 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.0007071495056152344 length of segment : 29 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00026726722717285156 length of segment : 14 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0005023479461669922 length of segment : 20 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.0002491474151611328 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.34453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 2093 time to create 1 rle with old method : 0.0026133060455322266 length of segment : 148 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 731 time to create 1 rle with old method : 0.0010585784912109375 length of segment : 19 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 1964 time to create 1 rle with old method : 0.002552032470703125 length of segment : 131 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 3296 time to create 1 rle with old method : 0.004185199737548828 length of segment : 55 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1344 time to create 1 rle with old method : 0.001840353012084961 length of segment : 43 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 634 time to create 1 rle with old method : 0.0009217262268066406 length of segment : 19 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00021028518676757812 length of segment : 16 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 2995 time to create 1 rle with old method : 0.003813505172729492 length of segment : 50 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.92812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 431 time to create 1 rle with old method : 0.0005578994750976562 length of segment : 39 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005068778991699219 length of segment : 31 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1813 time to create 1 rle with old method : 0.002347707748413086 length of segment : 88 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006611347198486328 length of segment : 34 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 1530 time to create 1 rle with old method : 0.001980304718017578 length of segment : 125 time for calcul the mask position with numpy : 0.0002295970916748047 nb_pixel_total : 5186 time to create 1 rle with old method : 0.006385087966918945 length of segment : 261 time for calcul the mask position with numpy : 0.00017070770263671875 nb_pixel_total : 3991 time to create 1 rle with old method : 0.004801750183105469 length of segment : 194 time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 4177 time to create 1 rle with old method : 0.0047876834869384766 length of segment : 211 Processing 1 images image shape: (280, 400, 3) min: 35.00000 max: 209.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 97.20937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009481906890869141 nb_pixel_total : 106070 time to create 1 rle with old method : 0.12307262420654297 length of segment : 278 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0004291534423828125 length of segment : 20 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003056526184082031 length of segment : 20 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00016236305236816406 length of segment : 23 time for calcul the mask position with numpy : 0.00019693374633789062 nb_pixel_total : 6999 time to create 1 rle with old method : 0.008283138275146484 length of segment : 237 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1518 time to create 1 rle with old method : 0.001800537109375 length of segment : 81 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.31875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 2161 time to create 1 rle with old method : 0.0026488304138183594 length of segment : 47 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003726482391357422 length of segment : 23 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0005249977111816406 length of segment : 20 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 609 time to create 1 rle with old method : 0.0008206367492675781 length of segment : 29 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 2536 time to create 1 rle with old method : 0.0032291412353515625 length of segment : 60 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00020813941955566406 length of segment : 10 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 2069 time to create 1 rle with old method : 0.0025513172149658203 length of segment : 44 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1351 time to create 1 rle with old method : 0.0016608238220214844 length of segment : 53 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1230 time to create 1 rle with old method : 0.0015387535095214844 length of segment : 55 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.92812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006310939788818359 length of segment : 80 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.00044989585876464844 length of segment : 45 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00018215179443359375 length of segment : 11 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.00014352798461914062 length of segment : 9 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 49 time to create 1 rle with old method : 0.00010180473327636719 length of segment : 7 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00012445449829101562 length of segment : 17 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002620220184326172 length of segment : 17 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1491 time to create 1 rle with old method : 0.001996755599975586 length of segment : 24 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.0006062984466552734 length of segment : 47 time for calcul the mask position with numpy : 0.0006711483001708984 nb_pixel_total : 33977 time to create 1 rle with old method : 0.06052136421203613 length of segment : 243 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.61406 max: 145.32266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.0005753040313720703 nb_pixel_total : 20741 time to create 1 rle with old method : 0.029868364334106445 length of segment : 163 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 948 time to create 1 rle with old method : 0.0013129711151123047 length of segment : 36 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 933 time to create 1 rle with old method : 0.0011138916015625 length of segment : 31 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1190 time to create 1 rle with old method : 0.0016412734985351562 length of segment : 28 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0005505084991455078 length of segment : 28 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.00047659873962402344 length of segment : 28 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 794 time to create 1 rle with old method : 0.0010280609130859375 length of segment : 50 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1919 time to create 1 rle with old method : 0.0023109912872314453 length of segment : 39 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1887 time to create 1 rle with old method : 0.0022666454315185547 length of segment : 35 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.00048542022705078125 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.25078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0018427371978759766 length of segment : 46 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 2254 time to create 1 rle with old method : 0.002668619155883789 length of segment : 51 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2598 time to create 1 rle with old method : 0.003063201904296875 length of segment : 59 Processing 1 images image shape: (400, 400, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -91.91094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003714561462402344 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0007264614105224609 length of segment : 27 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003063678741455078 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.64687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0006148815155029297 length of segment : 16 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1068 time to create 1 rle with old method : 0.0013408660888671875 length of segment : 53 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005462169647216797 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 8.00000 max: 219.00000 molded_images shape: (1, 640, 640, 3) min: -89.03203 max: 85.67266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.001249551773071289 nb_pixel_total : 152831 time to create 1 rle with new method : 0.0019562244415283203 length of segment : 394 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.51250 max: 150.36172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003895759582519531 length of segment : 25 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003070831298828125 length of segment : 23 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1371 time to create 1 rle with old method : 0.0016779899597167969 length of segment : 48 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00018739700317382812 length of segment : 12 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 6011 time to create 1 rle with old method : 0.0071942806243896484 length of segment : 150 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00020503997802734375 length of segment : 14 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.0002262592315673828 length of segment : 13 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00024819374084472656 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.09844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 971 time to create 1 rle with old method : 0.0013303756713867188 length of segment : 44 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005846023559570312 length of segment : 41 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005352497100830078 length of segment : 22 time for calcul the mask position with numpy : 0.00024175643920898438 nb_pixel_total : 12118 time to create 1 rle with old method : 0.014953851699829102 length of segment : 113 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006747245788574219 length of segment : 31 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003781318664550781 length of segment : 17 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.0001304149627685547 length of segment : 10 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.000274658203125 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.88359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 1791 time to create 1 rle with old method : 0.002146482467651367 length of segment : 116 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0008757114410400391 length of segment : 20 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 1714 time to create 1 rle with old method : 0.002081155776977539 length of segment : 137 time for calcul the mask position with numpy : 0.00011324882507324219 nb_pixel_total : 2101 time to create 1 rle with old method : 0.0027112960815429688 length of segment : 105 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 2852 time to create 1 rle with old method : 0.003495454788208008 length of segment : 57 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1319 time to create 1 rle with old method : 0.0018711090087890625 length of segment : 43 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.001115560531616211 length of segment : 37 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 755 time to create 1 rle with old method : 0.0011720657348632812 length of segment : 21 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1337 time to create 1 rle with old method : 0.0017971992492675781 length of segment : 42 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.90859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006196498870849609 length of segment : 40 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1767 time to create 1 rle with old method : 0.0021636486053466797 length of segment : 87 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0007231235504150391 length of segment : 47 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.00045943260192871094 length of segment : 32 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1277 time to create 1 rle with old method : 0.001672983169555664 length of segment : 123 time for calcul the mask position with numpy : 0.0001990795135498047 nb_pixel_total : 4213 time to create 1 rle with old method : 0.00525212287902832 length of segment : 221 time for calcul the mask position with numpy : 0.0001659393310546875 nb_pixel_total : 3725 time to create 1 rle with old method : 0.0044252872467041016 length of segment : 197 Processing 1 images image shape: (280, 400, 3) min: 15.00000 max: 203.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 78.36016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0016133785247802734 nb_pixel_total : 106188 time to create 1 rle with old method : 0.11755180358886719 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.78359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0006425380706787109 length of segment : 22 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00038552284240722656 length of segment : 11 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.24453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 2152 time to create 1 rle with old method : 0.003686666488647461 length of segment : 47 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.000148773193359375 length of segment : 10 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0005171298980712891 length of segment : 19 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 2366 time to create 1 rle with old method : 0.0029535293579101562 length of segment : 56 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.0002455711364746094 length of segment : 9 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.0008137226104736328 length of segment : 29 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 1365 time to create 1 rle with old method : 0.002229928970336914 length of segment : 52 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 942 time to create 1 rle with old method : 0.0012230873107910156 length of segment : 46 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.000316619873046875 length of segment : 20 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 2566 time to create 1 rle with old method : 0.003100872039794922 length of segment : 65 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00015282630920410156 length of segment : 16 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 888 time to create 1 rle with old method : 0.0011017322540283203 length of segment : 42 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1328 time to create 1 rle with old method : 0.002451181411743164 length of segment : 55 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.85781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003769397735595703 length of segment : 52 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00020432472229003906 length of segment : 10 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.0002760887145996094 length of segment : 13 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 549 time to create 1 rle with old method : 0.0008444786071777344 length of segment : 87 time for calcul the mask position with numpy : 0.00013518333435058594 nb_pixel_total : 2877 time to create 1 rle with old method : 0.005430698394775391 length of segment : 100 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 45 time to create 1 rle with old method : 9.942054748535156e-05 length of segment : 7 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 56 time to create 1 rle with old method : 0.000186920166015625 length of segment : 26 time for calcul the mask position with numpy : 0.0004258155822753906 nb_pixel_total : 37160 time to create 1 rle with old method : 0.04230618476867676 length of segment : 275 time for calcul the mask position with numpy : 0.00014638900756835938 nb_pixel_total : 6 time to create 1 rle with old method : 4.0531158447265625e-05 length of segment : 3 Detection mask done ! Trying to reset tf kernel 1222628 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 417 tf kernel not reseted sub process len(results) : 405 len(list_Values) 405 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 405 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 405 chid ids of type : 4228 Number RLEs to save : 23866 save missing photos in datou_result : time spend for datou_step_exec : 31.06899929046631 time spend to save output : 4.921057939529419 total time spend for step 1 : 35.99005722999573 step2:brightness Mon Feb 3 04:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738552829_1222209_1333949955_209c3a17c68844338b5c664656b5d94c.jpg treat image : temp/1738552829_1222209_1333949953_174a0ae46f1bf5da2d6c2b98cb00868b.jpg treat image : temp/1738552829_1222209_1333949952_39cec83275d04adb77c595708ee05d38.jpg treat image : temp/1738552829_1222209_1333949951_99206d26529f8e4b8ac6a57ad9eccb11.jpg treat image : temp/1738552829_1222209_1333949950_a308d4abe574fe0a9fea732c7a569fb3.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.02034616470336914 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.044016361236572266 save missing photos in datou_result : time spend for datou_step_exec : 1.359344720840454 time spend to save output : 0.06914639472961426 total time spend for step 2 : 1.4284911155700684 step3:blur_detection Mon Feb 3 04:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738552829_1222209_1333949955_209c3a17c68844338b5c664656b5d94c.jpg resize: (1080, 1920) 1333949955 -7.667858176235798 treat image : temp/1738552829_1222209_1333949953_174a0ae46f1bf5da2d6c2b98cb00868b.jpg resize: (1080, 1920) 1333949953 -7.8704964881384605 treat image : temp/1738552829_1222209_1333949952_39cec83275d04adb77c595708ee05d38.jpg resize: (1080, 1920) 1333949952 -7.874767021170974 treat image : temp/1738552829_1222209_1333949951_99206d26529f8e4b8ac6a57ad9eccb11.jpg resize: (1080, 1920) 1333949951 -7.865939573872376 treat image : temp/1738552829_1222209_1333949950_a308d4abe574fe0a9fea732c7a569fb3.jpg resize: (1080, 1920) 1333949950 -7.818194967240829 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.07364630699157715 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.12302899360656738 save missing photos in datou_result : time spend for datou_step_exec : 4.125089645385742 time spend to save output : 0.20120620727539062 total time spend for step 3 : 4.326295852661133 step4:rle_unique_nms_with_priority Mon Feb 3 04:21:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 405 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 80 nb_hashtags : 8 time to prepare the origin masks : 0.9761600494384766 time for calcul the mask position with numpy : 0.13750243186950684 nb_pixel_total : 1864702 time to create 1 rle with new method : 0.07840466499328613 time for calcul the mask position with numpy : 0.008231163024902344 nb_pixel_total : 2609 time to create 1 rle with old method : 0.0029256343841552734 time for calcul the mask position with numpy : 0.008276224136352539 nb_pixel_total : 925 time to create 1 rle with old method : 0.0010991096496582031 time for calcul the mask position with numpy : 0.00833749771118164 nb_pixel_total : 47 time to create 1 rle with old method : 7.843971252441406e-05 time for calcul the mask position with numpy : 0.008078813552856445 nb_pixel_total : 447 time to create 1 rle with old method : 0.0005404949188232422 time for calcul the mask position with numpy : 0.008055448532104492 nb_pixel_total : 30 time to create 1 rle with old method : 5.054473876953125e-05 time for calcul the mask position with numpy : 0.007876157760620117 nb_pixel_total : 342 time to create 1 rle with old method : 0.00039839744567871094 time for calcul the mask position with numpy : 0.008095026016235352 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004425048828125 time for calcul the mask position with numpy : 0.007908105850219727 nb_pixel_total : 3427 time to create 1 rle with old method : 0.0036704540252685547 time for calcul the mask position with numpy : 0.008205413818359375 nb_pixel_total : 5 time to create 1 rle with old method : 1.5020370483398438e-05 time for calcul the mask position with numpy : 0.008126258850097656 nb_pixel_total : 238 time to create 1 rle with old method : 0.0002765655517578125 time for calcul the mask position with numpy : 0.007921457290649414 nb_pixel_total : 101 time to create 1 rle with old method : 0.00011110305786132812 time for calcul the mask position with numpy : 0.008033990859985352 nb_pixel_total : 333 time to create 1 rle with old method : 0.0003464221954345703 time for calcul the mask position with numpy : 0.007856607437133789 nb_pixel_total : 903 time to create 1 rle with old method : 0.0009717941284179688 time for calcul the mask position with numpy : 0.008145809173583984 nb_pixel_total : 879 time to create 1 rle with old method : 0.0009069442749023438 time for calcul the mask position with numpy : 0.007648944854736328 nb_pixel_total : 1903 time to create 1 rle with old method : 0.0021562576293945312 time for calcul the mask position with numpy : 0.008239507675170898 nb_pixel_total : 486 time to create 1 rle with old method : 0.0005414485931396484 time for calcul the mask position with numpy : 0.008173704147338867 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005273818969726562 time for calcul the mask position with numpy : 0.00791168212890625 nb_pixel_total : 1987 time to create 1 rle with old method : 0.0021867752075195312 time for calcul the mask position with numpy : 0.008080005645751953 nb_pixel_total : 1491 time to create 1 rle with old method : 0.0017533302307128906 time for calcul the mask position with numpy : 0.008109569549560547 nb_pixel_total : 883 time to create 1 rle with old method : 0.0010313987731933594 time for calcul the mask position with numpy : 0.008106470108032227 nb_pixel_total : 21 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.008212089538574219 nb_pixel_total : 1345 time to create 1 rle with old method : 0.0015671253204345703 time for calcul the mask position with numpy : 0.008142471313476562 nb_pixel_total : 37 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.007814407348632812 nb_pixel_total : 317 time to create 1 rle with old method : 0.00033783912658691406 time for calcul the mask position with numpy : 0.0076792240142822266 nb_pixel_total : 502 time to create 1 rle with old method : 0.0005764961242675781 time for calcul the mask position with numpy : 0.007926464080810547 nb_pixel_total : 922 time to create 1 rle with old method : 0.001077413558959961 time for calcul the mask position with numpy : 0.008079767227172852 nb_pixel_total : 7865 time to create 1 rle with old method : 0.008655786514282227 time for calcul the mask position with numpy : 0.007864713668823242 nb_pixel_total : 897 time to create 1 rle with old method : 0.0009837150573730469 time for calcul the mask position with numpy : 0.007984638214111328 nb_pixel_total : 651 time to create 1 rle with old method : 0.0006878376007080078 time for calcul the mask position with numpy : 0.008178234100341797 nb_pixel_total : 949 time to create 1 rle with old method : 0.001260519027709961 time for calcul the mask position with numpy : 0.008095264434814453 nb_pixel_total : 2018 time to create 1 rle with old method : 0.0022668838500976562 time for calcul the mask position with numpy : 0.008135080337524414 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003581047058105469 time for calcul the mask position with numpy : 0.008045673370361328 nb_pixel_total : 4219 time to create 1 rle with old method : 0.0045528411865234375 time for calcul the mask position with numpy : 0.007910490036010742 nb_pixel_total : 1420 time to create 1 rle with old method : 0.001535654067993164 time for calcul the mask position with numpy : 0.007977724075317383 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004029273986816406 time for calcul the mask position with numpy : 0.007986307144165039 nb_pixel_total : 734 time to create 1 rle with old method : 0.0007658004760742188 time for calcul the mask position with numpy : 0.008063316345214844 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002338886260986328 time for calcul the mask position with numpy : 0.008260965347290039 nb_pixel_total : 133 time to create 1 rle with old method : 0.00014519691467285156 time for calcul the mask position with numpy : 0.008073091506958008 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002281665802001953 time for calcul the mask position with numpy : 0.007838249206542969 nb_pixel_total : 1153 time to create 1 rle with old method : 0.001245737075805664 time for calcul the mask position with numpy : 0.008133888244628906 nb_pixel_total : 407 time to create 1 rle with old method : 0.00047850608825683594 time for calcul the mask position with numpy : 0.007980585098266602 nb_pixel_total : 189 time to create 1 rle with old method : 0.00026607513427734375 time for calcul the mask position with numpy : 0.008093595504760742 nb_pixel_total : 1864 time to create 1 rle with old method : 0.0019919872283935547 time for calcul the mask position with numpy : 0.007880449295043945 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0011866092681884766 time for calcul the mask position with numpy : 0.007993936538696289 nb_pixel_total : 429 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.008206844329833984 nb_pixel_total : 519 time to create 1 rle with old method : 0.0005939006805419922 time for calcul the mask position with numpy : 0.007877826690673828 nb_pixel_total : 139 time to create 1 rle with old method : 0.00016880035400390625 time for calcul the mask position with numpy : 0.007761240005493164 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001614093780517578 time for calcul the mask position with numpy : 0.008055925369262695 nb_pixel_total : 348 time to create 1 rle with old method : 0.00041294097900390625 time for calcul the mask position with numpy : 0.008137226104736328 nb_pixel_total : 105612 time to create 1 rle with old method : 0.11426210403442383 time for calcul the mask position with numpy : 0.008071422576904297 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003666877746582031 time for calcul the mask position with numpy : 0.007877588272094727 nb_pixel_total : 82 time to create 1 rle with old method : 9.5367431640625e-05 time for calcul the mask position with numpy : 0.008147239685058594 nb_pixel_total : 83 time to create 1 rle with old method : 0.0001289844512939453 time for calcul the mask position with numpy : 0.007892370223999023 nb_pixel_total : 232 time to create 1 rle with old method : 0.0002696514129638672 time for calcul the mask position with numpy : 0.008197784423828125 nb_pixel_total : 1422 time to create 1 rle with old method : 0.0015039443969726562 time for calcul the mask position with numpy : 0.007815122604370117 nb_pixel_total : 2831 time to create 1 rle with old method : 0.0035507678985595703 time for calcul the mask position with numpy : 0.008028030395507812 nb_pixel_total : 35235 time to create 1 rle with old method : 0.03826141357421875 time for calcul the mask position with numpy : 0.008170366287231445 nb_pixel_total : 106 time to create 1 rle with old method : 0.00013446807861328125 time for calcul the mask position with numpy : 0.00788426399230957 nb_pixel_total : 284 time to create 1 rle with old method : 0.00033020973205566406 time for calcul the mask position with numpy : 0.008025407791137695 nb_pixel_total : 815 time to create 1 rle with old method : 0.0009071826934814453 time for calcul the mask position with numpy : 0.007928133010864258 nb_pixel_total : 329 time to create 1 rle with old method : 0.0003902912139892578 time for calcul the mask position with numpy : 0.007708072662353516 nb_pixel_total : 2342 time to create 1 rle with old method : 0.0025854110717773438 time for calcul the mask position with numpy : 0.007991790771484375 nb_pixel_total : 229 time to create 1 rle with old method : 0.000308990478515625 time for calcul the mask position with numpy : 0.007898092269897461 nb_pixel_total : 367 time to create 1 rle with old method : 0.00039768218994140625 time for calcul the mask position with numpy : 0.0076220035552978516 nb_pixel_total : 3266 time to create 1 rle with old method : 0.0033884048461914062 time for calcul the mask position with numpy : 0.007942914962768555 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002231597900390625 time for calcul the mask position with numpy : 0.008102655410766602 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001308917999267578 time for calcul the mask position with numpy : 0.007901191711425781 nb_pixel_total : 109 time to create 1 rle with old method : 0.00014328956604003906 time for calcul the mask position with numpy : 0.00812530517578125 nb_pixel_total : 88 time to create 1 rle with old method : 0.00011110305786132812 time for calcul the mask position with numpy : 0.007884979248046875 nb_pixel_total : 1546 time to create 1 rle with old method : 0.0016934871673583984 time for calcul the mask position with numpy : 0.007969856262207031 nb_pixel_total : 718 time to create 1 rle with old method : 0.0008547306060791016 time for calcul the mask position with numpy : 0.00806283950805664 nb_pixel_total : 66 time to create 1 rle with old method : 9.131431579589844e-05 time for calcul the mask position with numpy : 0.00780487060546875 nb_pixel_total : 1635 time to create 1 rle with old method : 0.0017917156219482422 time for calcul the mask position with numpy : 0.008127212524414062 nb_pixel_total : 41 time to create 1 rle with old method : 5.14984130859375e-05 time for calcul the mask position with numpy : 0.008127212524414062 nb_pixel_total : 353 time to create 1 rle with old method : 0.00042128562927246094 time for calcul the mask position with numpy : 0.008101940155029297 nb_pixel_total : 50 time to create 1 rle with old method : 6.270408630371094e-05 time for calcul the mask position with numpy : 0.007849693298339844 nb_pixel_total : 911 time to create 1 rle with old method : 0.0009462833404541016 time for calcul the mask position with numpy : 0.008112907409667969 nb_pixel_total : 2123 time to create 1 rle with old method : 0.0024123191833496094 time for calcul the mask position with numpy : 0.007949113845825195 nb_pixel_total : 225 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.008189916610717773 nb_pixel_total : 82 time to create 1 rle with old method : 0.00010561943054199219 create new chi : 1.0976684093475342 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.005463123321533203 batch 1 Loaded 81 chid ids of type : 4230 Number RLEs to save : 8733 TO DO : save crop sub photo not yet done ! save time : 4.4531097412109375 nb_obj : 85 nb_hashtags : 6 time to prepare the origin masks : 1.9367225170135498 time for calcul the mask position with numpy : 0.05115556716918945 nb_pixel_total : 1828017 time to create 1 rle with new method : 0.0857992172241211 time for calcul the mask position with numpy : 0.007808685302734375 nb_pixel_total : 32 time to create 1 rle with old method : 7.462501525878906e-05 time for calcul the mask position with numpy : 0.006542205810546875 nb_pixel_total : 402 time to create 1 rle with old method : 0.0004801750183105469 time for calcul the mask position with numpy : 0.0070590972900390625 nb_pixel_total : 886 time to create 1 rle with old method : 0.001049041748046875 time for calcul the mask position with numpy : 0.006184101104736328 nb_pixel_total : 908 time to create 1 rle with old method : 0.001085042953491211 time for calcul the mask position with numpy : 0.007892131805419922 nb_pixel_total : 11 time to create 1 rle with old method : 4.601478576660156e-05 time for calcul the mask position with numpy : 0.006375551223754883 nb_pixel_total : 937 time to create 1 rle with old method : 0.0011363029479980469 time for calcul the mask position with numpy : 0.006368875503540039 nb_pixel_total : 2075 time to create 1 rle with old method : 0.002447366714477539 time for calcul the mask position with numpy : 0.007420778274536133 nb_pixel_total : 20968 time to create 1 rle with old method : 0.024119138717651367 time for calcul the mask position with numpy : 0.006441354751586914 nb_pixel_total : 218 time to create 1 rle with old method : 0.00026988983154296875 time for calcul the mask position with numpy : 0.006564140319824219 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004222393035888672 time for calcul the mask position with numpy : 0.006333351135253906 nb_pixel_total : 695 time to create 1 rle with old method : 0.0008256435394287109 time for calcul the mask position with numpy : 0.006145954132080078 nb_pixel_total : 2633 time to create 1 rle with old method : 0.0031707286834716797 time for calcul the mask position with numpy : 0.006265401840209961 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006005764007568359 time for calcul the mask position with numpy : 0.006874561309814453 nb_pixel_total : 12 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.006314277648925781 nb_pixel_total : 134 time to create 1 rle with old method : 0.00017547607421875 time for calcul the mask position with numpy : 0.0060465335845947266 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005543231964111328 time for calcul the mask position with numpy : 0.006888866424560547 nb_pixel_total : 1808 time to create 1 rle with old method : 0.002127408981323242 time for calcul the mask position with numpy : 0.007231235504150391 nb_pixel_total : 15295 time to create 1 rle with old method : 0.01757335662841797 time for calcul the mask position with numpy : 0.0062255859375 nb_pixel_total : 826 time to create 1 rle with old method : 0.0009598731994628906 time for calcul the mask position with numpy : 0.0062487125396728516 nb_pixel_total : 979 time to create 1 rle with old method : 0.001176595687866211 time for calcul the mask position with numpy : 0.0061435699462890625 nb_pixel_total : 916 time to create 1 rle with old method : 0.0010864734649658203 time for calcul the mask position with numpy : 0.007126331329345703 nb_pixel_total : 175 time to create 1 rle with old method : 0.00024127960205078125 time for calcul the mask position with numpy : 0.006551504135131836 nb_pixel_total : 338 time to create 1 rle with old method : 0.00041174888610839844 time for calcul the mask position with numpy : 0.006105899810791016 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007691383361816406 time for calcul the mask position with numpy : 0.0066661834716796875 nb_pixel_total : 9306 time to create 1 rle with old method : 0.010656595230102539 time for calcul the mask position with numpy : 0.006135702133178711 nb_pixel_total : 1348 time to create 1 rle with old method : 0.0015511512756347656 time for calcul the mask position with numpy : 0.007279396057128906 nb_pixel_total : 38 time to create 1 rle with old method : 0.00010251998901367188 time for calcul the mask position with numpy : 0.006014108657836914 nb_pixel_total : 684 time to create 1 rle with old method : 0.0008149147033691406 time for calcul the mask position with numpy : 0.006155967712402344 nb_pixel_total : 892 time to create 1 rle with old method : 0.0011355876922607422 time for calcul the mask position with numpy : 0.0068585872650146484 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007550716400146484 time for calcul the mask position with numpy : 0.006087541580200195 nb_pixel_total : 3994 time to create 1 rle with old method : 0.004719257354736328 time for calcul the mask position with numpy : 0.006047248840332031 nb_pixel_total : 863 time to create 1 rle with old method : 0.0010437965393066406 time for calcul the mask position with numpy : 0.006005048751831055 nb_pixel_total : 2146 time to create 1 rle with old method : 0.0025081634521484375 time for calcul the mask position with numpy : 0.006323575973510742 nb_pixel_total : 334 time to create 1 rle with old method : 0.00040602684020996094 time for calcul the mask position with numpy : 0.006030559539794922 nb_pixel_total : 353 time to create 1 rle with old method : 0.0004494190216064453 time for calcul the mask position with numpy : 0.00637364387512207 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007143020629882812 time for calcul the mask position with numpy : 0.007050991058349609 nb_pixel_total : 216 time to create 1 rle with old method : 0.00027561187744140625 time for calcul the mask position with numpy : 0.005991220474243164 nb_pixel_total : 70 time to create 1 rle with old method : 0.00015401840209960938 time for calcul the mask position with numpy : 0.0059814453125 nb_pixel_total : 26 time to create 1 rle with old method : 5.6743621826171875e-05 time for calcul the mask position with numpy : 0.006871700286865234 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001437664031982422 time for calcul the mask position with numpy : 0.005982160568237305 nb_pixel_total : 401 time to create 1 rle with old method : 0.0004909038543701172 time for calcul the mask position with numpy : 0.005988359451293945 nb_pixel_total : 79 time to create 1 rle with old method : 0.00017309188842773438 time for calcul the mask position with numpy : 0.0060083866119384766 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0013778209686279297 time for calcul the mask position with numpy : 0.006178617477416992 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003037452697753906 time for calcul the mask position with numpy : 0.006259441375732422 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005576610565185547 time for calcul the mask position with numpy : 0.0064694881439208984 nb_pixel_total : 1749 time to create 1 rle with old method : 0.0020453929901123047 time for calcul the mask position with numpy : 0.0063457489013671875 nb_pixel_total : 147 time to create 1 rle with old method : 0.00019478797912597656 time for calcul the mask position with numpy : 0.006020784378051758 nb_pixel_total : 483 time to create 1 rle with old method : 0.0005965232849121094 time for calcul the mask position with numpy : 0.006207942962646484 nb_pixel_total : 71 time to create 1 rle with old method : 0.00011277198791503906 time for calcul the mask position with numpy : 0.00710749626159668 nb_pixel_total : 393 time to create 1 rle with old method : 0.0004673004150390625 time for calcul the mask position with numpy : 0.0060443878173828125 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005519390106201172 time for calcul the mask position with numpy : 0.0065991878509521484 nb_pixel_total : 151 time to create 1 rle with old method : 0.00021195411682128906 time for calcul the mask position with numpy : 0.0068857669830322266 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001575946807861328 time for calcul the mask position with numpy : 0.0060307979583740234 nb_pixel_total : 406 time to create 1 rle with old method : 0.0004858970642089844 time for calcul the mask position with numpy : 0.006014823913574219 nb_pixel_total : 6571 time to create 1 rle with old method : 0.0076138973236083984 time for calcul the mask position with numpy : 0.006613969802856445 nb_pixel_total : 102886 time to create 1 rle with old method : 0.11947107315063477 time for calcul the mask position with numpy : 0.0069501399993896484 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002124309539794922 time for calcul the mask position with numpy : 0.0063877105712890625 nb_pixel_total : 33554 time to create 1 rle with old method : 0.037583112716674805 time for calcul the mask position with numpy : 0.007177829742431641 nb_pixel_total : 5248 time to create 1 rle with old method : 0.0060272216796875 time for calcul the mask position with numpy : 0.00664210319519043 nb_pixel_total : 336 time to create 1 rle with old method : 0.0004076957702636719 time for calcul the mask position with numpy : 0.006372928619384766 nb_pixel_total : 610 time to create 1 rle with old method : 0.0007138252258300781 time for calcul the mask position with numpy : 0.006045103073120117 nb_pixel_total : 159 time to create 1 rle with old method : 0.00020551681518554688 time for calcul the mask position with numpy : 0.0065937042236328125 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004050731658935547 time for calcul the mask position with numpy : 0.006918907165527344 nb_pixel_total : 240 time to create 1 rle with old method : 0.00030231475830078125 time for calcul the mask position with numpy : 0.006281375885009766 nb_pixel_total : 88 time to create 1 rle with old method : 0.00020432472229003906 time for calcul the mask position with numpy : 0.006928682327270508 nb_pixel_total : 1220 time to create 1 rle with old method : 0.0014333724975585938 time for calcul the mask position with numpy : 0.007483720779418945 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005185604095458984 time for calcul the mask position with numpy : 0.006158590316772461 nb_pixel_total : 5 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.007236957550048828 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013327598571777344 time for calcul the mask position with numpy : 0.006057024002075195 nb_pixel_total : 41 time to create 1 rle with old method : 0.00011277198791503906 time for calcul the mask position with numpy : 0.005979061126708984 nb_pixel_total : 2722 time to create 1 rle with old method : 0.003145456314086914 time for calcul the mask position with numpy : 0.006036520004272461 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001266002655029297 time for calcul the mask position with numpy : 0.006003141403198242 nb_pixel_total : 1525 time to create 1 rle with old method : 0.0017325878143310547 time for calcul the mask position with numpy : 0.00608062744140625 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002765655517578125 time for calcul the mask position with numpy : 0.006329774856567383 nb_pixel_total : 176 time to create 1 rle with old method : 0.00021886825561523438 time for calcul the mask position with numpy : 0.006183624267578125 nb_pixel_total : 76 time to create 1 rle with old method : 0.00011515617370605469 time for calcul the mask position with numpy : 0.006052494049072266 nb_pixel_total : 4013 time to create 1 rle with old method : 0.0046117305755615234 time for calcul the mask position with numpy : 0.0061070919036865234 nb_pixel_total : 259 time to create 1 rle with old method : 0.000362396240234375 time for calcul the mask position with numpy : 0.0060999393463134766 nb_pixel_total : 1304 time to create 1 rle with old method : 0.0015342235565185547 time for calcul the mask position with numpy : 0.006291389465332031 nb_pixel_total : 57 time to create 1 rle with old method : 9.036064147949219e-05 time for calcul the mask position with numpy : 0.007328987121582031 nb_pixel_total : 1 time to create 1 rle with old method : 2.09808349609375e-05 time for calcul the mask position with numpy : 0.00604701042175293 nb_pixel_total : 915 time to create 1 rle with old method : 0.0010776519775390625 time for calcul the mask position with numpy : 0.008473873138427734 nb_pixel_total : 2117 time to create 1 rle with old method : 0.0024361610412597656 time for calcul the mask position with numpy : 0.008484125137329102 nb_pixel_total : 197 time to create 1 rle with old method : 0.00023508071899414062 time for calcul the mask position with numpy : 0.008448600769042969 nb_pixel_total : 67 time to create 1 rle with old method : 0.00010228157043457031 create new chi : 0.9893021583557129 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0013861656188964844 batch 1 Loaded 86 chid ids of type : 4230 Number RLEs to save : 9562 TO DO : save crop sub photo not yet done ! save time : 3.7202484607696533 nb_obj : 91 nb_hashtags : 6 time to prepare the origin masks : 1.3317317962646484 time for calcul the mask position with numpy : 0.07587838172912598 nb_pixel_total : 1808758 time to create 1 rle with new method : 0.128157377243042 time for calcul the mask position with numpy : 0.011194467544555664 nb_pixel_total : 26809 time to create 1 rle with old method : 0.03346824645996094 time for calcul the mask position with numpy : 0.006339311599731445 nb_pixel_total : 36 time to create 1 rle with old method : 9.179115295410156e-05 time for calcul the mask position with numpy : 0.0064089298248291016 nb_pixel_total : 18 time to create 1 rle with old method : 0.00010418891906738281 time for calcul the mask position with numpy : 0.006567955017089844 nb_pixel_total : 66 time to create 1 rle with old method : 0.00012540817260742188 time for calcul the mask position with numpy : 0.006365776062011719 nb_pixel_total : 370 time to create 1 rle with old method : 0.0004601478576660156 time for calcul the mask position with numpy : 0.006178617477416992 nb_pixel_total : 902 time to create 1 rle with old method : 0.0011382102966308594 time for calcul the mask position with numpy : 0.010663509368896484 nb_pixel_total : 401 time to create 1 rle with old method : 0.00047206878662109375 time for calcul the mask position with numpy : 0.01113271713256836 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005712509155273438 time for calcul the mask position with numpy : 0.008376836776733398 nb_pixel_total : 586 time to create 1 rle with old method : 0.0007410049438476562 time for calcul the mask position with numpy : 0.006412982940673828 nb_pixel_total : 2767 time to create 1 rle with old method : 0.004042863845825195 time for calcul the mask position with numpy : 0.0071141719818115234 nb_pixel_total : 6 time to create 1 rle with old method : 4.76837158203125e-05 time for calcul the mask position with numpy : 0.00667262077331543 nb_pixel_total : 6 time to create 1 rle with old method : 3.266334533691406e-05 time for calcul the mask position with numpy : 0.0068302154541015625 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0014767646789550781 time for calcul the mask position with numpy : 0.006955385208129883 nb_pixel_total : 12740 time to create 1 rle with old method : 0.01538228988647461 time for calcul the mask position with numpy : 0.006980180740356445 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002925395965576172 time for calcul the mask position with numpy : 0.007292270660400391 nb_pixel_total : 2139 time to create 1 rle with old method : 0.002629518508911133 time for calcul the mask position with numpy : 0.007966041564941406 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.011627435684204102 nb_pixel_total : 902 time to create 1 rle with old method : 0.00110626220703125 time for calcul the mask position with numpy : 0.011376380920410156 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006785392761230469 time for calcul the mask position with numpy : 0.011908531188964844 nb_pixel_total : 7139 time to create 1 rle with old method : 0.00820302963256836 time for calcul the mask position with numpy : 0.010886192321777344 nb_pixel_total : 131 time to create 1 rle with old method : 0.00018525123596191406 time for calcul the mask position with numpy : 0.010790348052978516 nb_pixel_total : 13 time to create 1 rle with old method : 5.030632019042969e-05 time for calcul the mask position with numpy : 0.010650157928466797 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004763603210449219 time for calcul the mask position with numpy : 0.011194705963134766 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005998611450195312 time for calcul the mask position with numpy : 0.010679960250854492 nb_pixel_total : 2229 time to create 1 rle with old method : 0.0026679039001464844 time for calcul the mask position with numpy : 0.00670623779296875 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007948875427246094 time for calcul the mask position with numpy : 0.00682830810546875 nb_pixel_total : 812 time to create 1 rle with old method : 0.0009281635284423828 time for calcul the mask position with numpy : 0.0067827701568603516 nb_pixel_total : 722 time to create 1 rle with old method : 0.0008587837219238281 time for calcul the mask position with numpy : 0.006812095642089844 nb_pixel_total : 12276 time to create 1 rle with old method : 0.013936042785644531 time for calcul the mask position with numpy : 0.006785154342651367 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004878044128417969 time for calcul the mask position with numpy : 0.0067212581634521484 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006341934204101562 time for calcul the mask position with numpy : 0.00688934326171875 nb_pixel_total : 270 time to create 1 rle with old method : 0.0005679130554199219 time for calcul the mask position with numpy : 0.006936788558959961 nb_pixel_total : 7363 time to create 1 rle with old method : 0.008541584014892578 time for calcul the mask position with numpy : 0.006876707077026367 nb_pixel_total : 16 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.006594181060791016 nb_pixel_total : 42 time to create 1 rle with old method : 9.703636169433594e-05 time for calcul the mask position with numpy : 0.006598711013793945 nb_pixel_total : 360 time to create 1 rle with old method : 0.00048732757568359375 time for calcul the mask position with numpy : 0.006225109100341797 nb_pixel_total : 2520 time to create 1 rle with old method : 0.002946138381958008 time for calcul the mask position with numpy : 0.006303548812866211 nb_pixel_total : 600 time to create 1 rle with old method : 0.0007126331329345703 time for calcul the mask position with numpy : 0.006322145462036133 nb_pixel_total : 985 time to create 1 rle with old method : 0.001199483871459961 time for calcul the mask position with numpy : 0.006315469741821289 nb_pixel_total : 4161 time to create 1 rle with old method : 0.004633426666259766 time for calcul the mask position with numpy : 0.0063304901123046875 nb_pixel_total : 2205 time to create 1 rle with old method : 0.002588033676147461 time for calcul the mask position with numpy : 0.0059092044830322266 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006585121154785156 time for calcul the mask position with numpy : 0.006689548492431641 nb_pixel_total : 9 time to create 1 rle with old method : 4.291534423828125e-05 time for calcul the mask position with numpy : 0.007464170455932617 nb_pixel_total : 360 time to create 1 rle with old method : 0.00040411949157714844 time for calcul the mask position with numpy : 0.0064127445220947266 nb_pixel_total : 190 time to create 1 rle with old method : 0.00024437904357910156 time for calcul the mask position with numpy : 0.006243705749511719 nb_pixel_total : 269 time to create 1 rle with old method : 0.00032901763916015625 time for calcul the mask position with numpy : 0.005864143371582031 nb_pixel_total : 121 time to create 1 rle with old method : 0.00014829635620117188 time for calcul the mask position with numpy : 0.005656242370605469 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002455711364746094 time for calcul the mask position with numpy : 0.0059435367584228516 nb_pixel_total : 202 time to create 1 rle with old method : 0.00027060508728027344 time for calcul the mask position with numpy : 0.006011486053466797 nb_pixel_total : 534 time to create 1 rle with old method : 0.0006432533264160156 time for calcul the mask position with numpy : 0.006200075149536133 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0013871192932128906 time for calcul the mask position with numpy : 0.006105899810791016 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002579689025878906 time for calcul the mask position with numpy : 0.00606989860534668 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005474090576171875 time for calcul the mask position with numpy : 0.006097078323364258 nb_pixel_total : 27 time to create 1 rle with old method : 9.965896606445312e-05 time for calcul the mask position with numpy : 0.0060405731201171875 nb_pixel_total : 1839 time to create 1 rle with old method : 0.002165079116821289 time for calcul the mask position with numpy : 0.006242275238037109 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005288124084472656 time for calcul the mask position with numpy : 0.005923271179199219 nb_pixel_total : 68 time to create 1 rle with old method : 0.0001010894775390625 time for calcul the mask position with numpy : 0.006185293197631836 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005638599395751953 time for calcul the mask position with numpy : 0.006795406341552734 nb_pixel_total : 513 time to create 1 rle with old method : 0.0006098747253417969 time for calcul the mask position with numpy : 0.006227016448974609 nb_pixel_total : 141 time to create 1 rle with old method : 0.0001914501190185547 time for calcul the mask position with numpy : 0.005832195281982422 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001361370086669922 time for calcul the mask position with numpy : 0.005774259567260742 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004742145538330078 time for calcul the mask position with numpy : 0.006735801696777344 nb_pixel_total : 102513 time to create 1 rle with old method : 0.11290860176086426 time for calcul the mask position with numpy : 0.006150722503662109 nb_pixel_total : 7183 time to create 1 rle with old method : 0.007901668548583984 time for calcul the mask position with numpy : 0.006089210510253906 nb_pixel_total : 23 time to create 1 rle with old method : 5.435943603515625e-05 time for calcul the mask position with numpy : 0.006096839904785156 nb_pixel_total : 3558 time to create 1 rle with old method : 0.004138469696044922 time for calcul the mask position with numpy : 0.0061795711517333984 nb_pixel_total : 36209 time to create 1 rle with old method : 0.039525747299194336 time for calcul the mask position with numpy : 0.005971193313598633 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001614093780517578 time for calcul the mask position with numpy : 0.005791664123535156 nb_pixel_total : 612 time to create 1 rle with old method : 0.000743865966796875 time for calcul the mask position with numpy : 0.00581812858581543 nb_pixel_total : 315 time to create 1 rle with old method : 0.00036454200744628906 time for calcul the mask position with numpy : 0.005851268768310547 nb_pixel_total : 25 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.005880832672119141 nb_pixel_total : 314 time to create 1 rle with old method : 0.0003952980041503906 time for calcul the mask position with numpy : 0.006047964096069336 nb_pixel_total : 232 time to create 1 rle with old method : 0.0002884864807128906 time for calcul the mask position with numpy : 0.005832195281982422 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0013816356658935547 time for calcul the mask position with numpy : 0.0057981014251708984 nb_pixel_total : 314 time to create 1 rle with old method : 0.0003676414489746094 time for calcul the mask position with numpy : 0.005970001220703125 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001544952392578125 time for calcul the mask position with numpy : 0.0067365169525146484 nb_pixel_total : 2708 time to create 1 rle with old method : 0.0031452178955078125 time for calcul the mask position with numpy : 0.006643772125244141 nb_pixel_total : 80 time to create 1 rle with old method : 0.00013327598571777344 time for calcul the mask position with numpy : 0.006518125534057617 nb_pixel_total : 230 time to create 1 rle with old method : 0.00031113624572753906 time for calcul the mask position with numpy : 0.006415605545043945 nb_pixel_total : 1485 time to create 1 rle with old method : 0.001787424087524414 time for calcul the mask position with numpy : 0.006857872009277344 nb_pixel_total : 86 time to create 1 rle with old method : 0.00012040138244628906 time for calcul the mask position with numpy : 0.0067272186279296875 nb_pixel_total : 72 time to create 1 rle with old method : 0.000110626220703125 time for calcul the mask position with numpy : 0.006651639938354492 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003609657287597656 time for calcul the mask position with numpy : 0.006167411804199219 nb_pixel_total : 931 time to create 1 rle with old method : 0.0010967254638671875 time for calcul the mask position with numpy : 0.006554365158081055 nb_pixel_total : 45 time to create 1 rle with old method : 8.821487426757812e-05 time for calcul the mask position with numpy : 0.008680582046508789 nb_pixel_total : 935 time to create 1 rle with old method : 0.0011584758758544922 time for calcul the mask position with numpy : 0.008733272552490234 nb_pixel_total : 33 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.00866842269897461 nb_pixel_total : 2014 time to create 1 rle with old method : 0.002455472946166992 time for calcul the mask position with numpy : 0.008517265319824219 nb_pixel_total : 116 time to create 1 rle with old method : 0.00017452239990234375 time for calcul the mask position with numpy : 0.008343219757080078 nb_pixel_total : 123 time to create 1 rle with old method : 0.00017380714416503906 time for calcul the mask position with numpy : 0.008299589157104492 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001010894775390625 create new chi : 1.1700491905212402 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001558065414428711 batch 1 Loaded 92 chid ids of type : 4230 Number RLEs to save : 10299 TO DO : save crop sub photo not yet done ! save time : 2.2654387950897217 nb_obj : 72 nb_hashtags : 6 time to prepare the origin masks : 1.192507028579712 time for calcul the mask position with numpy : 0.017822265625 nb_pixel_total : 1761899 time to create 1 rle with new method : 0.032292842864990234 time for calcul the mask position with numpy : 0.006049394607543945 nb_pixel_total : 4582 time to create 1 rle with old method : 0.004903316497802734 time for calcul the mask position with numpy : 0.005964040756225586 nb_pixel_total : 65729 time to create 1 rle with old method : 0.06824207305908203 time for calcul the mask position with numpy : 0.005685567855834961 nb_pixel_total : 894 time to create 1 rle with old method : 0.0009667873382568359 time for calcul the mask position with numpy : 0.005735158920288086 nb_pixel_total : 443 time to create 1 rle with old method : 0.0004954338073730469 time for calcul the mask position with numpy : 0.005772113800048828 nb_pixel_total : 1206 time to create 1 rle with old method : 0.0012917518615722656 time for calcul the mask position with numpy : 0.005560636520385742 nb_pixel_total : 412 time to create 1 rle with old method : 0.0004901885986328125 time for calcul the mask position with numpy : 0.005728960037231445 nb_pixel_total : 26 time to create 1 rle with old method : 6.604194641113281e-05 time for calcul the mask position with numpy : 0.005926370620727539 nb_pixel_total : 2842 time to create 1 rle with old method : 0.0032799243927001953 time for calcul the mask position with numpy : 0.006040811538696289 nb_pixel_total : 16084 time to create 1 rle with old method : 0.017527103424072266 time for calcul the mask position with numpy : 0.006104707717895508 nb_pixel_total : 13477 time to create 1 rle with old method : 0.015140295028686523 time for calcul the mask position with numpy : 0.006000995635986328 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003020763397216797 time for calcul the mask position with numpy : 0.005954265594482422 nb_pixel_total : 878 time to create 1 rle with old method : 0.0009551048278808594 time for calcul the mask position with numpy : 0.005852222442626953 nb_pixel_total : 20 time to create 1 rle with old method : 5.3882598876953125e-05 time for calcul the mask position with numpy : 0.005910158157348633 nb_pixel_total : 142 time to create 1 rle with old method : 0.00018024444580078125 time for calcul the mask position with numpy : 0.0057718753814697266 nb_pixel_total : 169 time to create 1 rle with old method : 0.00020194053649902344 time for calcul the mask position with numpy : 0.005828142166137695 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005629062652587891 time for calcul the mask position with numpy : 0.0061528682708740234 nb_pixel_total : 1964 time to create 1 rle with old method : 0.002252340316772461 time for calcul the mask position with numpy : 0.005674839019775391 nb_pixel_total : 156 time to create 1 rle with old method : 0.00019502639770507812 time for calcul the mask position with numpy : 0.005972146987915039 nb_pixel_total : 112 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.0060346126556396484 nb_pixel_total : 12344 time to create 1 rle with old method : 0.013794422149658203 time for calcul the mask position with numpy : 0.005859375 nb_pixel_total : 386 time to create 1 rle with old method : 0.0004420280456542969 time for calcul the mask position with numpy : 0.0059511661529541016 nb_pixel_total : 6 time to create 1 rle with old method : 5.030632019042969e-05 time for calcul the mask position with numpy : 0.0058879852294921875 nb_pixel_total : 731 time to create 1 rle with old method : 0.0008814334869384766 time for calcul the mask position with numpy : 0.006031513214111328 nb_pixel_total : 8985 time to create 1 rle with old method : 0.010208606719970703 time for calcul the mask position with numpy : 0.005962371826171875 nb_pixel_total : 5186 time to create 1 rle with old method : 0.00574946403503418 time for calcul the mask position with numpy : 0.005953788757324219 nb_pixel_total : 3296 time to create 1 rle with old method : 0.003868579864501953 time for calcul the mask position with numpy : 0.0058231353759765625 nb_pixel_total : 54 time to create 1 rle with old method : 0.00011968612670898438 time for calcul the mask position with numpy : 0.005869388580322266 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005168914794921875 time for calcul the mask position with numpy : 0.005830287933349609 nb_pixel_total : 1530 time to create 1 rle with old method : 0.0018231868743896484 time for calcul the mask position with numpy : 0.005822658538818359 nb_pixel_total : 874 time to create 1 rle with old method : 0.0011475086212158203 time for calcul the mask position with numpy : 0.00580143928527832 nb_pixel_total : 2093 time to create 1 rle with old method : 0.0023882389068603516 time for calcul the mask position with numpy : 0.006339311599731445 nb_pixel_total : 407 time to create 1 rle with old method : 0.00047588348388671875 time for calcul the mask position with numpy : 0.005810260772705078 nb_pixel_total : 164 time to create 1 rle with old method : 0.00023984909057617188 time for calcul the mask position with numpy : 0.005622386932373047 nb_pixel_total : 149 time to create 1 rle with old method : 0.0001838207244873047 time for calcul the mask position with numpy : 0.005852937698364258 nb_pixel_total : 128 time to create 1 rle with old method : 0.00015616416931152344 time for calcul the mask position with numpy : 0.0059452056884765625 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001709461212158203 time for calcul the mask position with numpy : 0.005626678466796875 nb_pixel_total : 1344 time to create 1 rle with old method : 0.0014290809631347656 time for calcul the mask position with numpy : 0.0058329105377197266 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002579689025878906 time for calcul the mask position with numpy : 0.005695819854736328 nb_pixel_total : 431 time to create 1 rle with old method : 0.0004596710205078125 time for calcul the mask position with numpy : 0.0055887699127197266 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0019702911376953125 time for calcul the mask position with numpy : 0.005707263946533203 nb_pixel_total : 158 time to create 1 rle with old method : 0.0001919269561767578 time for calcul the mask position with numpy : 0.0056171417236328125 nb_pixel_total : 66 time to create 1 rle with old method : 8.821487426757812e-05 time for calcul the mask position with numpy : 0.005487918853759766 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004439353942871094 time for calcul the mask position with numpy : 0.005608081817626953 nb_pixel_total : 529 time to create 1 rle with old method : 0.0005786418914794922 time for calcul the mask position with numpy : 0.005445718765258789 nb_pixel_total : 118 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.0054662227630615234 nb_pixel_total : 121 time to create 1 rle with old method : 0.00014829635620117188 time for calcul the mask position with numpy : 0.0057086944580078125 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003161430358886719 time for calcul the mask position with numpy : 0.006139278411865234 nb_pixel_total : 106070 time to create 1 rle with old method : 0.10780215263366699 time for calcul the mask position with numpy : 0.005637168884277344 nb_pixel_total : 6999 time to create 1 rle with old method : 0.007391214370727539 time for calcul the mask position with numpy : 0.0054361820220947266 nb_pixel_total : 75 time to create 1 rle with old method : 0.00010156631469726562 time for calcul the mask position with numpy : 0.005983829498291016 nb_pixel_total : 250 time to create 1 rle with old method : 0.00031638145446777344 time for calcul the mask position with numpy : 0.005682945251464844 nb_pixel_total : 77 time to create 1 rle with old method : 0.00011563301086425781 time for calcul the mask position with numpy : 0.00577998161315918 nb_pixel_total : 33977 time to create 1 rle with old method : 0.03502202033996582 time for calcul the mask position with numpy : 0.005519390106201172 nb_pixel_total : 609 time to create 1 rle with old method : 0.0006642341613769531 time for calcul the mask position with numpy : 0.005589008331298828 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003299713134765625 time for calcul the mask position with numpy : 0.00550532341003418 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005211830139160156 time for calcul the mask position with numpy : 0.005467891693115234 nb_pixel_total : 213 time to create 1 rle with old method : 0.00023746490478515625 time for calcul the mask position with numpy : 0.005409717559814453 nb_pixel_total : 1351 time to create 1 rle with old method : 0.0014224052429199219 time for calcul the mask position with numpy : 0.005446195602416992 nb_pixel_total : 77 time to create 1 rle with old method : 0.00012350082397460938 time for calcul the mask position with numpy : 0.005426168441772461 nb_pixel_total : 337 time to create 1 rle with old method : 0.0003833770751953125 time for calcul the mask position with numpy : 0.005469560623168945 nb_pixel_total : 2536 time to create 1 rle with old method : 0.0026106834411621094 time for calcul the mask position with numpy : 0.005417346954345703 nb_pixel_total : 93 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.005414485931396484 nb_pixel_total : 1491 time to create 1 rle with old method : 0.0015702247619628906 time for calcul the mask position with numpy : 0.005478382110595703 nb_pixel_total : 1518 time to create 1 rle with old method : 0.001535654067993164 time for calcul the mask position with numpy : 0.005400657653808594 nb_pixel_total : 49 time to create 1 rle with old method : 7.176399230957031e-05 time for calcul the mask position with numpy : 0.00545954704284668 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003139972686767578 time for calcul the mask position with numpy : 0.005408525466918945 nb_pixel_total : 74 time to create 1 rle with old method : 9.560585021972656e-05 time for calcul the mask position with numpy : 0.005426645278930664 nb_pixel_total : 29 time to create 1 rle with old method : 7.987022399902344e-05 time for calcul the mask position with numpy : 0.005445003509521484 nb_pixel_total : 2161 time to create 1 rle with old method : 0.002342700958251953 time for calcul the mask position with numpy : 0.005621671676635742 nb_pixel_total : 247 time to create 1 rle with old method : 0.00028014183044433594 time for calcul the mask position with numpy : 0.005879878997802734 nb_pixel_total : 81 time to create 1 rle with old method : 0.00011539459228515625 time for calcul the mask position with numpy : 0.005811452865600586 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002052783966064453 create new chi : 0.7950115203857422 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0013556480407714844 batch 1 Loaded 73 chid ids of type : 4230 Number RLEs to save : 9643 TO DO : save crop sub photo not yet done ! save time : 2.0754518508911133 nb_obj : 76 nb_hashtags : 6 time to prepare the origin masks : 1.3024029731750488 time for calcul the mask position with numpy : 0.020093679428100586 nb_pixel_total : 1689313 time to create 1 rle with new method : 0.03429055213928223 time for calcul the mask position with numpy : 0.00628209114074707 nb_pixel_total : 948 time to create 1 rle with old method : 0.0011696815490722656 time for calcul the mask position with numpy : 0.006399631500244141 nb_pixel_total : 71 time to create 1 rle with old method : 0.0001227855682373047 time for calcul the mask position with numpy : 0.006285905838012695 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002148151397705078 time for calcul the mask position with numpy : 0.006299734115600586 nb_pixel_total : 31 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.006213188171386719 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005884170532226562 time for calcul the mask position with numpy : 0.00587153434753418 nb_pixel_total : 93 time to create 1 rle with old method : 0.00018477439880371094 time for calcul the mask position with numpy : 0.005795001983642578 nb_pixel_total : 1919 time to create 1 rle with old method : 0.0021848678588867188 time for calcul the mask position with numpy : 0.005640268325805664 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004649162292480469 time for calcul the mask position with numpy : 0.00587153434753418 nb_pixel_total : 1190 time to create 1 rle with old method : 0.0012898445129394531 time for calcul the mask position with numpy : 0.005789279937744141 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005841255187988281 time for calcul the mask position with numpy : 0.005779266357421875 nb_pixel_total : 2254 time to create 1 rle with old method : 0.0025472640991210938 time for calcul the mask position with numpy : 0.006162881851196289 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003478527069091797 time for calcul the mask position with numpy : 0.006695985794067383 nb_pixel_total : 20741 time to create 1 rle with old method : 0.02373337745666504 time for calcul the mask position with numpy : 0.006823062896728516 nb_pixel_total : 237 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.00652313232421875 nb_pixel_total : 1068 time to create 1 rle with old method : 0.001272439956665039 time for calcul the mask position with numpy : 0.006064891815185547 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0013909339904785156 time for calcul the mask position with numpy : 0.010404586791992188 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006761550903320312 time for calcul the mask position with numpy : 0.009819507598876953 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005180835723876953 time for calcul the mask position with numpy : 0.010101318359375 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005314350128173828 time for calcul the mask position with numpy : 0.011618375778198242 nb_pixel_total : 152831 time to create 1 rle with new method : 0.02912759780883789 time for calcul the mask position with numpy : 0.010413169860839844 nb_pixel_total : 1714 time to create 1 rle with old method : 0.001973390579223633 time for calcul the mask position with numpy : 0.005978822708129883 nb_pixel_total : 2101 time to create 1 rle with old method : 0.003264188766479492 time for calcul the mask position with numpy : 0.006701231002807617 nb_pixel_total : 875 time to create 1 rle with old method : 0.001024007797241211 time for calcul the mask position with numpy : 0.00651097297668457 nb_pixel_total : 170 time to create 1 rle with old method : 0.00022172927856445312 time for calcul the mask position with numpy : 0.006882190704345703 nb_pixel_total : 12065 time to create 1 rle with old method : 0.01336979866027832 time for calcul the mask position with numpy : 0.007427215576171875 nb_pixel_total : 345 time to create 1 rle with old method : 0.000415802001953125 time for calcul the mask position with numpy : 0.00598597526550293 nb_pixel_total : 602 time to create 1 rle with old method : 0.0007395744323730469 time for calcul the mask position with numpy : 0.006091594696044922 nb_pixel_total : 158 time to create 1 rle with old method : 0.00024247169494628906 time for calcul the mask position with numpy : 0.005797386169433594 nb_pixel_total : 1371 time to create 1 rle with old method : 0.0015099048614501953 time for calcul the mask position with numpy : 0.0059967041015625 nb_pixel_total : 2852 time to create 1 rle with old method : 0.0031728744506835938 time for calcul the mask position with numpy : 0.005944490432739258 nb_pixel_total : 1277 time to create 1 rle with old method : 0.0015561580657958984 time for calcul the mask position with numpy : 0.0059735774993896484 nb_pixel_total : 563 time to create 1 rle with old method : 0.0006711483001708984 time for calcul the mask position with numpy : 0.0058825016021728516 nb_pixel_total : 4875 time to create 1 rle with old method : 0.005594015121459961 time for calcul the mask position with numpy : 0.006216764450073242 nb_pixel_total : 971 time to create 1 rle with old method : 0.001219034194946289 time for calcul the mask position with numpy : 0.010020971298217773 nb_pixel_total : 4213 time to create 1 rle with old method : 0.005074501037597656 time for calcul the mask position with numpy : 0.010011911392211914 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002589225769042969 time for calcul the mask position with numpy : 0.010401248931884766 nb_pixel_total : 1791 time to create 1 rle with old method : 0.002213716506958008 time for calcul the mask position with numpy : 0.01007986068725586 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006237030029296875 time for calcul the mask position with numpy : 0.010551214218139648 nb_pixel_total : 130 time to create 1 rle with old method : 0.00016808509826660156 time for calcul the mask position with numpy : 0.010407447814941406 nb_pixel_total : 247 time to create 1 rle with old method : 0.00031638145446777344 time for calcul the mask position with numpy : 0.01003575325012207 nb_pixel_total : 1319 time to create 1 rle with old method : 0.0016207695007324219 time for calcul the mask position with numpy : 0.008125543594360352 nb_pixel_total : 54 time to create 1 rle with old method : 0.0001518726348876953 time for calcul the mask position with numpy : 0.007931709289550781 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002789497375488281 time for calcul the mask position with numpy : 0.005884408950805664 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005366802215576172 time for calcul the mask position with numpy : 0.0058176517486572266 nb_pixel_total : 1767 time to create 1 rle with old method : 0.001971721649169922 time for calcul the mask position with numpy : 0.006171226501464844 nb_pixel_total : 154 time to create 1 rle with old method : 0.00020575523376464844 time for calcul the mask position with numpy : 0.006121397018432617 nb_pixel_total : 73 time to create 1 rle with old method : 0.00011658668518066406 time for calcul the mask position with numpy : 0.005850315093994141 nb_pixel_total : 370 time to create 1 rle with old method : 0.000423431396484375 time for calcul the mask position with numpy : 0.0057735443115234375 nb_pixel_total : 528 time to create 1 rle with old method : 0.0006365776062011719 time for calcul the mask position with numpy : 0.00590825080871582 nb_pixel_total : 135 time to create 1 rle with old method : 0.0001823902130126953 time for calcul the mask position with numpy : 0.006261348724365234 nb_pixel_total : 116 time to create 1 rle with old method : 0.000152587890625 time for calcul the mask position with numpy : 0.005707263946533203 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003407001495361328 time for calcul the mask position with numpy : 0.006465435028076172 nb_pixel_total : 106188 time to create 1 rle with old method : 0.11588120460510254 time for calcul the mask position with numpy : 0.006053924560546875 nb_pixel_total : 2877 time to create 1 rle with old method : 0.0032885074615478516 time for calcul the mask position with numpy : 0.00609898567199707 nb_pixel_total : 56 time to create 1 rle with old method : 9.894371032714844e-05 time for calcul the mask position with numpy : 0.006249427795410156 nb_pixel_total : 37152 time to create 1 rle with old method : 0.04244494438171387 time for calcul the mask position with numpy : 0.00649714469909668 nb_pixel_total : 98 time to create 1 rle with old method : 0.00014591217041015625 time for calcul the mask position with numpy : 0.0063779354095458984 nb_pixel_total : 335 time to create 1 rle with old method : 0.00037026405334472656 time for calcul the mask position with numpy : 0.0059392452239990234 nb_pixel_total : 600 time to create 1 rle with old method : 0.0007078647613525391 time for calcul the mask position with numpy : 0.005964756011962891 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002486705780029297 time for calcul the mask position with numpy : 0.005967617034912109 nb_pixel_total : 50 time to create 1 rle with old method : 9.250640869140625e-05 time for calcul the mask position with numpy : 0.006289482116699219 nb_pixel_total : 1365 time to create 1 rle with old method : 0.0015709400177001953 time for calcul the mask position with numpy : 0.006302833557128906 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004417896270751953 time for calcul the mask position with numpy : 0.0063097476959228516 nb_pixel_total : 96 time to create 1 rle with old method : 0.00012445449829101562 time for calcul the mask position with numpy : 0.006367921829223633 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003421306610107422 time for calcul the mask position with numpy : 0.0057811737060546875 nb_pixel_total : 2366 time to create 1 rle with old method : 0.002699613571166992 time for calcul the mask position with numpy : 0.006108283996582031 nb_pixel_total : 81 time to create 1 rle with old method : 0.000118255615234375 time for calcul the mask position with numpy : 0.005986452102661133 nb_pixel_total : 549 time to create 1 rle with old method : 0.0006291866302490234 time for calcul the mask position with numpy : 0.00592041015625 nb_pixel_total : 87 time to create 1 rle with old method : 0.00012159347534179688 time for calcul the mask position with numpy : 0.0059664249420166016 nb_pixel_total : 45 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.006352663040161133 nb_pixel_total : 942 time to create 1 rle with old method : 0.0010936260223388672 time for calcul the mask position with numpy : 0.006018161773681641 nb_pixel_total : 2152 time to create 1 rle with old method : 0.0024309158325195312 time for calcul the mask position with numpy : 0.0062940120697021484 nb_pixel_total : 207 time to create 1 rle with old method : 0.000247955322265625 time for calcul the mask position with numpy : 0.006194114685058594 nb_pixel_total : 22 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.006259441375732422 nb_pixel_total : 96 time to create 1 rle with old method : 0.00015234947204589844 time for calcul the mask position with numpy : 0.005907773971557617 nb_pixel_total : 84 time to create 1 rle with old method : 0.00011730194091796875 create new chi : 0.869260311126709 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014026165008544922 batch 1 Loaded 77 chid ids of type : 4230 Number RLEs to save : 9028 TO DO : save crop sub photo not yet done ! save time : 2.1278598308563232 map_output_result : {1333949955: (0.0, 'Should be the crop_list due to order', 0.0), 1333949953: (0.0, 'Should be the crop_list due to order', 0.0), 1333949952: (0.0, 'Should be the crop_list due to order', 0.0), 1333949951: (0.0, 'Should be the crop_list due to order', 0.0), 1333949950: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1333949955, 1333949953, 1333949952, 1333949951, 1333949950] Looping around the photos to save general results len do output : 5 /1333949955.Didn't retrieve data . /1333949953.Didn't retrieve data . /1333949952.Didn't retrieve data . /1333949951.Didn't retrieve data . /1333949950.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949955', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949953', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949952', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949951', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949950', None, None, None, None, None, '2538711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.0776224136352539 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.80437660217285 time spend to save output : 0.07793736457824707 total time spend for step 4 : 26.8823139667511 step5:crop_condition Mon Feb 3 04:21:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 409 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 130 About to insert : list_path_to_insert length 130 new photo from crops ! About to upload 130 photos upload in portfolio : 4869462 init cache_photo without model_param we have 130 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738552901_1222209 we have uploaded 130 photos in the portfolio 4869462 time of upload the photos Elapsed time : 31.08130931854248 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 50 About to insert : list_path_to_insert length 50 new photo from crops ! About to upload 50 photos upload in portfolio : 4869462 init cache_photo without model_param we have 50 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738552933_1222209 we have uploaded 50 photos in the portfolio 4869462 time of upload the photos Elapsed time : 16.664972066879272 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738552949_1222209 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6395645141601562 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 4869462 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738552951_1222209 we have uploaded 26 photos in the portfolio 4869462 time of upload the photos Elapsed time : 5.489197254180908 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 59 About to insert : list_path_to_insert length 59 new photo from crops ! About to upload 59 photos upload in portfolio : 4869462 init cache_photo without model_param we have 59 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738552957_1222209 we have uploaded 59 photos in the portfolio 4869462 time of upload the photos Elapsed time : 16.087077617645264 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333949955, 1333949953, 1333949952, 1333949951, 1333949950] Looping around the photos to save general results len do output : 266 /1334074702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334074954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334075530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949955', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949953', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949952', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949951', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949950', None, None, None, None, None, '2538711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 803 time used for this insertion : 0.17255878448486328 save_final save missing photos in datou_result : time spend for datou_step_exec : 75.97147226333618 time spend to save output : 0.17968344688415527 total time spend for step 5 : 76.15115571022034 step6:thcl Mon Feb 3 04:22:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.020411968231201172 time to convert the images to numpy array : 0.03182029724121094 time to import caffe and check if the image exist : 0.018871307373046875 time to convert the images to numpy array : 0.04142904281616211 time to import caffe and check if the image exist : 0.015568256378173828 time to convert the images to numpy array : 0.049161434173583984 time to import caffe and check if the image exist : 0.018929004669189453 time to convert the images to numpy array : 0.051779985427856445 time to import caffe and check if the image exist : 0.015386581420898438 time to convert the images to numpy array : 0.07853817939758301 time to import caffe and check if the image exist : 0.023036718368530273 time to convert the images to numpy array : 0.07691383361816406 time to import caffe and check if the image exist : 0.012853622436523438 time to convert the images to numpy array : 0.08742547035217285 time to import caffe and check if the image exist : 0.018543243408203125 time to convert the images to numpy array : 0.08144021034240723 time to import caffe and check if the image exist : 0.022644758224487305 time to convert the images to numpy array : 0.08063673973083496 time to import caffe and check if the image exist : 0.018778562545776367 time to convert the images to numpy array : 0.08844780921936035 total time to convert the images to numpy array : 0.32978343963623047 list photo_ids error: [] list photo_ids correct : [1334075019, 1334075022, 1334075025, 1334075027, 1334075032, 1334075035, 1334075038, 1334075042, 1334075045, 1334075048, 1334075051, 1334075054, 1334075057, 1334075060, 1334075063, 1334075066, 1334075069, 1334075072, 1334075075, 1334075078, 1334075080, 1334075083, 1334075087, 1334075089, 1334075091, 1334075093, 1334075095, 1334074803, 1334074805, 1334074807, 1334074809, 1334074811, 1334074813, 1334074815, 1334074817, 1334074819, 1334074821, 1334074823, 1334074825, 1334074827, 1334074829, 1334074831, 1334074833, 1334074835, 1334074837, 1334074839, 1334074841, 1334074843, 1334074845, 1334074847, 1334074849, 1334074851, 1334074853, 1334074855, 1334075194, 1334075196, 1334075198, 1334075200, 1334075202, 1334075204, 1334075206, 1334075208, 1334075210, 1334075212, 1334075214, 1334075216, 1334075218, 1334075220, 1334075222, 1334075224, 1334075226, 1334075228, 1334075467, 1334075468, 1334075470, 1334075472, 1334075474, 1334075475, 1334075476, 1334075477, 1334075479, 1334074912, 1334074914, 1334074916, 1334074918, 1334074920, 1334074922, 1334074924, 1334074926, 1334074928, 1334074930, 1334074932, 1334074934, 1334074936, 1334074938, 1334074940, 1334074942, 1334074944, 1334074946, 1334074948, 1334074950, 1334074952, 1334074954, 1334075004, 1334075007, 1334075010, 1334075013, 1334075016, 1334074857, 1334074860, 1334074862, 1334074864, 1334074866, 1334074868, 1334074870, 1334074872, 1334074874, 1334074876, 1334074878, 1334074880, 1334074882, 1334074884, 1334074886, 1334074888, 1334074890, 1334074892, 1334074894, 1334074896, 1334074898, 1334074900, 1334074902, 1334074904, 1334074906, 1334074908, 1334074910, 1334075097, 1334075099, 1334075101, 1334075103, 1334075105, 1334075107, 1334075109, 1334075111, 1334075113, 1334075115, 1334075117, 1334075119, 1334075121, 1334075123, 1334075125, 1334075127, 1334075129, 1334075131, 1334075145, 1334075176, 1334075179, 1334075182, 1334075184, 1334075186, 1334075188, 1334075190, 1334075192, 1334075480, 1334075481, 1334075482, 1334075483, 1334075484, 1334075485, 1334075486, 1334075488, 1334075489, 1334075490, 1334075491, 1334075492, 1334075493, 1334075494, 1334075495, 1334075496, 1334075497, 1334075498, 1334075499, 1334075500, 1334075501, 1334075502, 1334075503, 1334075504, 1334075505, 1334075506, 1334075507, 1334075508, 1334075509, 1334075510, 1334075511, 1334075512, 1334075513, 1334075514, 1334075515, 1334075516, 1334075517, 1334075518, 1334075519, 1334075520, 1334075521, 1334075522, 1334075523, 1334075524, 1334075525, 1334075526, 1334075527, 1334075528, 1334075529, 1334075530, 1334074749, 1334074751, 1334074753, 1334074755, 1334074757, 1334074759, 1334074761, 1334074763, 1334074765, 1334074767, 1334074769, 1334074771, 1334074773, 1334074775, 1334074777, 1334074779, 1334074781, 1334074783, 1334074785, 1334074787, 1334074789, 1334074791, 1334074793, 1334074795, 1334074797, 1334074799, 1334074801, 1334074702, 1334074703, 1334074704, 1334074705, 1334074706, 1334074707, 1334074708, 1334074710, 1334074712, 1334074714, 1334074716, 1334074718, 1334074720, 1334074722, 1334074724, 1334074726, 1334074728, 1334074730, 1334074732, 1334074734, 1334074736, 1334074738, 1334074740, 1334074741, 1334074743, 1334074745, 1334074747] number of photos to traite : 266 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10555 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.1637468338012695 time used to do the prediction : 1.054011344909668 save descriptor for thcl : 3237 time to traite the descriptors : 1.5633513927459717 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1334075019 To insert : 1334075022 To insert : 1334075025 To insert : 1334075027 To insert : 1334075032 To insert : 1334075035 To insert : 1334075038 To insert : 1334075042 To insert : 1334075045 To insert : 1334075048 To insert : 1334075051 To insert : 1334075054 To insert : 1334075057 To insert : 1334075060 To insert : 1334075063 To insert : 1334075066 To insert : 1334075069 To insert : 1334075072 To insert : 1334075075 To insert : 1334075078 To insert : 1334075080 To insert : 1334075083 To insert : 1334075087 To insert : 1334075089 To insert : 1334075091 To insert : 1334075093 To insert : 1334075095 To insert : 1334074803 To insert : 1334074805 To insert : 1334074807 To insert : 1334074809 To insert : 1334074811 To insert : 1334074813 To insert : 1334074815 To insert : 1334074817 To insert : 1334074819 To insert : 1334074821 To insert : 1334074823 To insert : 1334074825 To insert : 1334074827 To insert : 1334074829 To insert : 1334074831 To insert : 1334074833 To insert : 1334074835 To insert : 1334074837 To insert : 1334074839 To insert : 1334074841 To insert : 1334074843 To insert : 1334074845 To insert : 1334074847 To insert : 1334074849 To insert : 1334074851 To insert : 1334074853 To insert : 1334074855 To insert : 1334075194 To insert : 1334075196 To insert : 1334075198 To insert : 1334075200 To insert : 1334075202 To insert : 1334075204 To insert : 1334075206 To insert : 1334075208 To insert : 1334075210 To insert : 1334075212 To insert : 1334075214 To insert : 1334075216 To insert : 1334075218 To insert : 1334075220 To insert : 1334075222 To insert : 1334075224 To insert : 1334075226 To insert : 1334075228 To insert : 1334075467 To insert : 1334075468 To insert : 1334075470 To insert : 1334075472 To insert : 1334075474 To insert : 1334075475 To insert : 1334075476 To insert : 1334075477 To insert : 1334075479 To insert : 1334074912 To insert : 1334074914 To insert : 1334074916 To insert : 1334074918 To insert : 1334074920 To insert : 1334074922 To insert : 1334074924 To insert : 1334074926 To insert : 1334074928 To insert : 1334074930 To insert : 1334074932 To insert : 1334074934 To insert : 1334074936 To insert : 1334074938 To insert : 1334074940 To insert : 1334074942 To insert : 1334074944 To insert : 1334074946 To insert : 1334074948 To insert : 1334074950 To insert : 1334074952 To insert : 1334074954 To insert : 1334075004 To insert : 1334075007 To insert : 1334075010 To insert : 1334075013 To insert : 1334075016 To insert : 1334074857 To insert : 1334074860 To insert : 1334074862 To insert : 1334074864 To insert : 1334074866 To insert : 1334074868 To insert : 1334074870 To insert : 1334074872 To insert : 1334074874 To insert : 1334074876 To insert : 1334074878 To insert : 1334074880 To insert : 1334074882 To insert : 1334074884 To insert : 1334074886 To insert : 1334074888 To insert : 1334074890 To insert : 1334074892 To insert : 1334074894 To insert : 1334074896 To insert : 1334074898 To insert : 1334074900 To insert : 1334074902 To insert : 1334074904 To insert : 1334074906 To insert : 1334074908 To insert : 1334074910 To insert : 1334075097 To insert : 1334075099 To insert : 1334075101 To insert : 1334075103 To insert : 1334075105 To insert : 1334075107 To insert : 1334075109 To insert : 1334075111 To insert : 1334075113 To insert : 1334075115 To insert : 1334075117 To insert : 1334075119 To insert : 1334075121 To insert : 1334075123 To insert : 1334075125 To insert : 1334075127 To insert : 1334075129 To insert : 1334075131 To insert : 1334075145 To insert : 1334075176 To insert : 1334075179 To insert : 1334075182 To insert : 1334075184 To insert : 1334075186 To insert : 1334075188 To insert : 1334075190 To insert : 1334075192 To insert : 1334075480 To insert : 1334075481 To insert : 1334075482 To insert : 1334075483 To insert : 1334075484 To insert : 1334075485 To insert : 1334075486 To insert : 1334075488 To insert : 1334075489 To insert : 1334075490 To insert : 1334075491 To insert : 1334075492 To insert : 1334075493 To insert : 1334075494 To insert : 1334075495 To insert : 1334075496 To insert : 1334075497 To insert : 1334075498 To insert : 1334075499 To insert : 1334075500 To insert : 1334075501 To insert : 1334075502 To insert : 1334075503 To insert : 1334075504 To insert : 1334075505 To insert : 1334075506 To insert : 1334075507 To insert : 1334075508 To insert : 1334075509 To insert : 1334075510 To insert : 1334075511 To insert : 1334075512 To insert : 1334075513 To insert : 1334075514 To insert : 1334075515 To insert : 1334075516 To insert : 1334075517 To insert : 1334075518 To insert : 1334075519 To insert : 1334075520 To insert : 1334075521 To insert : 1334075522 To insert : 1334075523 To insert : 1334075524 To insert : 1334075525 To insert : 1334075526 To insert : 1334075527 To insert : 1334075528 To insert : 1334075529 To insert : 1334075530 To insert : 1334074749 To insert : 1334074751 To insert : 1334074753 To insert : 1334074755 To insert : 1334074757 To insert : 1334074759 To insert : 1334074761 To insert : 1334074763 To insert : 1334074765 To insert : 1334074767 To insert : 1334074769 To insert : 1334074771 To insert : 1334074773 To insert : 1334074775 To insert : 1334074777 To insert : 1334074779 To insert : 1334074781 To insert : 1334074783 To insert : 1334074785 To insert : 1334074787 To insert : 1334074789 To insert : 1334074791 To insert : 1334074793 To insert : 1334074795 To insert : 1334074797 To insert : 1334074799 To insert : 1334074801 To insert : 1334074702 To insert : 1334074703 To insert : 1334074704 To insert : 1334074705 To insert : 1334074706 To insert : 1334074707 To insert : 1334074708 To insert : 1334074710 To insert : 1334074712 To insert : 1334074714 To insert : 1334074716 To insert : 1334074718 To insert : 1334074720 To insert : 1334074722 To insert : 1334074724 To insert : 1334074726 To insert : 1334074728 To insert : 1334074730 To insert : 1334074732 To insert : 1334074734 To insert : 1334074736 To insert : 1334074738 To insert : 1334074740 To insert : 1334074741 To insert : 1334074743 To insert : 1334074745 To insert : 1334074747 time to insert the descriptors : 48.176981925964355 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 383 time used for this insertion : 0.0306699275970459 save missing photos in datou_result : time spend for datou_step_exec : 56.121336221694946 time spend to save output : 0.08281898498535156 total time spend for step 6 : 56.2041552066803 step7:ventilate_hashtags_in_portfolio Mon Feb 3 04:23:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20162680 get user id for portfolio 20162680 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162680 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','environnement','papier','Tetrapak','carton','pehd','pet_fonce','PET_clair','mal_croppe','Carton','PEHD','PET_fonce','pet_clair','Papier','metal','Film_plastique','flou','refus')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162680 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','environnement','papier','Tetrapak','carton','pehd','pet_fonce','PET_clair','mal_croppe','Carton','PEHD','PET_fonce','pet_clair','Papier','metal','Film_plastique','flou','refus')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162680 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','environnement','papier','Tetrapak','carton','pehd','pet_fonce','PET_clair','mal_croppe','Carton','PEHD','PET_fonce','pet_clair','Papier','metal','Film_plastique','flou','refus')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162680 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','environnement','papier','Tetrapak','carton','pehd','pet_fonce','PET_clair','mal_croppe','Carton','PEHD','PET_fonce','pet_clair','Papier','metal','Film_plastique','flou','refus')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20166239,20166240,20166252,20166242,20166248,20166249,20166250,20166251,20166247,20166253,20166254,20166255,20166256?tags=autre,environnement,papier,tetrapak,carton,pehd,pet_fonce,pet_clair,mal_croppe,metal,film_plastique,flou,refus&datou_id_consolidate=4235&port_consolidate=20162680 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1333949955, 1333949953, 1333949952, 1333949951, 1333949950] Looping around the photos to save general results len do output : 1 /20162680. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949955', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949953', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949952', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949951', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949950', None, None, None, None, None, '2538711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01806187629699707 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.56575870513916 time spend to save output : 0.018340110778808594 total time spend for step 7 : 2.5840988159179688 step8:final Mon Feb 3 04:23:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1333949955: ('0.1915944391901324',), 1333949953: ('0.1915944391901324',), 1333949952: ('0.1915944391901324',), 1333949951: ('0.1915944391901324',), 1333949950: ('0.1915944391901324',)} new output for save of step final : {1333949955: ('0.1915944391901324',), 1333949953: ('0.1915944391901324',), 1333949952: ('0.1915944391901324',), 1333949951: ('0.1915944391901324',), 1333949950: ('0.1915944391901324',)} [1333949955, 1333949953, 1333949952, 1333949951, 1333949950] Looping around the photos to save general results len do output : 5 /1333949955.Didn't retrieve data . /1333949953.Didn't retrieve data . /1333949952.Didn't retrieve data . /1333949951.Didn't retrieve data . /1333949950.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949955', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949953', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949952', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949951', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949950', None, None, None, None, None, '2538711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.016538143157958984 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11968612670898438 time spend to save output : 0.01685929298400879 total time spend for step 8 : 0.13654541969299316 step9:velours_tree Mon Feb 3 04:23:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20166239,20166240,20166252,20166242,20166248,20166249,20166250,20166251,20166247,20166253,20166254,20166255,20166256 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166239 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166240 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166252 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166242 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166248 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166249 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166250 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166251 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166247 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166253 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166254 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166255 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20166256 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 266 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [1 2 4 4 0 4 3 4 1 3 1 3 2 1 2 1 2 2 4 0 4 4 2 4 4 4 0 4 4 3 4 1 3 1 1 1 4 4 3 2 2 3 1 1 2 4 2 4 4 4 4 4 4 0 4 3 4 3 1 1 1 3 2 4 4 3 3 2 2 1 3 1 1 2 2 4 4 4 4 4 0 4 0 0 2 4 3 4 3 1 1 4 4 3 2 2 3 4 1 2 4 2 2 4 4 4 0 4 3 4 1 3 1 1 3 4 1 3 2 4 2 1 3 1 2 2 4 2 4 4 0 1 4 4 2 2 4 1 1 1 1 0 0 1 1 4 2 1 1 1 4 1 0 0 1 4 1 2 4 1 4 1 1 1 4 4 2 1 4 1 2 0 0 0 1 4 2 1 4 1 1 3 2 3 5 1 3 4 3 5 3 1 1 3 3 5 2 1 1 3 5 4 0 3 3 5 1 2 0 0 2 3 2 2 1 1 2 2 2 0 2 3 1 1 2 2 2 2 2 2 2 2 0 1 1 2 2 2 1 2 2 0 3 1 1 2 2 2 4 0 2 0 0 1 4 1 4 0 2 2 2 4 2 0 2 2] Elapsed time: 0.042223215103149414 graph_id used : 75622 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20166239,20166240,20166252,20166242,20166248,20166249,20166250,20166251,20166247,20166253,20166254,20166255,20166256?tags=autre,environnement,papier,tetrapak,carton,pehd,pet_fonce,pet_clair,mal_croppe,metal,film_plastique,flou,refus&datou_id_consolidate=4235&port_consolidate=20162680&tree_id=75622 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1333949955, 1333949953, 1333949952, 1333949951, 1333949950] Looping around the photos to save general results len do output : 1 /20162680Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949955', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949953', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949952', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949951', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949950', None, None, None, None, None, '2538711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013764619827270508 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.854814767837524 time spend to save output : 0.014060258865356445 total time spend for step 9 : 18.86887502670288 step10:send_mail_cod Mon Feb 3 04:24:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20162680_03-02-2025_04_24_12.pdf 20166221 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201662211738553052 20166234 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201662341738553053 20166224 imagette201662241738553054 20166230 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201662301738553054 20166231 imagette201662311738553055 20166232 imagette201662321738553055 20166233 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201662331738553055 20166229 imagette201662291738553056 20166235 change filename to text .imagette201662351738553056 20166236 imagette201662361738553056 20166237 imagette201662371738553056 20166238 imagette201662381738553056 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20162680 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20166239,20166240,20166252,20166242,20166248,20166249,20166250,20166251,20166247,20166253,20166254,20166255,20166256?tags=autre,environnement,papier,tetrapak,carton,pehd,pet_fonce,pet_clair,mal_croppe,metal,film_plastique,flou,refus&datou_id_consolidate=4235&port_consolidate=20162680&tree_id=75622 your option no_mail is active, we will not send the real mail to your client args[1333949955] : ((1333949955, -7.667858176235798, 492609224), (1333949955, -0.2530465653757115, 496442774), '0.1915944391901324') We are sending mail with results at cod@fotonower.com args[1333949953] : ((1333949953, -7.8704964881384605, 492609224), (1333949953, -0.07802137187522196, 496442774), '0.1915944391901324') We are sending mail with results at cod@fotonower.com args[1333949952] : ((1333949952, -7.874767021170974, 492609224), (1333949952, -0.10605375204398604, 496442774), '0.1915944391901324') We are sending mail with results at cod@fotonower.com args[1333949951] : ((1333949951, -7.865939573872376, 492609224), (1333949951, -0.11247212851308852, 496442774), '0.1915944391901324') We are sending mail with results at cod@fotonower.com args[1333949950] : ((1333949950, -7.818194967240829, 492609224), (1333949950, -0.16576101383746816, 496442774), '0.1915944391901324') We are sending mail with results at cod@fotonower.com refus_total : 0.1915944391901324 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20162680 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162680_03-02-2025_04_24_12.pdf results_Qualipapia_P20162680_03-02-2025_04_24_12.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162680_03-02-2025_04_24_12.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20162680','results_Qualipapia_P20162680_03-02-2025_04_24_12.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162680_03-02-2025_04_24_12.pdf','pdf','','0.18','0.1915944391901324') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1333949955, 1333949953, 1333949952, 1333949951, 1333949950] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949955', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949953', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949952', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949951', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949950', None, None, None, None, None, '2538711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.10278034210205078 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.925408124923706 time spend to save output : 0.10297036170959473 total time spend for step 10 : 5.028378486633301 step11:split_time_score Mon Feb 3 04:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02022025 20162680 Nombre de photos uploadées : 13 / 23040 (0%) 02022025 20162680 Nombre de photos taguées (types de déchets): 13 / 13 (100%) 02022025 20162680 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008056163787841797 elapsed_time : insert_dashboard_record_day_entry 0.025106430053710938 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162644 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162662 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162664 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162665 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162666 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162667 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162668 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162669 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162670 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162671 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162672 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162673 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162674 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162675 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162676 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162677 order by id desc limit 1 Qualite : 0.21121943125808038 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162678_03-02-2025_03_35_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162678 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162678 AND mptpi.`type`=4230 To do Qualite : 0.18704640826288624 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162679_03-02-2025_03_52_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162679 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162679 AND mptpi.`type`=4230 To do Qualite : 0.1915944391901324 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162680_03-02-2025_04_24_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162680 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162680 AND mptpi.`type`=4230 To do Qualite : 0.12966306483712942 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162681_03-02-2025_02_47_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162681 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162681 AND mptpi.`type`=4230 To do Qualite : 0.1832822109376579 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162682_03-02-2025_03_25_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162682 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162682 AND mptpi.`type`=4230 To do Qualite : 0.16702339664312432 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162683_03-02-2025_02_39_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162683 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162683 AND mptpi.`type`=4230 To do Qualite : 0.19982909633604562 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162684_03-02-2025_02_35_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162684 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162684 AND mptpi.`type`=4230 To do Qualite : 0.2305840509306758 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162685_03-02-2025_02_26_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162685 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162685 AND mptpi.`type`=4230 To do Qualite : 0.24047913948636446 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162686_03-02-2025_01_46_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162686 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162686 AND mptpi.`type`=4230 To do Qualite : 0.24738916764667143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162687_03-02-2025_01_50_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162687 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162687 AND mptpi.`type`=4230 To do Qualite : 0.24765217198616346 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162688_03-02-2025_01_42_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162688 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162688 AND mptpi.`type`=4230 To do Qualite : 0.21025546761378716 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162689_03-02-2025_01_34_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162689 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162689 AND mptpi.`type`=4230 To do Qualite : 0.2518085364093474 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162690_03-02-2025_01_32_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162690 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162690 AND mptpi.`type`=4230 To do Qualite : 0.23214516723309475 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162691_03-02-2025_01_27_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162691 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162691 AND mptpi.`type`=4230 To do Qualite : 0.2004456322145325 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162692_03-02-2025_01_22_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162692 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162692 AND mptpi.`type`=4230 To do Qualite : 0.20880203185509494 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162693_03-02-2025_01_20_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162693 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162693 AND mptpi.`type`=4230 To do Qualite : 0.18514600417968427 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162694_03-02-2025_01_16_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162694 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162694 AND mptpi.`type`=4230 To do Qualite : 0.17908366031743364 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162695_03-02-2025_00_51_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162695 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162695 AND mptpi.`type`=4230 To do Qualite : 0.19305288886737082 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162696_03-02-2025_00_44_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162696 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162696 AND mptpi.`type`=4230 To do Qualite : 0.19328242832005024 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162697_03-02-2025_00_46_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162697 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162697 AND mptpi.`type`=4230 To do Qualite : 0.17139189028903767 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162698_03-02-2025_00_34_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162698 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162698 AND mptpi.`type`=4230 To do Qualite : 0.1891712268968112 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162699_03-02-2025_00_31_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162699 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162699 AND mptpi.`type`=4230 To do Qualite : 0.17923304163593254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162700_03-02-2025_00_27_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162700 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162700 AND mptpi.`type`=4230 To do Qualite : 0.21157504534527558 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162701_03-02-2025_00_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162701 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162701 AND mptpi.`type`=4230 To do Qualite : 0.19050968855918649 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162702_03-02-2025_00_18_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162702 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162702 AND mptpi.`type`=4230 To do Qualite : 0.21383786583408712 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162703_03-02-2025_00_16_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162703 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162703 AND mptpi.`type`=4230 To do Qualite : 0.16928211545032903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20162704_03-02-2025_00_10_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20162704 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20162704 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02022025': {'nb_upload': 13, 'nb_taggue_class': 13, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1333949955, 1333949953, 1333949952, 1333949951, 1333949950] Looping around the photos to save general results len do output : 1 /20162680Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949955', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949953', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949952', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949951', None, None, None, None, None, '2538711') ('4234', None, None, None, None, None, None, None, '2538711') ('4234', '20162680', '1333949950', None, None, None, None, None, '2538711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.0455470085144043 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.115979433059692 time spend to save output : 0.04579591751098633 total time spend for step 11 : 15.161775350570679 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 54.14user 32.68system 4:06.84elapsed 35%CPU (0avgtext+0avgdata 2531532maxresident)k 448inputs+20176outputs (4major+2255972minor)pagefaults 0swaps