python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3856831 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 24>5 please execute split_portfolio.py -i 21129194 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2645987'] with mtr_portfolio_ids : ['21129194'] and first list_photo_ids : [] new path : /proc/3856831/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.5357296466827393 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Thu Mar 6 22:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-06 22:20:32.464579: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-06 22:20:32.491238: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-06 22:20:32.493668: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f447c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-06 22:20:32.493746: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-06 22:20:32.498422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-06 22:20:32.644950: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xc165d60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-06 22:20:32.645029: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-06 22:20:32.646652: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-06 22:20:32.647175: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-06 22:20:32.651340: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-06 22:20:32.655295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-06 22:20:32.656066: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-06 22:20:32.659203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-06 22:20:32.660923: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-06 22:20:32.667961: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-06 22:20:32.669689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-06 22:20:32.669880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-06 22:20:32.671010: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-06 22:20:32.671031: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-06 22:20:32.671040: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-06 22:20:32.672557: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9217 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-06 22:20:32.982188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-06 22:20:32.982329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-06 22:20:32.982361: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-06 22:20:32.982388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-06 22:20:32.982413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-06 22:20:32.982444: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-06 22:20:32.982472: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-06 22:20:32.982502: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-06 22:20:32.984270: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-06 22:20:32.986019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-06 22:20:32.986134: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-06 22:20:32.986165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-06 22:20:32.986241: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-06 22:20:32.986267: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-06 22:20:32.986292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-06 22:20:32.986317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-06 22:20:32.986344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-06 22:20:32.988120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-06 22:20:32.988190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-06 22:20:32.988204: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-06 22:20:32.988215: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-06 22:20:32.990077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9217 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-06 22:20:42.126232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-06 22:20:42.336721: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.94219 max: 145.19375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00012612342834472656 nb_pixel_total : 157 time to create 1 rle with old method : 0.00041675567626953125 length of segment : 20 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0006940364837646484 length of segment : 29 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 20 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.0016167163848876953 length of segment : 57 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.001192331314086914 length of segment : 48 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.58281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 891 time to create 1 rle with old method : 0.0017817020416259766 length of segment : 77 time for calcul the mask position with numpy : 0.00011444091796875 nb_pixel_total : 2832 time to create 1 rle with old method : 0.005246162414550781 length of segment : 55 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 45 time to create 1 rle with old method : 0.0001709461212158203 length of segment : 6 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.001241922378540039 length of segment : 46 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 3141 time to create 1 rle with old method : 0.006474494934082031 length of segment : 55 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 36 time to create 1 rle with old method : 0.00014710426330566406 length of segment : 6 time for calcul the mask position with numpy : 0.000133514404296875 nb_pixel_total : 2350 time to create 1 rle with old method : 0.005262136459350586 length of segment : 92 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.07500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0004475116729736328 length of segment : 11 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003650188446044922 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.01250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004994869232177734 length of segment : 22 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0007560253143310547 length of segment : 25 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002722740173339844 length of segment : 26 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005121231079101562 length of segment : 24 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1054 time to create 1 rle with old method : 0.00140380859375 length of segment : 71 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 2791 time to create 1 rle with old method : 0.0038793087005615234 length of segment : 99 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 196.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 55.42422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0007371902465820312 length of segment : 16 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1273 time to create 1 rle with old method : 0.0016298294067382812 length of segment : 79 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.0008540153503417969 length of segment : 31 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003829002380371094 length of segment : 26 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 601 time to create 1 rle with old method : 0.0008268356323242188 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 160.00000 molded_images shape: (1, 640, 640, 3) min: -100.44219 max: 43.68984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013699531555175781 nb_pixel_total : 153947 time to create 1 rle with new method : 0.0021805763244628906 length of segment : 411 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.94219 max: 148.41641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 0.00017070770263671875 nb_pixel_total : 9923 time to create 1 rle with old method : 0.011904001235961914 length of segment : 125 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1180 time to create 1 rle with old method : 0.0016374588012695312 length of segment : 32 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 2039 time to create 1 rle with old method : 0.003354787826538086 length of segment : 44 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00027823448181152344 length of segment : 19 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005545616149902344 length of segment : 19 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00017261505126953125 length of segment : 13 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1250 time to create 1 rle with old method : 0.0018684864044189453 length of segment : 40 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0004055500030517578 length of segment : 31 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0006604194641113281 length of segment : 19 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003437995910644531 length of segment : 17 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003771781921386719 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.38359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 2990 time to create 1 rle with old method : 0.003833770751953125 length of segment : 49 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 38 time to create 1 rle with old method : 0.0001227855682373047 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.32500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00016641616821289062 nb_pixel_total : 6296 time to create 1 rle with old method : 0.007897138595581055 length of segment : 184 time for calcul the mask position with numpy : 0.00020194053649902344 nb_pixel_total : 5207 time to create 1 rle with old method : 0.00657343864440918 length of segment : 217 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 2109 time to create 1 rle with old method : 0.002690553665161133 length of segment : 60 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 716 time to create 1 rle with old method : 0.0011167526245117188 length of segment : 35 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1391 time to create 1 rle with old method : 0.0023283958435058594 length of segment : 52 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 166.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 51.86172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00010037422180175781 nb_pixel_total : 3103 time to create 1 rle with old method : 0.003987789154052734 length of segment : 144 time for calcul the mask position with numpy : 0.0001506805419921875 nb_pixel_total : 2552 time to create 1 rle with old method : 0.0033452510833740234 length of segment : 148 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007576942443847656 length of segment : 33 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 26 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003654956817626953 length of segment : 29 time for calcul the mask position with numpy : 0.00014972686767578125 nb_pixel_total : 2968 time to create 1 rle with old method : 0.003724336624145508 length of segment : 187 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.0001785755157470703 length of segment : 25 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0007393360137939453 length of segment : 31 Processing 1 images image shape: (280, 400, 3) min: 5.00000 max: 164.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 46.79922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009284019470214844 nb_pixel_total : 105462 time to create 1 rle with old method : 0.13625669479370117 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.82656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0010342597961425781 length of segment : 29 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00024390220642089844 length of segment : 19 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0007529258728027344 length of segment : 30 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0008149147033691406 length of segment : 41 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 759 time to create 1 rle with old method : 0.0010495185852050781 length of segment : 53 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 882 time to create 1 rle with old method : 0.0012633800506591797 length of segment : 28 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 3063 time to create 1 rle with old method : 0.004857063293457031 length of segment : 69 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1232 time to create 1 rle with old method : 0.0016891956329345703 length of segment : 49 time for calcul the mask position with numpy : 0.00024056434631347656 nb_pixel_total : 9141 time to create 1 rle with old method : 0.011782407760620117 length of segment : 111 time for calcul the mask position with numpy : 0.0008597373962402344 nb_pixel_total : 50444 time to create 1 rle with old method : 0.059046268463134766 length of segment : 251 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1042 time to create 1 rle with old method : 0.001399993896484375 length of segment : 42 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1295 time to create 1 rle with old method : 0.0016603469848632812 length of segment : 38 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0003840923309326172 length of segment : 23 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1502 time to create 1 rle with old method : 0.0019683837890625 length of segment : 42 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 1588 time to create 1 rle with old method : 0.002112865447998047 length of segment : 66 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 244.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 118.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0005819797515869141 length of segment : 22 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0003266334533691406 length of segment : 14 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00025343894958496094 length of segment : 14 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0011115074157714844 length of segment : 35 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1375 time to create 1 rle with old method : 0.0019068717956542969 length of segment : 44 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.000637054443359375 length of segment : 22 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00017833709716796875 length of segment : 13 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00039577484130859375 length of segment : 23 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0007228851318359375 length of segment : 28 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002846717834472656 length of segment : 18 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0005347728729248047 length of segment : 18 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005598068237304688 length of segment : 22 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003361701965332031 length of segment : 18 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0003256797790527344 length of segment : 18 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0005908012390136719 length of segment : 29 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0011718273162841797 length of segment : 46 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.73672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0007073879241943359 length of segment : 34 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00031685829162597656 length of segment : 13 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005297660827636719 length of segment : 34 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005505084991455078 length of segment : 26 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0006794929504394531 length of segment : 41 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.000972747802734375 length of segment : 22 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0007405281066894531 length of segment : 35 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 27 time to create 1 rle with old method : 0.00010037422180175781 length of segment : 9 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00024080276489257812 length of segment : 12 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007574558258056641 length of segment : 41 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0007348060607910156 length of segment : 32 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0005769729614257812 length of segment : 29 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0010793209075927734 length of segment : 43 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0007600784301757812 nb_pixel_total : 37997 time to create 1 rle with old method : 0.04869198799133301 length of segment : 239 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.36797 max: 146.11562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00035309791564941406 length of segment : 21 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 615 time to create 1 rle with old method : 0.0009889602661132812 length of segment : 49 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00039768218994140625 length of segment : 26 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00023555755615234375 length of segment : 22 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.0003008842468261719 length of segment : 14 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.001337289810180664 length of segment : 50 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.0002923011779785156 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.16484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00030231475830078125 nb_pixel_total : 320 time to create 1 rle with old method : 0.0010268688201904297 length of segment : 74 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 3008 time to create 1 rle with old method : 0.003709077835083008 length of segment : 53 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 885 time to create 1 rle with old method : 0.0012662410736083984 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.25078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 741 time to create 1 rle with old method : 0.0017447471618652344 length of segment : 37 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0021703243255615234 length of segment : 52 time for calcul the mask position with numpy : 0.00015807151794433594 nb_pixel_total : 214 time to create 1 rle with old method : 0.0007443428039550781 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.02422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0007910728454589844 length of segment : 26 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.000545501708984375 length of segment : 22 time for calcul the mask position with numpy : 0.0001518726348876953 nb_pixel_total : 2999 time to create 1 rle with old method : 0.004221916198730469 length of segment : 94 time for calcul the mask position with numpy : 0.0001418590545654297 nb_pixel_total : 2640 time to create 1 rle with old method : 0.0033643245697021484 length of segment : 121 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.0005040168762207031 length of segment : 21 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005292892456054688 length of segment : 23 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.0012583732604980469 length of segment : 34 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 59.42422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1657 time to create 1 rle with old method : 0.0020599365234375 length of segment : 91 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0007777214050292969 length of segment : 16 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1101 time to create 1 rle with old method : 0.0015292167663574219 length of segment : 61 Processing 1 images image shape: (400, 400, 3) min: 15.00000 max: 165.00000 molded_images shape: (1, 640, 640, 3) min: -100.39141 max: 47.16641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0015704631805419922 nb_pixel_total : 152354 time to create 1 rle with new method : 0.0022339820861816406 length of segment : 399 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.77422 max: 147.05312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 2241 time to create 1 rle with old method : 0.004081010818481445 length of segment : 49 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1203 time to create 1 rle with old method : 0.0016579627990722656 length of segment : 34 time for calcul the mask position with numpy : 0.0001780986785888672 nb_pixel_total : 9116 time to create 1 rle with old method : 0.011310815811157227 length of segment : 112 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005884170532226562 length of segment : 18 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 1824 time to create 1 rle with old method : 0.002455472946166992 length of segment : 61 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00029921531677246094 length of segment : 17 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004417896270751953 length of segment : 29 time for calcul the mask position with numpy : 0.00012445449829101562 nb_pixel_total : 1241 time to create 1 rle with old method : 0.001683950424194336 length of segment : 42 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005698204040527344 length of segment : 22 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006513595581054688 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.29375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0015933513641357422 length of segment : 62 time for calcul the mask position with numpy : 0.00014209747314453125 nb_pixel_total : 5600 time to create 1 rle with old method : 0.007123470306396484 length of segment : 56 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0005233287811279297 length of segment : 21 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 1252 time to create 1 rle with old method : 0.003973484039306641 length of segment : 43 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 736 time to create 1 rle with old method : 0.002007007598876953 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.66094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 2910 time to create 1 rle with old method : 0.0038509368896484375 length of segment : 68 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 675 time to create 1 rle with old method : 0.0009286403656005859 length of segment : 28 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1271 time to create 1 rle with old method : 0.0016872882843017578 length of segment : 43 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0016322135925292969 length of segment : 43 time for calcul the mask position with numpy : 0.0004737377166748047 nb_pixel_total : 17865 time to create 1 rle with old method : 0.024204492568969727 length of segment : 201 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005400180816650391 length of segment : 21 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 2674 time to create 1 rle with old method : 0.003386259078979492 length of segment : 62 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 751 time to create 1 rle with old method : 0.0009801387786865234 length of segment : 36 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0006072521209716797 length of segment : 21 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.0009822845458984375 length of segment : 37 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 175.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 51.02969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0006093978881835938 length of segment : 28 time for calcul the mask position with numpy : 0.00011754035949707031 nb_pixel_total : 1680 time to create 1 rle with old method : 0.0030722618103027344 length of segment : 165 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 1966 time to create 1 rle with old method : 0.002579927444458008 length of segment : 123 time for calcul the mask position with numpy : 0.00021457672119140625 nb_pixel_total : 3242 time to create 1 rle with old method : 0.00437617301940918 length of segment : 176 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0002143383026123047 length of segment : 24 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0008616447448730469 length of segment : 36 Processing 1 images image shape: (280, 400, 3) min: 6.00000 max: 167.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 49.22891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0011069774627685547 nb_pixel_total : 103956 time to create 1 rle with old method : 0.1266326904296875 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 3209 time to create 1 rle with old method : 0.004036903381347656 length of segment : 70 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00016355514526367188 length of segment : 19 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0006878376007080078 length of segment : 31 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005204677581787109 length of segment : 30 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0013966560363769531 length of segment : 46 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 863 time to create 1 rle with old method : 0.0011789798736572266 length of segment : 59 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.00039839744567871094 length of segment : 33 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0009119510650634766 length of segment : 30 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2508 time to create 1 rle with old method : 0.003236055374145508 length of segment : 82 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 239.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 112.70547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003781318664550781 length of segment : 18 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.0004916191101074219 length of segment : 22 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.0017821788787841797 length of segment : 36 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00023818016052246094 length of segment : 14 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00021648406982421875 length of segment : 15 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005366802215576172 length of segment : 21 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005774497985839844 length of segment : 32 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0005142688751220703 length of segment : 25 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00032401084899902344 length of segment : 19 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 630 time to create 1 rle with old method : 0.00086212158203125 length of segment : 39 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.00025963783264160156 length of segment : 23 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00024127960205078125 length of segment : 15 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001723766326904297 length of segment : 13 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.000553131103515625 length of segment : 25 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.13125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0008065700531005859 length of segment : 36 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005290508270263672 length of segment : 27 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002963542938232422 length of segment : 12 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 651 time to create 1 rle with old method : 0.0010495185852050781 length of segment : 35 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00024771690368652344 length of segment : 13 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.0004508495330810547 length of segment : 31 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004100799560546875 length of segment : 28 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.00096893310546875 length of segment : 24 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006196498870849609 length of segment : 41 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004353523254394531 length of segment : 31 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.66250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0005631446838378906 nb_pixel_total : 32505 time to create 1 rle with old method : 0.051889896392822266 length of segment : 294 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.85234 max: 145.42031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0004775524139404297 length of segment : 31 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0010342597961425781 length of segment : 51 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0006077289581298828 length of segment : 33 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002803802490234375 length of segment : 12 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 649 time to create 1 rle with old method : 0.0013248920440673828 length of segment : 58 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00025343894958496094 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.23516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 2905 time to create 1 rle with old method : 0.003521442413330078 length of segment : 99 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2828 time to create 1 rle with old method : 0.0037496089935302734 length of segment : 54 time for calcul the mask position with numpy : 0.0002453327178955078 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002796649932861328 length of segment : 38 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002009868621826172 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.34063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 8463 time to create 1 rle with old method : 0.010563135147094727 length of segment : 123 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 628 time to create 1 rle with old method : 0.0008902549743652344 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.12578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 1676 time to create 1 rle with old method : 0.002988576889038086 length of segment : 69 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.000982046127319336 length of segment : 26 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0008685588836669922 length of segment : 25 time for calcul the mask position with numpy : 0.0001621246337890625 nb_pixel_total : 2777 time to create 1 rle with old method : 0.004807949066162109 length of segment : 104 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005018711090087891 length of segment : 26 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 195.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 72.58437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 522 time to create 1 rle with old method : 0.0009682178497314453 length of segment : 17 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 714 time to create 1 rle with old method : 0.0009369850158691406 length of segment : 31 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0018525123596191406 length of segment : 85 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 156.00000 molded_images shape: (1, 640, 640, 3) min: -111.02422 max: 43.90859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013360977172851562 nb_pixel_total : 153952 time to create 1 rle with new method : 0.0022902488708496094 length of segment : 411 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.62969 max: 151.02969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1248 time to create 1 rle with old method : 0.0016863346099853516 length of segment : 35 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.000652313232421875 length of segment : 19 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 2224 time to create 1 rle with old method : 0.0031011104583740234 length of segment : 44 time for calcul the mask position with numpy : 0.00020074844360351562 nb_pixel_total : 9236 time to create 1 rle with old method : 0.011497259140014648 length of segment : 109 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006783008575439453 length of segment : 18 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00037217140197753906 length of segment : 30 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002956390380859375 length of segment : 21 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1465 time to create 1 rle with old method : 0.001977682113647461 length of segment : 58 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 2482 time to create 1 rle with old method : 0.0052547454833984375 length of segment : 66 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005435943603515625 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.93438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00016355514526367188 nb_pixel_total : 6150 time to create 1 rle with old method : 0.010715246200561523 length of segment : 63 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 1121 time to create 1 rle with old method : 0.0019788742065429688 length of segment : 66 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 747 time to create 1 rle with old method : 0.0013325214385986328 length of segment : 34 time for calcul the mask position with numpy : 0.0005745887756347656 nb_pixel_total : 17490 time to create 1 rle with old method : 0.0282747745513916 length of segment : 167 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002772808074951172 length of segment : 18 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.000667572021484375 length of segment : 31 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1471 time to create 1 rle with old method : 0.002019643783569336 length of segment : 46 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00044608116149902344 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.51250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0022521018981933594 length of segment : 43 time for calcul the mask position with numpy : 0.0001232624053955078 nb_pixel_total : 2749 time to create 1 rle with old method : 0.0048596858978271484 length of segment : 62 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 792 time to create 1 rle with old method : 0.0014405250549316406 length of segment : 37 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1201 time to create 1 rle with old method : 0.0023648738861083984 length of segment : 44 time for calcul the mask position with numpy : 0.0003573894500732422 nb_pixel_total : 9555 time to create 1 rle with old method : 0.017112016677856445 length of segment : 269 time for calcul the mask position with numpy : 0.00012731552124023438 nb_pixel_total : 2607 time to create 1 rle with old method : 0.0054607391357421875 length of segment : 68 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.001013040542602539 length of segment : 37 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 3285 time to create 1 rle with old method : 0.004404783248901367 length of segment : 72 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 167.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 50.98672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.000347137451171875 length of segment : 30 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 2181 time to create 1 rle with old method : 0.002839803695678711 length of segment : 124 time for calcul the mask position with numpy : 0.00011587142944335938 nb_pixel_total : 2879 time to create 1 rle with old method : 0.004071474075317383 length of segment : 186 time for calcul the mask position with numpy : 0.00027441978454589844 nb_pixel_total : 3688 time to create 1 rle with old method : 0.006845235824584961 length of segment : 196 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 457 time to create 1 rle with old method : 0.0007443428039550781 length of segment : 41 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006742477416992188 length of segment : 29 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.0009069442749023438 length of segment : 40 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 171.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 57.48672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009946823120117188 nb_pixel_total : 104786 time to create 1 rle with old method : 0.15393686294555664 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1472 time to create 1 rle with old method : 0.0018656253814697266 length of segment : 65 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001964569091796875 length of segment : 19 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 3111 time to create 1 rle with old method : 0.004040241241455078 length of segment : 65 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0009322166442871094 length of segment : 29 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 916 time to create 1 rle with old method : 0.0012362003326416016 length of segment : 45 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 729 time to create 1 rle with old method : 0.0010066032409667969 length of segment : 56 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005452632904052734 length of segment : 25 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1297 time to create 1 rle with old method : 0.0019989013671875 length of segment : 46 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0007233619689941406 length of segment : 31 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0017325878143310547 length of segment : 40 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1530 time to create 1 rle with old method : 0.002002239227294922 length of segment : 41 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0011057853698730469 length of segment : 31 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1221 time to create 1 rle with old method : 0.0016360282897949219 length of segment : 44 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 249.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 117.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0003018379211425781 length of segment : 16 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004725456237792969 length of segment : 20 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 745 time to create 1 rle with old method : 0.0011949539184570312 length of segment : 36 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00034928321838378906 length of segment : 15 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0006425380706787109 length of segment : 21 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003719329833984375 length of segment : 19 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00024175643920898438 length of segment : 14 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1147 time to create 1 rle with old method : 0.0018084049224853516 length of segment : 52 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004940032958984375 length of segment : 22 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0005404949188232422 length of segment : 22 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0006036758422851562 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.59219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 571 time to create 1 rle with old method : 0.0008218288421630859 length of segment : 40 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0004756450653076172 length of segment : 14 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0011026859283447266 length of segment : 35 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0006577968597412109 length of segment : 31 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0006265640258789062 length of segment : 33 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0012359619140625 length of segment : 49 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003273487091064453 length of segment : 29 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0007538795471191406 length of segment : 34 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 699 time to create 1 rle with old method : 0.0010380744934082031 length of segment : 22 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0008308887481689453 length of segment : 35 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.44219 max: 145.57656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 237 time to create 1 rle with old method : 0.0004904270172119141 length of segment : 39 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 687 time to create 1 rle with old method : 0.0013837814331054688 length of segment : 50 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.0006322860717773438 length of segment : 35 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 797 time to create 1 rle with old method : 0.0015499591827392578 length of segment : 56 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0002713203430175781 length of segment : 13 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0012295246124267578 length of segment : 51 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.0002529621124267578 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.24297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 835 time to create 1 rle with old method : 0.0011136531829833984 length of segment : 41 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 2174 time to create 1 rle with old method : 0.0029511451721191406 length of segment : 33 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 2222 time to create 1 rle with old method : 0.0029125213623046875 length of segment : 45 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 2405 time to create 1 rle with old method : 0.003144979476928711 length of segment : 36 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 2583 time to create 1 rle with old method : 0.0032732486724853516 length of segment : 47 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 944 time to create 1 rle with old method : 0.0012543201446533203 length of segment : 37 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 2980 time to create 1 rle with old method : 0.0038666725158691406 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.89531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00016117095947265625 nb_pixel_total : 7409 time to create 1 rle with old method : 0.009238958358764648 length of segment : 121 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004885196685791016 length of segment : 23 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0008144378662109375 length of segment : 28 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 689 time to create 1 rle with old method : 0.0009222030639648438 length of segment : 35 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005502700805664062 length of segment : 22 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003304481506347656 length of segment : 21 time for calcul the mask position with numpy : 0.000156402587890625 nb_pixel_total : 1807 time to create 1 rle with old method : 0.0029420852661132812 length of segment : 96 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 194.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 62.53750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0008203983306884766 length of segment : 16 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1367 time to create 1 rle with old method : 0.0016515254974365234 length of segment : 89 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0006644725799560547 length of segment : 26 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 684 time to create 1 rle with old method : 0.0012531280517578125 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 161.00000 molded_images shape: (1, 640, 640, 3) min: -104.58672 max: 47.94375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0014657974243164062 nb_pixel_total : 153000 time to create 1 rle with new method : 0.002553224563598633 length of segment : 402 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.82500 max: 147.12344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 2193 time to create 1 rle with old method : 0.0029761791229248047 length of segment : 46 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1178 time to create 1 rle with old method : 0.0018725395202636719 length of segment : 33 time for calcul the mask position with numpy : 0.0001895427703857422 nb_pixel_total : 9646 time to create 1 rle with old method : 0.01166224479675293 length of segment : 127 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006496906280517578 length of segment : 38 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002548694610595703 length of segment : 17 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0006134510040283203 length of segment : 20 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005943775177001953 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.27031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 6740 time to create 1 rle with old method : 0.008378982543945312 length of segment : 64 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1133 time to create 1 rle with old method : 0.00151824951171875 length of segment : 66 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0009653568267822266 length of segment : 33 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004818439483642578 length of segment : 25 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.0001709461212158203 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.24688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1254 time to create 1 rle with old method : 0.0016374588012695312 length of segment : 45 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1271 time to create 1 rle with old method : 0.0016639232635498047 length of segment : 43 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0010066032409667969 length of segment : 36 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.00047397613525390625 length of segment : 21 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 703 time to create 1 rle with old method : 0.0009331703186035156 length of segment : 28 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 2300 time to create 1 rle with old method : 0.003016948699951172 length of segment : 47 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 178.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 52.77969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00012087821960449219 nb_pixel_total : 2660 time to create 1 rle with old method : 0.004710674285888672 length of segment : 223 time for calcul the mask position with numpy : 0.00019931793212890625 nb_pixel_total : 3372 time to create 1 rle with old method : 0.00585174560546875 length of segment : 180 time for calcul the mask position with numpy : 0.00010418891906738281 nb_pixel_total : 2370 time to create 1 rle with old method : 0.003931760787963867 length of segment : 140 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.00041747093200683594 length of segment : 25 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007455348968505859 length of segment : 63 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006730556488037109 length of segment : 44 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006747245788574219 length of segment : 47 Processing 1 images image shape: (280, 400, 3) min: 3.00000 max: 158.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 44.60391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010454654693603516 nb_pixel_total : 103477 time to create 1 rle with old method : 0.14301681518554688 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.93594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00017595291137695312 length of segment : 19 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 671 time to create 1 rle with old method : 0.0008890628814697266 length of segment : 31 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006883144378662109 length of segment : 31 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 2945 time to create 1 rle with old method : 0.0038611888885498047 length of segment : 70 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0015265941619873047 length of segment : 51 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 867 time to create 1 rle with old method : 0.001539468765258789 length of segment : 29 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1390 time to create 1 rle with old method : 0.0018036365509033203 length of segment : 44 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1265 time to create 1 rle with old method : 0.0016429424285888672 length of segment : 48 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 2423 time to create 1 rle with old method : 0.003186941146850586 length of segment : 73 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 250.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 122.34609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004189014434814453 length of segment : 24 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00020742416381835938 length of segment : 14 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00024509429931640625 length of segment : 14 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.00042891502380371094 length of segment : 17 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 745 time to create 1 rle with old method : 0.0010454654693603516 length of segment : 36 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00022912025451660156 length of segment : 17 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0006351470947265625 length of segment : 32 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0005109310150146484 length of segment : 21 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.00046062469482421875 length of segment : 25 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.0002155303955078125 length of segment : 14 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0007491111755371094 length of segment : 39 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00021147727966308594 length of segment : 16 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.33828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0003025531768798828 length of segment : 12 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 575 time to create 1 rle with old method : 0.0009000301361083984 length of segment : 40 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0006453990936279297 length of segment : 21 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0006794929504394531 length of segment : 34 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007307529449462891 length of segment : 32 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0004937648773193359 length of segment : 27 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00033402442932128906 length of segment : 28 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.0003910064697265625 length of segment : 31 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0005476474761962891 nb_pixel_total : 35868 time to create 1 rle with old method : 0.04178905487060547 length of segment : 251 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.00078 max: 148.55703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001976490020751953 length of segment : 26 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 752 time to create 1 rle with old method : 0.0010631084442138672 length of segment : 58 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0003383159637451172 length of segment : 32 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001583099365234375 length of segment : 13 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 938 time to create 1 rle with old method : 0.0012607574462890625 length of segment : 56 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0002384185791015625 length of segment : 21 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 781 time to create 1 rle with old method : 0.0010867118835449219 length of segment : 62 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 17 time to create 1 rle with old method : 6.890296936035156e-05 length of segment : 6 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 52 time to create 1 rle with old method : 9.512901306152344e-05 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.42266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 2677 time to create 1 rle with old method : 0.0034487247467041016 length of segment : 50 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 943 time to create 1 rle with old method : 0.0013096332550048828 length of segment : 32 time for calcul the mask position with numpy : 0.00020384788513183594 nb_pixel_total : 326 time to create 1 rle with old method : 0.0005578994750976562 length of segment : 62 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0010259151458740234 length of segment : 52 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 3038 time to create 1 rle with old method : 0.0038514137268066406 length of segment : 54 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1021 time to create 1 rle with old method : 0.0013699531555175781 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.11016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00019097328186035156 nb_pixel_total : 7842 time to create 1 rle with old method : 0.009561538696289062 length of segment : 130 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.00045871734619140625 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.27813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005211830139160156 length of segment : 25 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.00043845176696777344 length of segment : 23 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003046989440917969 length of segment : 20 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.00037026405334472656 length of segment : 18 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 218.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 69.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007500648498535156 length of segment : 16 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1540 time to create 1 rle with old method : 0.0019237995147705078 length of segment : 114 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 635 time to create 1 rle with old method : 0.0008425712585449219 length of segment : 32 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00039124488830566406 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 171.00000 molded_images shape: (1, 640, 640, 3) min: -101.68047 max: 49.10391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0015439987182617188 nb_pixel_total : 153521 time to create 1 rle with new method : 0.0027365684509277344 length of segment : 408 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.81719 max: 146.83047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 1200 time to create 1 rle with old method : 0.002302408218383789 length of segment : 34 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0009598731994628906 length of segment : 38 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 2122 time to create 1 rle with old method : 0.002892732620239258 length of segment : 46 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 9703 time to create 1 rle with old method : 0.011946439743041992 length of segment : 120 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002875328063964844 length of segment : 20 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 1688 time to create 1 rle with old method : 0.002285003662109375 length of segment : 49 time for calcul the mask position with numpy : 0.00012254714965820312 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0020177364349365234 length of segment : 43 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005483627319335938 length of segment : 18 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0006318092346191406 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.27031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00011682510375976562 nb_pixel_total : 5905 time to create 1 rle with old method : 0.00744175910949707 length of segment : 58 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0015134811401367188 length of segment : 63 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 704 time to create 1 rle with old method : 0.0009393692016601562 length of segment : 32 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002810955047607422 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.37969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1238 time to create 1 rle with old method : 0.0016336441040039062 length of segment : 43 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 750 time to create 1 rle with old method : 0.0010187625885009766 length of segment : 39 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1264 time to create 1 rle with old method : 0.001741170883178711 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 176.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 58.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 2157 time to create 1 rle with old method : 0.0028502941131591797 length of segment : 175 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005397796630859375 length of segment : 40 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 1721 time to create 1 rle with old method : 0.002405881881713867 length of segment : 122 time for calcul the mask position with numpy : 0.00018858909606933594 nb_pixel_total : 3461 time to create 1 rle with old method : 0.0043985843658447266 length of segment : 180 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 732 time to create 1 rle with old method : 0.000986337661743164 length of segment : 42 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 747 time to create 1 rle with old method : 0.0010986328125 length of segment : 42 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 163.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 52.94766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013322830200195312 nb_pixel_total : 105156 time to create 1 rle with old method : 0.13127875328063965 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.04531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00018262863159179688 length of segment : 19 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 3013 time to create 1 rle with old method : 0.004011392593383789 length of segment : 61 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0008192062377929688 length of segment : 28 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 930 time to create 1 rle with old method : 0.0012462139129638672 length of segment : 49 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006470680236816406 length of segment : 29 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 851 time to create 1 rle with old method : 0.001131296157836914 length of segment : 27 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1196 time to create 1 rle with old method : 0.0015537738800048828 length of segment : 46 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1340 time to create 1 rle with old method : 0.0017139911651611328 length of segment : 40 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1332 time to create 1 rle with old method : 0.0017979145050048828 length of segment : 92 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004315376281738281 length of segment : 31 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1345 time to create 1 rle with old method : 0.0016980171203613281 length of segment : 41 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1053 time to create 1 rle with old method : 0.0013508796691894531 length of segment : 44 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006914138793945312 length of segment : 31 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 119.17031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0007753372192382812 length of segment : 22 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 715 time to create 1 rle with old method : 0.0009961128234863281 length of segment : 34 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002353191375732422 length of segment : 13 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005991458892822266 length of segment : 32 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.0002334117889404297 length of segment : 18 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003349781036376953 length of segment : 19 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005204677581787109 length of segment : 22 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.000751495361328125 length of segment : 36 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.000457763671875 length of segment : 19 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00042819976806640625 length of segment : 31 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.00046443939208984375 length of segment : 24 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003790855407714844 length of segment : 20 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.0001881122589111328 length of segment : 14 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005128383636474609 length of segment : 22 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002493858337402344 length of segment : 19 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.36172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00030541419982910156 length of segment : 18 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006699562072753906 length of segment : 33 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.0004317760467529297 length of segment : 23 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 34 time to create 1 rle with old method : 0.00010848045349121094 length of segment : 9 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0009481906890869141 length of segment : 35 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0006456375122070312 length of segment : 25 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0007841587066650391 length of segment : 32 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.000396728515625 length of segment : 33 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00042057037353515625 nb_pixel_total : 33276 time to create 1 rle with old method : 0.03930258750915527 length of segment : 241 Detection mask done ! Trying to reset tf kernel 3857511 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 395 tf kernel not reseted sub process len(results) : 445 len(list_Values) 445 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 445 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5684 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 445 chid ids of type : 4228 Number RLEs to save : 23408 save missing photos in datou_result : time spend for datou_step_exec : 36.1575140953064 time spend to save output : 2.37870192527771 total time spend for step 1 : 38.536216020584106 step2:brightness Thu Mar 6 22:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741296028_3856831_1341310788_4eb82a469d0e17e56c25f69cc1a33088.jpg treat image : temp/1741296028_3856831_1341310785_1e1a73682ea2676236e31ff24fb79318.jpg treat image : temp/1741296028_3856831_1341310782_945625110c2525e5b968c057b8d5244c.jpg treat image : temp/1741296028_3856831_1341310779_186b21d67c04284a72c44b47adb14c46.jpg treat image : temp/1741296028_3856831_1341310777_d0909cf22a05c894c3a24b59516c1a2d.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.011368036270141602 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.012090206146240234 save missing photos in datou_result : time spend for datou_step_exec : 1.2086830139160156 time spend to save output : 0.02855682373046875 total time spend for step 2 : 1.2372398376464844 step3:blur_detection Thu Mar 6 22:21:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741296028_3856831_1341310788_4eb82a469d0e17e56c25f69cc1a33088.jpg resize: (1080, 1920) 1341310788 -6.891517446364395 treat image : temp/1741296028_3856831_1341310785_1e1a73682ea2676236e31ff24fb79318.jpg resize: (1080, 1920) 1341310785 -6.925657692861879 treat image : temp/1741296028_3856831_1341310782_945625110c2525e5b968c057b8d5244c.jpg resize: (1080, 1920) 1341310782 -6.945870569189708 treat image : temp/1741296028_3856831_1341310779_186b21d67c04284a72c44b47adb14c46.jpg resize: (1080, 1920) 1341310779 -6.962072541791819 treat image : temp/1741296028_3856831_1341310777_d0909cf22a05c894c3a24b59516c1a2d.jpg resize: (1080, 1920) 1341310777 -6.966655224133138 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.012547969818115234 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.013316869735717773 save missing photos in datou_result : time spend for datou_step_exec : 5.060507535934448 time spend to save output : 0.031104564666748047 total time spend for step 3 : 5.091612100601196 step4:rle_unique_nms_with_priority Thu Mar 6 22:21:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 445 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 95 nb_hashtags : 7 time to prepare the origin masks : 1.367041826248169 time for calcul the mask position with numpy : 0.08350920677185059 nb_pixel_total : 1654952 time to create 1 rle with new method : 0.09978437423706055 time for calcul the mask position with numpy : 0.009063243865966797 nb_pixel_total : 758 time to create 1 rle with old method : 0.0011878013610839844 time for calcul the mask position with numpy : 0.00867009162902832 nb_pixel_total : 137 time to create 1 rle with old method : 0.00020766258239746094 time for calcul the mask position with numpy : 0.008739948272705078 nb_pixel_total : 36 time to create 1 rle with old method : 6.341934204101562e-05 time for calcul the mask position with numpy : 0.008785247802734375 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002040863037109375 time for calcul the mask position with numpy : 0.008706331253051758 nb_pixel_total : 117 time to create 1 rle with old method : 0.00018334388732910156 time for calcul the mask position with numpy : 0.00866246223449707 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004482269287109375 time for calcul the mask position with numpy : 0.008749961853027344 nb_pixel_total : 2832 time to create 1 rle with old method : 0.0033292770385742188 time for calcul the mask position with numpy : 0.008661031723022461 nb_pixel_total : 71 time to create 1 rle with old method : 0.00034809112548828125 time for calcul the mask position with numpy : 0.009361743927001953 nb_pixel_total : 626 time to create 1 rle with old method : 0.0009884834289550781 time for calcul the mask position with numpy : 0.008682966232299805 nb_pixel_total : 27 time to create 1 rle with old method : 6.198883056640625e-05 time for calcul the mask position with numpy : 0.008574962615966797 nb_pixel_total : 891 time to create 1 rle with old method : 0.001070261001586914 time for calcul the mask position with numpy : 0.00865936279296875 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0012669563293457031 time for calcul the mask position with numpy : 0.008756160736083984 nb_pixel_total : 1273 time to create 1 rle with old method : 0.0015568733215332031 time for calcul the mask position with numpy : 0.008736371994018555 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007617473602294922 time for calcul the mask position with numpy : 0.008702993392944336 nb_pixel_total : 182 time to create 1 rle with old method : 0.00024509429931640625 time for calcul the mask position with numpy : 0.008568286895751953 nb_pixel_total : 2350 time to create 1 rle with old method : 0.002838134765625 time for calcul the mask position with numpy : 0.008640289306640625 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004799365997314453 time for calcul the mask position with numpy : 0.008714914321899414 nb_pixel_total : 263 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.008579492568969727 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004334449768066406 time for calcul the mask position with numpy : 0.008699893951416016 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005669593811035156 time for calcul the mask position with numpy : 0.008678436279296875 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.008800745010375977 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003273487091064453 time for calcul the mask position with numpy : 0.008689403533935547 nb_pixel_total : 2791 time to create 1 rle with old method : 0.0033960342407226562 time for calcul the mask position with numpy : 0.008633613586425781 nb_pixel_total : 45 time to create 1 rle with old method : 8.0108642578125e-05 time for calcul the mask position with numpy : 0.008639335632324219 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006117820739746094 time for calcul the mask position with numpy : 0.009246826171875 nb_pixel_total : 153947 time to create 1 rle with new method : 0.10827875137329102 time for calcul the mask position with numpy : 0.008571147918701172 nb_pixel_total : 5207 time to create 1 rle with old method : 0.006079673767089844 time for calcul the mask position with numpy : 0.008836030960083008 nb_pixel_total : 716 time to create 1 rle with old method : 0.0008375644683837891 time for calcul the mask position with numpy : 0.008589744567871094 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003590583801269531 time for calcul the mask position with numpy : 0.008465766906738281 nb_pixel_total : 9923 time to create 1 rle with old method : 0.010884523391723633 time for calcul the mask position with numpy : 0.008199214935302734 nb_pixel_total : 38 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.008197307586669922 nb_pixel_total : 2990 time to create 1 rle with old method : 0.003420591354370117 time for calcul the mask position with numpy : 0.008384466171264648 nb_pixel_total : 123 time to create 1 rle with old method : 0.00013685226440429688 time for calcul the mask position with numpy : 0.00839996337890625 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007278919219970703 time for calcul the mask position with numpy : 0.00955820083618164 nb_pixel_total : 3103 time to create 1 rle with old method : 0.0037932395935058594 time for calcul the mask position with numpy : 0.008446693420410156 nb_pixel_total : 36 time to create 1 rle with old method : 5.316734313964844e-05 time for calcul the mask position with numpy : 0.008466243743896484 nb_pixel_total : 811 time to create 1 rle with old method : 0.0009849071502685547 time for calcul the mask position with numpy : 0.00855708122253418 nb_pixel_total : 249 time to create 1 rle with old method : 0.00032019615173339844 time for calcul the mask position with numpy : 0.00873708724975586 nb_pixel_total : 2552 time to create 1 rle with old method : 0.0030083656311035156 time for calcul the mask position with numpy : 0.008452892303466797 nb_pixel_total : 6296 time to create 1 rle with old method : 0.007211446762084961 time for calcul the mask position with numpy : 0.008419990539550781 nb_pixel_total : 2109 time to create 1 rle with old method : 0.002447843551635742 time for calcul the mask position with numpy : 0.008495092391967773 nb_pixel_total : 87 time to create 1 rle with old method : 0.00018787384033203125 time for calcul the mask position with numpy : 0.00850367546081543 nb_pixel_total : 209 time to create 1 rle with old method : 0.00027179718017578125 time for calcul the mask position with numpy : 0.00854945182800293 nb_pixel_total : 1180 time to create 1 rle with old method : 0.0014569759368896484 time for calcul the mask position with numpy : 0.008672475814819336 nb_pixel_total : 38 time to create 1 rle with old method : 9.799003601074219e-05 time for calcul the mask position with numpy : 0.00856161117553711 nb_pixel_total : 1250 time to create 1 rle with old method : 0.0015082359313964844 time for calcul the mask position with numpy : 0.008447408676147461 nb_pixel_total : 2039 time to create 1 rle with old method : 0.0025510787963867188 time for calcul the mask position with numpy : 0.008507490158081055 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002799034118652344 time for calcul the mask position with numpy : 0.008571147918701172 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005536079406738281 time for calcul the mask position with numpy : 0.008524417877197266 nb_pixel_total : 170 time to create 1 rle with old method : 0.00021767616271972656 time for calcul the mask position with numpy : 0.008501052856445312 nb_pixel_total : 257 time to create 1 rle with old method : 0.00034117698669433594 time for calcul the mask position with numpy : 0.008931875228881836 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001323223114013672 time for calcul the mask position with numpy : 0.010335922241210938 nb_pixel_total : 105462 time to create 1 rle with old method : 0.1232759952545166 time for calcul the mask position with numpy : 0.008597135543823242 nb_pixel_total : 82 time to create 1 rle with old method : 0.00014448165893554688 time for calcul the mask position with numpy : 0.009804487228393555 nb_pixel_total : 85 time to create 1 rle with old method : 0.00014662742614746094 time for calcul the mask position with numpy : 0.008632898330688477 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006499290466308594 time for calcul the mask position with numpy : 0.008719921112060547 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001914501190185547 time for calcul the mask position with numpy : 0.008671760559082031 nb_pixel_total : 36819 time to create 1 rle with old method : 0.048358917236328125 time for calcul the mask position with numpy : 0.009148836135864258 nb_pixel_total : 177 time to create 1 rle with old method : 0.00022840499877929688 time for calcul the mask position with numpy : 0.008507251739501953 nb_pixel_total : 1375 time to create 1 rle with old method : 0.0015993118286132812 time for calcul the mask position with numpy : 0.008492708206176758 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002486705780029297 time for calcul the mask position with numpy : 0.008451700210571289 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001404285430908203 time for calcul the mask position with numpy : 0.008581876754760742 nb_pixel_total : 37997 time to create 1 rle with old method : 0.043131351470947266 time for calcul the mask position with numpy : 0.008494853973388672 nb_pixel_total : 509 time to create 1 rle with old method : 0.0005843639373779297 time for calcul the mask position with numpy : 0.008446693420410156 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004456043243408203 time for calcul the mask position with numpy : 0.008429527282714844 nb_pixel_total : 173 time to create 1 rle with old method : 0.00021338462829589844 time for calcul the mask position with numpy : 0.00851893424987793 nb_pixel_total : 322 time to create 1 rle with old method : 0.00038170814514160156 time for calcul the mask position with numpy : 0.008472681045532227 nb_pixel_total : 2972 time to create 1 rle with old method : 0.0034284591674804688 time for calcul the mask position with numpy : 0.008494377136230469 nb_pixel_total : 772 time to create 1 rle with old method : 0.0009090900421142578 time for calcul the mask position with numpy : 0.008445024490356445 nb_pixel_total : 792 time to create 1 rle with old method : 0.000982522964477539 time for calcul the mask position with numpy : 0.009225845336914062 nb_pixel_total : 149 time to create 1 rle with old method : 0.00036215782165527344 time for calcul the mask position with numpy : 0.00867605209350586 nb_pixel_total : 882 time to create 1 rle with old method : 0.001031637191772461 time for calcul the mask position with numpy : 0.008547067642211914 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006308555603027344 time for calcul the mask position with numpy : 0.008603334426879883 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.009443044662475586 nb_pixel_total : 15 time to create 1 rle with old method : 4.5299530029296875e-05 time for calcul the mask position with numpy : 0.009241342544555664 nb_pixel_total : 9005 time to create 1 rle with old method : 0.010449647903442383 time for calcul the mask position with numpy : 0.008614063262939453 nb_pixel_total : 27 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.00871419906616211 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004627704620361328 time for calcul the mask position with numpy : 0.008869647979736328 nb_pixel_total : 11 time to create 1 rle with old method : 3.0994415283203125e-05 time for calcul the mask position with numpy : 0.008722782135009766 nb_pixel_total : 386 time to create 1 rle with old method : 0.000461578369140625 time for calcul the mask position with numpy : 0.008739233016967773 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007810592651367188 time for calcul the mask position with numpy : 0.009358644485473633 nb_pixel_total : 452 time to create 1 rle with old method : 0.0007948875427246094 time for calcul the mask position with numpy : 0.009419679641723633 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003120899200439453 time for calcul the mask position with numpy : 0.008751869201660156 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005719661712646484 time for calcul the mask position with numpy : 0.008524179458618164 nb_pixel_total : 759 time to create 1 rle with old method : 0.0008871555328369141 time for calcul the mask position with numpy : 0.008457183837890625 nb_pixel_total : 169 time to create 1 rle with old method : 0.00019431114196777344 time for calcul the mask position with numpy : 0.008429288864135742 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002551078796386719 time for calcul the mask position with numpy : 0.00848078727722168 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0014379024505615234 time for calcul the mask position with numpy : 0.008457183837890625 nb_pixel_total : 304 time to create 1 rle with old method : 0.00036334991455078125 time for calcul the mask position with numpy : 0.008500337600708008 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004563331604003906 time for calcul the mask position with numpy : 0.008463144302368164 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005326271057128906 time for calcul the mask position with numpy : 0.008489608764648438 nb_pixel_total : 390 time to create 1 rle with old method : 0.00044918060302734375 time for calcul the mask position with numpy : 0.008757352828979492 nb_pixel_total : 255 time to create 1 rle with old method : 0.00033926963806152344 time for calcul the mask position with numpy : 0.008558273315429688 nb_pixel_total : 357 time to create 1 rle with old method : 0.00048661231994628906 time for calcul the mask position with numpy : 0.008499383926391602 nb_pixel_total : 83 time to create 1 rle with old method : 0.00010418891906738281 create new chi : 1.4546940326690674 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006510734558105469 batch 1 Loaded 96 chid ids of type : 4230 Number RLEs to save : 10289 TO DO : save crop sub photo not yet done ! save time : 0.6115286350250244 nb_obj : 89 nb_hashtags : 7 time to prepare the origin masks : 2.5809783935546875 time for calcul the mask position with numpy : 0.037459373474121094 nb_pixel_total : 1693133 time to create 1 rle with new method : 0.08563590049743652 time for calcul the mask position with numpy : 0.010794639587402344 nb_pixel_total : 109 time to create 1 rle with old method : 0.0002493858337402344 time for calcul the mask position with numpy : 0.011881351470947266 nb_pixel_total : 615 time to create 1 rle with old method : 0.0009121894836425781 time for calcul the mask position with numpy : 0.009412527084350586 nb_pixel_total : 885 time to create 1 rle with old method : 0.0012621879577636719 time for calcul the mask position with numpy : 0.015027523040771484 nb_pixel_total : 12 time to create 1 rle with old method : 4.863739013671875e-05 time for calcul the mask position with numpy : 0.013544082641601562 nb_pixel_total : 155 time to create 1 rle with old method : 0.000209808349609375 time for calcul the mask position with numpy : 0.012229681015014648 nb_pixel_total : 3008 time to create 1 rle with old method : 0.003999233245849609 time for calcul the mask position with numpy : 0.010776519775390625 nb_pixel_total : 104 time to create 1 rle with old method : 0.00023174285888671875 time for calcul the mask position with numpy : 0.0102386474609375 nb_pixel_total : 69 time to create 1 rle with old method : 0.00018072128295898438 time for calcul the mask position with numpy : 0.009512186050415039 nb_pixel_total : 352 time to create 1 rle with old method : 0.0006568431854248047 time for calcul the mask position with numpy : 0.008938074111938477 nb_pixel_total : 2640 time to create 1 rle with old method : 0.003267526626586914 time for calcul the mask position with numpy : 0.008173465728759766 nb_pixel_total : 1657 time to create 1 rle with old method : 0.001983642578125 time for calcul the mask position with numpy : 0.0078046321868896484 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004608631134033203 time for calcul the mask position with numpy : 0.009873628616333008 nb_pixel_total : 250 time to create 1 rle with old method : 0.00031948089599609375 time for calcul the mask position with numpy : 0.0101470947265625 nb_pixel_total : 339 time to create 1 rle with old method : 0.00043702125549316406 time for calcul the mask position with numpy : 0.009135246276855469 nb_pixel_total : 1103 time to create 1 rle with old method : 0.006979227066040039 time for calcul the mask position with numpy : 0.009699344635009766 nb_pixel_total : 741 time to create 1 rle with old method : 0.001058340072631836 time for calcul the mask position with numpy : 0.014335393905639648 nb_pixel_total : 373 time to create 1 rle with old method : 0.0006108283996582031 time for calcul the mask position with numpy : 0.012687444686889648 nb_pixel_total : 419 time to create 1 rle with old method : 0.0006306171417236328 time for calcul the mask position with numpy : 0.008548259735107422 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.007979154586791992 nb_pixel_total : 2999 time to create 1 rle with old method : 0.004358768463134766 time for calcul the mask position with numpy : 0.008629083633422852 nb_pixel_total : 79 time to create 1 rle with old method : 0.00015497207641601562 time for calcul the mask position with numpy : 0.007773637771606445 nb_pixel_total : 790 time to create 1 rle with old method : 0.0009367465972900391 time for calcul the mask position with numpy : 0.007267951965332031 nb_pixel_total : 523 time to create 1 rle with old method : 0.0006504058837890625 time for calcul the mask position with numpy : 0.010593652725219727 nb_pixel_total : 152354 time to create 1 rle with new method : 0.05510139465332031 time for calcul the mask position with numpy : 0.009369850158691406 nb_pixel_total : 736 time to create 1 rle with old method : 0.0009188652038574219 time for calcul the mask position with numpy : 0.012997627258300781 nb_pixel_total : 751 time to create 1 rle with old method : 0.0008985996246337891 time for calcul the mask position with numpy : 0.011389970779418945 nb_pixel_total : 90 time to create 1 rle with old method : 0.00015401840209960938 time for calcul the mask position with numpy : 0.013579607009887695 nb_pixel_total : 291 time to create 1 rle with old method : 0.00041294097900390625 time for calcul the mask position with numpy : 0.013643980026245117 nb_pixel_total : 73 time to create 1 rle with old method : 0.00018262863159179688 time for calcul the mask position with numpy : 0.013137102127075195 nb_pixel_total : 1271 time to create 1 rle with old method : 0.0015592575073242188 time for calcul the mask position with numpy : 0.012291908264160156 nb_pixel_total : 9116 time to create 1 rle with old method : 0.010969400405883789 time for calcul the mask position with numpy : 0.012105464935302734 nb_pixel_total : 221 time to create 1 rle with old method : 0.00041794776916503906 time for calcul the mask position with numpy : 0.01282501220703125 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0015447139739990234 time for calcul the mask position with numpy : 0.012637615203857422 nb_pixel_total : 5600 time to create 1 rle with old method : 0.006551027297973633 time for calcul the mask position with numpy : 0.010394811630249023 nb_pixel_total : 17865 time to create 1 rle with old method : 0.020385265350341797 time for calcul the mask position with numpy : 0.011108875274658203 nb_pixel_total : 901 time to create 1 rle with old method : 0.0011172294616699219 time for calcul the mask position with numpy : 0.011805057525634766 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001556873321533203 time for calcul the mask position with numpy : 0.012269973754882812 nb_pixel_total : 663 time to create 1 rle with old method : 0.0008237361907958984 time for calcul the mask position with numpy : 0.010707616806030273 nb_pixel_total : 1680 time to create 1 rle with old method : 0.002031087875366211 time for calcul the mask position with numpy : 0.010753154754638672 nb_pixel_total : 3242 time to create 1 rle with old method : 0.0038399696350097656 time for calcul the mask position with numpy : 0.011791467666625977 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0013196468353271484 time for calcul the mask position with numpy : 0.010854244232177734 nb_pixel_total : 47 time to create 1 rle with old method : 9.5367431640625e-05 time for calcul the mask position with numpy : 0.012499809265136719 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004565715789794922 time for calcul the mask position with numpy : 0.012393474578857422 nb_pixel_total : 2910 time to create 1 rle with old method : 0.003587961196899414 time for calcul the mask position with numpy : 0.010793447494506836 nb_pixel_total : 376 time to create 1 rle with old method : 0.0006585121154785156 time for calcul the mask position with numpy : 0.01084280014038086 nb_pixel_total : 15 time to create 1 rle with old method : 0.00010514259338378906 time for calcul the mask position with numpy : 0.010735750198364258 nb_pixel_total : 1824 time to create 1 rle with old method : 0.0021042823791503906 time for calcul the mask position with numpy : 0.011077165603637695 nb_pixel_total : 1202 time to create 1 rle with old method : 0.0014002323150634766 time for calcul the mask position with numpy : 0.010907173156738281 nb_pixel_total : 363 time to create 1 rle with old method : 0.00044226646423339844 time for calcul the mask position with numpy : 0.011137008666992188 nb_pixel_total : 5 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.010510683059692383 nb_pixel_total : 1241 time to create 1 rle with old method : 0.0015780925750732422 time for calcul the mask position with numpy : 0.010801076889038086 nb_pixel_total : 2241 time to create 1 rle with old method : 0.0026171207427978516 time for calcul the mask position with numpy : 0.010928630828857422 nb_pixel_total : 675 time to create 1 rle with old method : 0.0008132457733154297 time for calcul the mask position with numpy : 0.01087641716003418 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002372264862060547 time for calcul the mask position with numpy : 0.007693767547607422 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004284381866455078 time for calcul the mask position with numpy : 0.0074007511138916016 nb_pixel_total : 103956 time to create 1 rle with old method : 0.11900925636291504 time for calcul the mask position with numpy : 0.007203102111816406 nb_pixel_total : 133 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.0070765018463134766 nb_pixel_total : 126 time to create 1 rle with old method : 0.00019240379333496094 time for calcul the mask position with numpy : 0.007894515991210938 nb_pixel_total : 182 time to create 1 rle with old method : 0.00025653839111328125 time for calcul the mask position with numpy : 0.006960630416870117 nb_pixel_total : 101 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.006727933883666992 nb_pixel_total : 2508 time to create 1 rle with old method : 0.002903461456298828 time for calcul the mask position with numpy : 0.0068285465240478516 nb_pixel_total : 519 time to create 1 rle with old method : 0.0006194114685058594 time for calcul the mask position with numpy : 0.0067560672760009766 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004565715789794922 time for calcul the mask position with numpy : 0.0065610408782958984 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002808570861816406 time for calcul the mask position with numpy : 0.007026195526123047 nb_pixel_total : 32505 time to create 1 rle with old method : 0.03776955604553223 time for calcul the mask position with numpy : 0.007467985153198242 nb_pixel_total : 339 time to create 1 rle with old method : 0.0005888938903808594 time for calcul the mask position with numpy : 0.008946418762207031 nb_pixel_total : 664 time to create 1 rle with old method : 0.0007915496826171875 time for calcul the mask position with numpy : 0.0071468353271484375 nb_pixel_total : 3209 time to create 1 rle with old method : 0.0038695335388183594 time for calcul the mask position with numpy : 0.007556438446044922 nb_pixel_total : 758 time to create 1 rle with old method : 0.0010423660278320312 time for calcul the mask position with numpy : 0.007938146591186523 nb_pixel_total : 145 time to create 1 rle with old method : 0.00020956993103027344 time for calcul the mask position with numpy : 0.008657217025756836 nb_pixel_total : 543 time to create 1 rle with old method : 0.0010225772857666016 time for calcul the mask position with numpy : 0.008510828018188477 nb_pixel_total : 367 time to create 1 rle with old method : 0.0006983280181884766 time for calcul the mask position with numpy : 0.008444070816040039 nb_pixel_total : 149 time to create 1 rle with old method : 0.0003237724304199219 time for calcul the mask position with numpy : 0.00902247428894043 nb_pixel_total : 366 time to create 1 rle with old method : 0.0007145404815673828 time for calcul the mask position with numpy : 0.008574962615966797 nb_pixel_total : 324 time to create 1 rle with old method : 0.0006916522979736328 time for calcul the mask position with numpy : 0.008448123931884766 nb_pixel_total : 418 time to create 1 rle with old method : 0.0007407665252685547 time for calcul the mask position with numpy : 0.008943319320678711 nb_pixel_total : 655 time to create 1 rle with old method : 0.0012507438659667969 time for calcul the mask position with numpy : 0.00893855094909668 nb_pixel_total : 863 time to create 1 rle with old method : 0.0016891956329345703 time for calcul the mask position with numpy : 0.008358478546142578 nb_pixel_total : 433 time to create 1 rle with old method : 0.000812530517578125 time for calcul the mask position with numpy : 0.008039712905883789 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002295970916748047 time for calcul the mask position with numpy : 0.00796055793762207 nb_pixel_total : 207 time to create 1 rle with old method : 0.00027251243591308594 time for calcul the mask position with numpy : 0.008545160293579102 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0018813610076904297 time for calcul the mask position with numpy : 0.007789134979248047 nb_pixel_total : 26 time to create 1 rle with old method : 6.747245788574219e-05 time for calcul the mask position with numpy : 0.008052587509155273 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004792213439941406 time for calcul the mask position with numpy : 0.007956743240356445 nb_pixel_total : 310 time to create 1 rle with old method : 0.00038051605224609375 time for calcul the mask position with numpy : 0.0073282718658447266 nb_pixel_total : 277 time to create 1 rle with old method : 0.0005147457122802734 time for calcul the mask position with numpy : 0.008396148681640625 nb_pixel_total : 630 time to create 1 rle with old method : 0.00079345703125 time for calcul the mask position with numpy : 0.006949424743652344 nb_pixel_total : 59 time to create 1 rle with old method : 0.00011563301086425781 time for calcul the mask position with numpy : 0.007138729095458984 nb_pixel_total : 651 time to create 1 rle with old method : 0.0008361339569091797 create new chi : 1.32765793800354 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0021250247955322266 batch 1 Loaded 90 chid ids of type : 4230 Number RLEs to save : 9748 TO DO : save crop sub photo not yet done ! save time : 0.6167998313903809 nb_obj : 89 nb_hashtags : 8 time to prepare the origin masks : 1.6154136657714844 time for calcul the mask position with numpy : 0.02708578109741211 nb_pixel_total : 1704408 time to create 1 rle with new method : 0.06902241706848145 time for calcul the mask position with numpy : 0.007298707962036133 nb_pixel_total : 8463 time to create 1 rle with old method : 0.00990748405456543 time for calcul the mask position with numpy : 0.006938934326171875 nb_pixel_total : 494 time to create 1 rle with old method : 0.0006418228149414062 time for calcul the mask position with numpy : 0.006860971450805664 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003027915954589844 time for calcul the mask position with numpy : 0.006785392761230469 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002884864807128906 time for calcul the mask position with numpy : 0.006950855255126953 nb_pixel_total : 8 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.006985187530517578 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002734661102294922 time for calcul the mask position with numpy : 0.0066030025482177734 nb_pixel_total : 2828 time to create 1 rle with old method : 0.0032401084899902344 time for calcul the mask position with numpy : 0.006609201431274414 nb_pixel_total : 81 time to create 1 rle with old method : 0.0001227855682373047 time for calcul the mask position with numpy : 0.006574153900146484 nb_pixel_total : 714 time to create 1 rle with old method : 0.0008435249328613281 time for calcul the mask position with numpy : 0.006555080413818359 nb_pixel_total : 862 time to create 1 rle with old method : 0.0010421276092529297 time for calcul the mask position with numpy : 0.006522178649902344 nb_pixel_total : 1676 time to create 1 rle with old method : 0.0019931793212890625 time for calcul the mask position with numpy : 0.009405136108398438 nb_pixel_total : 165 time to create 1 rle with old method : 0.0003006458282470703 time for calcul the mask position with numpy : 0.00626826286315918 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001590251922607422 time for calcul the mask position with numpy : 0.006743192672729492 nb_pixel_total : 2905 time to create 1 rle with old method : 0.0052051544189453125 time for calcul the mask position with numpy : 0.007793903350830078 nb_pixel_total : 338 time to create 1 rle with old method : 0.0005218982696533203 time for calcul the mask position with numpy : 0.007127285003662109 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007817745208740234 time for calcul the mask position with numpy : 0.00762486457824707 nb_pixel_total : 361 time to create 1 rle with old method : 0.0007586479187011719 time for calcul the mask position with numpy : 0.00812220573425293 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005996227264404297 time for calcul the mask position with numpy : 0.0076601505279541016 nb_pixel_total : 2777 time to create 1 rle with old method : 0.003385782241821289 time for calcul the mask position with numpy : 0.006860256195068359 nb_pixel_total : 522 time to create 1 rle with old method : 0.0006299018859863281 time for calcul the mask position with numpy : 0.007765293121337891 nb_pixel_total : 153952 time to create 1 rle with new method : 0.03389787673950195 time for calcul the mask position with numpy : 0.007321596145629883 nb_pixel_total : 16396 time to create 1 rle with old method : 0.022077322006225586 time for calcul the mask position with numpy : 0.006673097610473633 nb_pixel_total : 9555 time to create 1 rle with old method : 0.011118650436401367 time for calcul the mask position with numpy : 0.007351398468017578 nb_pixel_total : 747 time to create 1 rle with old method : 0.0008962154388427734 time for calcul the mask position with numpy : 0.0072667598724365234 nb_pixel_total : 23 time to create 1 rle with old method : 9.083747863769531e-05 time for calcul the mask position with numpy : 0.007722377777099609 nb_pixel_total : 792 time to create 1 rle with old method : 0.0009267330169677734 time for calcul the mask position with numpy : 0.0071790218353271484 nb_pixel_total : 241 time to create 1 rle with old method : 0.00031113624572753906 time for calcul the mask position with numpy : 0.00791478157043457 nb_pixel_total : 1269 time to create 1 rle with old method : 0.002528667449951172 time for calcul the mask position with numpy : 0.008398056030273438 nb_pixel_total : 55 time to create 1 rle with old method : 9.989738464355469e-05 time for calcul the mask position with numpy : 0.0064203739166259766 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005855560302734375 time for calcul the mask position with numpy : 0.0068247318267822266 nb_pixel_total : 9236 time to create 1 rle with old method : 0.010778427124023438 time for calcul the mask position with numpy : 0.007073402404785156 nb_pixel_total : 6150 time to create 1 rle with old method : 0.0077877044677734375 time for calcul the mask position with numpy : 0.007002353668212891 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005638599395751953 time for calcul the mask position with numpy : 0.007300138473510742 nb_pixel_total : 91 time to create 1 rle with old method : 0.00014925003051757812 time for calcul the mask position with numpy : 0.007221221923828125 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005743503570556641 time for calcul the mask position with numpy : 0.008263826370239258 nb_pixel_total : 686 time to create 1 rle with old method : 0.0009322166442871094 time for calcul the mask position with numpy : 0.007081747055053711 nb_pixel_total : 2181 time to create 1 rle with old method : 0.0027344226837158203 time for calcul the mask position with numpy : 0.007306814193725586 nb_pixel_total : 1049 time to create 1 rle with old method : 0.0013098716735839844 time for calcul the mask position with numpy : 0.00752568244934082 nb_pixel_total : 3688 time to create 1 rle with old method : 0.007678031921386719 time for calcul the mask position with numpy : 0.0078887939453125 nb_pixel_total : 427 time to create 1 rle with old method : 0.0007605552673339844 time for calcul the mask position with numpy : 0.00698089599609375 nb_pixel_total : 1121 time to create 1 rle with old method : 0.0019042491912841797 time for calcul the mask position with numpy : 0.007599592208862305 nb_pixel_total : 253 time to create 1 rle with old method : 0.00044918060302734375 time for calcul the mask position with numpy : 0.006673097610473633 nb_pixel_total : 496 time to create 1 rle with old method : 0.0010178089141845703 time for calcul the mask position with numpy : 0.006975889205932617 nb_pixel_total : 56 time to create 1 rle with old method : 0.0001964569091796875 time for calcul the mask position with numpy : 0.007017850875854492 nb_pixel_total : 2749 time to create 1 rle with old method : 0.00458979606628418 time for calcul the mask position with numpy : 0.007080078125 nb_pixel_total : 418 time to create 1 rle with old method : 0.0007307529449462891 time for calcul the mask position with numpy : 0.0069942474365234375 nb_pixel_total : 1465 time to create 1 rle with old method : 0.002490997314453125 time for calcul the mask position with numpy : 0.011731624603271484 nb_pixel_total : 1248 time to create 1 rle with old method : 0.002012491226196289 time for calcul the mask position with numpy : 0.008622169494628906 nb_pixel_total : 2221 time to create 1 rle with old method : 0.0037636756896972656 time for calcul the mask position with numpy : 0.009411096572875977 nb_pixel_total : 2119 time to create 1 rle with old method : 0.009052515029907227 time for calcul the mask position with numpy : 0.0067827701568603516 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005228519439697266 time for calcul the mask position with numpy : 0.006916999816894531 nb_pixel_total : 192 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.007025718688964844 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003337860107421875 time for calcul the mask position with numpy : 0.007070302963256836 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002911090850830078 time for calcul the mask position with numpy : 0.007997512817382812 nb_pixel_total : 104786 time to create 1 rle with old method : 0.1882157325744629 time for calcul the mask position with numpy : 0.007126331329345703 nb_pixel_total : 757 time to create 1 rle with old method : 0.0009686946868896484 time for calcul the mask position with numpy : 0.007586956024169922 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009186267852783203 time for calcul the mask position with numpy : 0.007476806640625 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001652240753173828 time for calcul the mask position with numpy : 0.007299184799194336 nb_pixel_total : 370 time to create 1 rle with old method : 0.00048804283142089844 time for calcul the mask position with numpy : 0.00958561897277832 nb_pixel_total : 372 time to create 1 rle with old method : 0.00046515464782714844 time for calcul the mask position with numpy : 0.008150339126586914 nb_pixel_total : 159 time to create 1 rle with old method : 0.0003566741943359375 time for calcul the mask position with numpy : 0.007372140884399414 nb_pixel_total : 269 time to create 1 rle with old method : 0.00034737586975097656 time for calcul the mask position with numpy : 0.007128238677978516 nb_pixel_total : 645 time to create 1 rle with old method : 0.0008666515350341797 time for calcul the mask position with numpy : 0.009640693664550781 nb_pixel_total : 3111 time to create 1 rle with old method : 0.0037517547607421875 time for calcul the mask position with numpy : 0.0075681209564208984 nb_pixel_total : 309 time to create 1 rle with old method : 0.00041031837463378906 time for calcul the mask position with numpy : 0.007061481475830078 nb_pixel_total : 229 time to create 1 rle with old method : 0.00033736228942871094 time for calcul the mask position with numpy : 0.00775909423828125 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0015919208526611328 time for calcul the mask position with numpy : 0.006862163543701172 nb_pixel_total : 745 time to create 1 rle with old method : 0.0009949207305908203 time for calcul the mask position with numpy : 0.0071909427642822266 nb_pixel_total : 1472 time to create 1 rle with old method : 0.001880645751953125 time for calcul the mask position with numpy : 0.007794380187988281 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002148151397705078 time for calcul the mask position with numpy : 0.006888866424560547 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006470680236816406 time for calcul the mask position with numpy : 0.007056236267089844 nb_pixel_total : 23 time to create 1 rle with old method : 8.535385131835938e-05 time for calcul the mask position with numpy : 0.006761074066162109 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004458427429199219 time for calcul the mask position with numpy : 0.006920814514160156 nb_pixel_total : 254 time to create 1 rle with old method : 0.00035691261291503906 time for calcul the mask position with numpy : 0.00695037841796875 nb_pixel_total : 327 time to create 1 rle with old method : 0.00040030479431152344 time for calcul the mask position with numpy : 0.006877422332763672 nb_pixel_total : 164 time to create 1 rle with old method : 0.00030350685119628906 time for calcul the mask position with numpy : 0.007078647613525391 nb_pixel_total : 699 time to create 1 rle with old method : 0.0008280277252197266 time for calcul the mask position with numpy : 0.006676912307739258 nb_pixel_total : 916 time to create 1 rle with old method : 0.0011119842529296875 time for calcul the mask position with numpy : 0.006703615188598633 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007884502410888672 time for calcul the mask position with numpy : 0.006769418716430664 nb_pixel_total : 571 time to create 1 rle with old method : 0.0007288455963134766 time for calcul the mask position with numpy : 0.00703120231628418 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002894401550292969 time for calcul the mask position with numpy : 0.009975671768188477 nb_pixel_total : 1147 time to create 1 rle with old method : 0.0014958381652832031 time for calcul the mask position with numpy : 0.007135152816772461 nb_pixel_total : 288 time to create 1 rle with old method : 0.0005784034729003906 time for calcul the mask position with numpy : 0.006865739822387695 nb_pixel_total : 1297 time to create 1 rle with old method : 0.0016071796417236328 time for calcul the mask position with numpy : 0.006709575653076172 nb_pixel_total : 23 time to create 1 rle with old method : 8.130073547363281e-05 time for calcul the mask position with numpy : 0.007590770721435547 nb_pixel_total : 331 time to create 1 rle with old method : 0.000457763671875 time for calcul the mask position with numpy : 0.010921239852905273 nb_pixel_total : 11 time to create 1 rle with old method : 6.771087646484375e-05 time for calcul the mask position with numpy : 0.006994724273681641 nb_pixel_total : 800 time to create 1 rle with old method : 0.0009810924530029297 time for calcul the mask position with numpy : 0.0069544315338134766 nb_pixel_total : 120 time to create 1 rle with old method : 0.00016880035400390625 create new chi : 1.1375479698181152 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0018703937530517578 batch 1 Loaded 90 chid ids of type : 4230 Number RLEs to save : 9972 TO DO : save crop sub photo not yet done ! save time : 1.2074038982391357 nb_obj : 82 nb_hashtags : 8 time to prepare the origin masks : 1.528423547744751 time for calcul the mask position with numpy : 0.025806903839111328 nb_pixel_total : 1704091 time to create 1 rle with new method : 0.06305336952209473 time for calcul the mask position with numpy : 0.006609916687011719 nb_pixel_total : 7409 time to create 1 rle with old method : 0.008801937103271484 time for calcul the mask position with numpy : 0.0068356990814208984 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003180503845214844 time for calcul the mask position with numpy : 0.006752967834472656 nb_pixel_total : 687 time to create 1 rle with old method : 0.0008463859558105469 time for calcul the mask position with numpy : 0.006791114807128906 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003306865692138672 time for calcul the mask position with numpy : 0.007220029830932617 nb_pixel_total : 6 time to create 1 rle with old method : 7.05718994140625e-05 time for calcul the mask position with numpy : 0.0071048736572265625 nb_pixel_total : 154 time to create 1 rle with old method : 0.00022554397583007812 time for calcul the mask position with numpy : 0.007203340530395508 nb_pixel_total : 322 time to create 1 rle with old method : 0.00046062469482421875 time for calcul the mask position with numpy : 0.0073511600494384766 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006012916564941406 time for calcul the mask position with numpy : 0.007165670394897461 nb_pixel_total : 6 time to create 1 rle with old method : 3.4332275390625e-05 time for calcul the mask position with numpy : 0.007208824157714844 nb_pixel_total : 78 time to create 1 rle with old method : 0.00011992454528808594 time for calcul the mask position with numpy : 0.007050514221191406 nb_pixel_total : 2222 time to create 1 rle with old method : 0.002661466598510742 time for calcul the mask position with numpy : 0.007058858871459961 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007700920104980469 time for calcul the mask position with numpy : 0.007476806640625 nb_pixel_total : 1367 time to create 1 rle with old method : 0.0016138553619384766 time for calcul the mask position with numpy : 0.0075702667236328125 nb_pixel_total : 336 time to create 1 rle with old method : 0.000579833984375 time for calcul the mask position with numpy : 0.0072557926177978516 nb_pixel_total : 2174 time to create 1 rle with old method : 0.002597332000732422 time for calcul the mask position with numpy : 0.0070765018463134766 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003039836883544922 time for calcul the mask position with numpy : 0.007052898406982422 nb_pixel_total : 835 time to create 1 rle with old method : 0.0009958744049072266 time for calcul the mask position with numpy : 0.007257699966430664 nb_pixel_total : 944 time to create 1 rle with old method : 0.0011403560638427734 time for calcul the mask position with numpy : 0.0068280696868896484 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004298686981201172 time for calcul the mask position with numpy : 0.006855964660644531 nb_pixel_total : 689 time to create 1 rle with old method : 0.000827789306640625 time for calcul the mask position with numpy : 0.006985664367675781 nb_pixel_total : 307 time to create 1 rle with old method : 0.00038123130798339844 time for calcul the mask position with numpy : 0.0068972110748291016 nb_pixel_total : 380 time to create 1 rle with old method : 0.00047659873962402344 time for calcul the mask position with numpy : 0.007002592086791992 nb_pixel_total : 474 time to create 1 rle with old method : 0.000640869140625 time for calcul the mask position with numpy : 0.007383823394775391 nb_pixel_total : 1807 time to create 1 rle with old method : 0.0022308826446533203 time for calcul the mask position with numpy : 0.008188009262084961 nb_pixel_total : 527 time to create 1 rle with old method : 0.0008261203765869141 time for calcul the mask position with numpy : 0.01089930534362793 nb_pixel_total : 153000 time to create 1 rle with new method : 0.036203622817993164 time for calcul the mask position with numpy : 0.008115768432617188 nb_pixel_total : 724 time to create 1 rle with old method : 0.0011281967163085938 time for calcul the mask position with numpy : 0.008250713348388672 nb_pixel_total : 760 time to create 1 rle with old method : 0.00115966796875 time for calcul the mask position with numpy : 0.00783991813659668 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003783702850341797 time for calcul the mask position with numpy : 0.00807046890258789 nb_pixel_total : 54 time to create 1 rle with old method : 0.0001780986785888672 time for calcul the mask position with numpy : 0.009778976440429688 nb_pixel_total : 1254 time to create 1 rle with old method : 0.0019304752349853516 time for calcul the mask position with numpy : 0.009627342224121094 nb_pixel_total : 9646 time to create 1 rle with old method : 0.013889312744140625 time for calcul the mask position with numpy : 0.00896763801574707 nb_pixel_total : 497 time to create 1 rle with old method : 0.0009453296661376953 time for calcul the mask position with numpy : 0.008649587631225586 nb_pixel_total : 42 time to create 1 rle with old method : 0.0001518726348876953 time for calcul the mask position with numpy : 0.007692098617553711 nb_pixel_total : 6740 time to create 1 rle with old method : 0.011204242706298828 time for calcul the mask position with numpy : 0.007220268249511719 nb_pixel_total : 61 time to create 1 rle with old method : 0.0001728534698486328 time for calcul the mask position with numpy : 0.00742340087890625 nb_pixel_total : 629 time to create 1 rle with old method : 0.0013248920440673828 time for calcul the mask position with numpy : 0.007102489471435547 nb_pixel_total : 2660 time to create 1 rle with old method : 0.004579782485961914 time for calcul the mask position with numpy : 0.007221698760986328 nb_pixel_total : 3372 time to create 1 rle with old method : 0.00567173957824707 time for calcul the mask position with numpy : 0.007082462310791016 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007984638214111328 time for calcul the mask position with numpy : 0.006862640380859375 nb_pixel_total : 1133 time to create 1 rle with old method : 0.0014147758483886719 time for calcul the mask position with numpy : 0.0072879791259765625 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005211830139160156 time for calcul the mask position with numpy : 0.007452249526977539 nb_pixel_total : 2300 time to create 1 rle with old method : 0.0028696060180664062 time for calcul the mask position with numpy : 0.007260322570800781 nb_pixel_total : 1176 time to create 1 rle with old method : 0.0015413761138916016 time for calcul the mask position with numpy : 0.007407188415527344 nb_pixel_total : 334 time to create 1 rle with old method : 0.0004715919494628906 time for calcul the mask position with numpy : 0.0070536136627197266 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004055500030517578 time for calcul the mask position with numpy : 0.0075533390045166016 nb_pixel_total : 2193 time to create 1 rle with old method : 0.0031728744506835938 time for calcul the mask position with numpy : 0.0074825286865234375 nb_pixel_total : 703 time to create 1 rle with old method : 0.0008516311645507812 time for calcul the mask position with numpy : 0.007426738739013672 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005295276641845703 time for calcul the mask position with numpy : 0.00788569450378418 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005946159362792969 time for calcul the mask position with numpy : 0.008070945739746094 nb_pixel_total : 164 time to create 1 rle with old method : 0.00022983551025390625 time for calcul the mask position with numpy : 0.008093595504760742 nb_pixel_total : 103477 time to create 1 rle with old method : 0.11806821823120117 time for calcul the mask position with numpy : 0.0070760250091552734 nb_pixel_total : 127 time to create 1 rle with old method : 0.0001773834228515625 time for calcul the mask position with numpy : 0.0063934326171875 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002486705780029297 time for calcul the mask position with numpy : 0.006647348403930664 nb_pixel_total : 35868 time to create 1 rle with old method : 0.04840087890625 time for calcul the mask position with numpy : 0.007609367370605469 nb_pixel_total : 109 time to create 1 rle with old method : 0.0002353191375732422 time for calcul the mask position with numpy : 0.0073909759521484375 nb_pixel_total : 503 time to create 1 rle with old method : 0.0008540153503417969 time for calcul the mask position with numpy : 0.007138252258300781 nb_pixel_total : 311 time to create 1 rle with old method : 0.0005650520324707031 time for calcul the mask position with numpy : 0.007572174072265625 nb_pixel_total : 106 time to create 1 rle with old method : 0.00022673606872558594 time for calcul the mask position with numpy : 0.007523298263549805 nb_pixel_total : 283 time to create 1 rle with old method : 0.0005350112915039062 time for calcul the mask position with numpy : 0.008276700973510742 nb_pixel_total : 671 time to create 1 rle with old method : 0.0011720657348632812 time for calcul the mask position with numpy : 0.007949590682983398 nb_pixel_total : 2945 time to create 1 rle with old method : 0.0033915042877197266 time for calcul the mask position with numpy : 0.0074405670166015625 nb_pixel_total : 1390 time to create 1 rle with old method : 0.001680135726928711 time for calcul the mask position with numpy : 0.0067670345306396484 nb_pixel_total : 745 time to create 1 rle with old method : 0.0009205341339111328 time for calcul the mask position with numpy : 0.0070073604583740234 nb_pixel_total : 2423 time to create 1 rle with old method : 0.002892732620239258 time for calcul the mask position with numpy : 0.006879091262817383 nb_pixel_total : 781 time to create 1 rle with old method : 0.0009398460388183594 time for calcul the mask position with numpy : 0.006863117218017578 nb_pixel_total : 147 time to create 1 rle with old method : 0.00020456314086914062 time for calcul the mask position with numpy : 0.006791114807128906 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006289482116699219 time for calcul the mask position with numpy : 0.006975650787353516 nb_pixel_total : 342 time to create 1 rle with old method : 0.00043392181396484375 time for calcul the mask position with numpy : 0.006758213043212891 nb_pixel_total : 119 time to create 1 rle with old method : 0.00017595291137695312 time for calcul the mask position with numpy : 0.0067784786224365234 nb_pixel_total : 575 time to create 1 rle with old method : 0.0008709430694580078 time for calcul the mask position with numpy : 0.007776021957397461 nb_pixel_total : 285 time to create 1 rle with old method : 0.0004832744598388672 time for calcul the mask position with numpy : 0.006845712661743164 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005528926849365234 time for calcul the mask position with numpy : 0.0074083805084228516 nb_pixel_total : 447 time to create 1 rle with old method : 0.0006723403930664062 time for calcul the mask position with numpy : 0.0067141056060791016 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0012106895446777344 time for calcul the mask position with numpy : 0.006842851638793945 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005795955657958984 time for calcul the mask position with numpy : 0.011468648910522461 nb_pixel_total : 136 time to create 1 rle with old method : 0.00020313262939453125 time for calcul the mask position with numpy : 0.00774693489074707 nb_pixel_total : 1265 time to create 1 rle with old method : 0.0015063285827636719 time for calcul the mask position with numpy : 0.008084535598754883 nb_pixel_total : 293 time to create 1 rle with old method : 0.0003886222839355469 time for calcul the mask position with numpy : 0.008596658706665039 nb_pixel_total : 541 time to create 1 rle with old method : 0.0011515617370605469 time for calcul the mask position with numpy : 0.007961034774780273 nb_pixel_total : 131 time to create 1 rle with old method : 0.00020933151245117188 time for calcul the mask position with numpy : 0.007827520370483398 nb_pixel_total : 223 time to create 1 rle with old method : 0.0004513263702392578 create new chi : 1.0186967849731445 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0024480819702148438 batch 1 Loaded 83 chid ids of type : 4230 Number RLEs to save : 9167 TO DO : save crop sub photo not yet done ! save time : 0.5522747039794922 nb_obj : 86 nb_hashtags : 8 time to prepare the origin masks : 1.612043857574463 time for calcul the mask position with numpy : 0.1065223217010498 nb_pixel_total : 1711927 time to create 1 rle with new method : 0.17323088645935059 time for calcul the mask position with numpy : 0.008866310119628906 nb_pixel_total : 7842 time to create 1 rle with old method : 0.009569644927978516 time for calcul the mask position with numpy : 0.007430315017700195 nb_pixel_total : 289 time to create 1 rle with old method : 0.0004208087921142578 time for calcul the mask position with numpy : 0.0077784061431884766 nb_pixel_total : 17 time to create 1 rle with old method : 7.271766662597656e-05 time for calcul the mask position with numpy : 0.007352352142333984 nb_pixel_total : 81 time to create 1 rle with old method : 0.00014734268188476562 time for calcul the mask position with numpy : 0.011836767196655273 nb_pixel_total : 943 time to create 1 rle with old method : 0.0016970634460449219 time for calcul the mask position with numpy : 0.01197957992553711 nb_pixel_total : 12 time to create 1 rle with old method : 7.43865966796875e-05 time for calcul the mask position with numpy : 0.011977910995483398 nb_pixel_total : 39 time to create 1 rle with old method : 8.726119995117188e-05 time for calcul the mask position with numpy : 0.011385440826416016 nb_pixel_total : 752 time to create 1 rle with old method : 0.0009558200836181641 time for calcul the mask position with numpy : 0.011310338973999023 nb_pixel_total : 101 time to create 1 rle with old method : 0.00016117095947265625 time for calcul the mask position with numpy : 0.01127934455871582 nb_pixel_total : 121 time to create 1 rle with old method : 0.00019502639770507812 time for calcul the mask position with numpy : 0.010984182357788086 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005049705505371094 time for calcul the mask position with numpy : 0.011227130889892578 nb_pixel_total : 2677 time to create 1 rle with old method : 0.003086566925048828 time for calcul the mask position with numpy : 0.00684046745300293 nb_pixel_total : 75 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.006814002990722656 nb_pixel_total : 339 time to create 1 rle with old method : 0.00042748451232910156 time for calcul the mask position with numpy : 0.006966590881347656 nb_pixel_total : 1540 time to create 1 rle with old method : 0.0022509098052978516 time for calcul the mask position with numpy : 0.007022857666015625 nb_pixel_total : 198 time to create 1 rle with old method : 0.000286102294921875 time for calcul the mask position with numpy : 0.006911277770996094 nb_pixel_total : 777 time to create 1 rle with old method : 0.0009529590606689453 time for calcul the mask position with numpy : 0.006927490234375 nb_pixel_total : 211 time to create 1 rle with old method : 0.00028204917907714844 time for calcul the mask position with numpy : 0.011254072189331055 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004334449768066406 time for calcul the mask position with numpy : 0.011182069778442383 nb_pixel_total : 304 time to create 1 rle with old method : 0.0003991127014160156 time for calcul the mask position with numpy : 0.011220455169677734 nb_pixel_total : 274 time to create 1 rle with old method : 0.00035452842712402344 time for calcul the mask position with numpy : 0.011095285415649414 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004019737243652344 time for calcul the mask position with numpy : 0.010949134826660156 nb_pixel_total : 370 time to create 1 rle with old method : 0.00045609474182128906 time for calcul the mask position with numpy : 0.01120305061340332 nb_pixel_total : 52 time to create 1 rle with old method : 8.869171142578125e-05 time for calcul the mask position with numpy : 0.012148141860961914 nb_pixel_total : 508 time to create 1 rle with old method : 0.000614166259765625 time for calcul the mask position with numpy : 0.013737678527832031 nb_pixel_total : 153521 time to create 1 rle with new method : 0.1924753189086914 time for calcul the mask position with numpy : 0.011269092559814453 nb_pixel_total : 704 time to create 1 rle with old method : 0.0009546279907226562 time for calcul the mask position with numpy : 0.01165628433227539 nb_pixel_total : 750 time to create 1 rle with old method : 0.0009050369262695312 time for calcul the mask position with numpy : 0.012883186340332031 nb_pixel_total : 1238 time to create 1 rle with old method : 0.001828908920288086 time for calcul the mask position with numpy : 0.012115240097045898 nb_pixel_total : 47 time to create 1 rle with old method : 0.0001418590545654297 time for calcul the mask position with numpy : 0.012212753295898438 nb_pixel_total : 9703 time to create 1 rle with old method : 0.01623058319091797 time for calcul the mask position with numpy : 0.012066364288330078 nb_pixel_total : 401 time to create 1 rle with old method : 0.0007090568542480469 time for calcul the mask position with numpy : 0.014018058776855469 nb_pixel_total : 132 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.013692617416381836 nb_pixel_total : 5905 time to create 1 rle with old method : 0.008135318756103516 time for calcul the mask position with numpy : 0.012285470962524414 nb_pixel_total : 732 time to create 1 rle with old method : 0.0009224414825439453 time for calcul the mask position with numpy : 0.012391805648803711 nb_pixel_total : 18 time to create 1 rle with old method : 8.177757263183594e-05 time for calcul the mask position with numpy : 0.012610912322998047 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005431175231933594 time for calcul the mask position with numpy : 0.012932300567626953 nb_pixel_total : 2157 time to create 1 rle with old method : 0.002635478973388672 time for calcul the mask position with numpy : 0.01362752914428711 nb_pixel_total : 3461 time to create 1 rle with old method : 0.004130363464355469 time for calcul the mask position with numpy : 0.013016700744628906 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0013608932495117188 time for calcul the mask position with numpy : 0.016603946685791016 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005495548248291016 time for calcul the mask position with numpy : 0.013286113739013672 nb_pixel_total : 1688 time to create 1 rle with old method : 0.002092599868774414 time for calcul the mask position with numpy : 0.013543367385864258 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0014667510986328125 time for calcul the mask position with numpy : 0.013509035110473633 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0014884471893310547 time for calcul the mask position with numpy : 0.013199806213378906 nb_pixel_total : 2122 time to create 1 rle with old method : 0.0026073455810546875 time for calcul the mask position with numpy : 0.013875484466552734 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004801750183105469 time for calcul the mask position with numpy : 0.013944387435913086 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002627372741699219 time for calcul the mask position with numpy : 0.013078927993774414 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006737709045410156 time for calcul the mask position with numpy : 0.013868570327758789 nb_pixel_total : 105156 time to create 1 rle with old method : 0.15574216842651367 time for calcul the mask position with numpy : 0.013097047805786133 nb_pixel_total : 124 time to create 1 rle with old method : 0.0003390312194824219 time for calcul the mask position with numpy : 0.013224363327026367 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002090930938720703 time for calcul the mask position with numpy : 0.013891220092773438 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006415843963623047 time for calcul the mask position with numpy : 0.013333797454833984 nb_pixel_total : 45 time to create 1 rle with old method : 0.0001289844512939453 time for calcul the mask position with numpy : 0.014359474182128906 nb_pixel_total : 324 time to create 1 rle with old method : 0.0005469322204589844 time for calcul the mask position with numpy : 0.013489961624145508 nb_pixel_total : 124 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.013460397720336914 nb_pixel_total : 33276 time to create 1 rle with old method : 0.03848743438720703 time for calcul the mask position with numpy : 0.013672113418579102 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003609657287597656 time for calcul the mask position with numpy : 0.013003826141357422 nb_pixel_total : 620 time to create 1 rle with old method : 0.0007576942443847656 time for calcul the mask position with numpy : 0.013502120971679688 nb_pixel_total : 3013 time to create 1 rle with old method : 0.003580331802368164 time for calcul the mask position with numpy : 0.012387990951538086 nb_pixel_total : 260 time to create 1 rle with old method : 0.00035071372985839844 time for calcul the mask position with numpy : 0.01235342025756836 nb_pixel_total : 1340 time to create 1 rle with old method : 0.0016994476318359375 time for calcul the mask position with numpy : 0.012148857116699219 nb_pixel_total : 36 time to create 1 rle with old method : 0.00010848045349121094 time for calcul the mask position with numpy : 0.012482643127441406 nb_pixel_total : 715 time to create 1 rle with old method : 0.0008814334869384766 time for calcul the mask position with numpy : 0.012517213821411133 nb_pixel_total : 1332 time to create 1 rle with old method : 0.0016694068908691406 time for calcul the mask position with numpy : 0.015066385269165039 nb_pixel_total : 826 time to create 1 rle with old method : 0.0009868144989013672 time for calcul the mask position with numpy : 0.012586593627929688 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002124309539794922 time for calcul the mask position with numpy : 0.013414621353149414 nb_pixel_total : 526 time to create 1 rle with old method : 0.0006420612335205078 time for calcul the mask position with numpy : 0.01079559326171875 nb_pixel_total : 4 time to create 1 rle with old method : 3.8623809814453125e-05 time for calcul the mask position with numpy : 0.008548736572265625 nb_pixel_total : 372 time to create 1 rle with old method : 0.0004467964172363281 time for calcul the mask position with numpy : 0.008455038070678711 nb_pixel_total : 10 time to create 1 rle with old method : 2.9802322387695312e-05 time for calcul the mask position with numpy : 0.00847005844116211 nb_pixel_total : 180 time to create 1 rle with old method : 0.00023317337036132812 time for calcul the mask position with numpy : 0.008487224578857422 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005276203155517578 time for calcul the mask position with numpy : 0.008538484573364258 nb_pixel_total : 270 time to create 1 rle with old method : 0.00033211708068847656 time for calcul the mask position with numpy : 0.008542776107788086 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005521774291992188 time for calcul the mask position with numpy : 0.00885629653930664 nb_pixel_total : 34 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.00892329216003418 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006697177886962891 time for calcul the mask position with numpy : 0.008696317672729492 nb_pixel_total : 930 time to create 1 rle with old method : 0.0011250972747802734 time for calcul the mask position with numpy : 0.008643150329589844 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005676746368408203 time for calcul the mask position with numpy : 0.008547306060791016 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002200603485107422 time for calcul the mask position with numpy : 0.012912511825561523 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003077983856201172 time for calcul the mask position with numpy : 0.00863957405090332 nb_pixel_total : 225 time to create 1 rle with old method : 0.00030231475830078125 time for calcul the mask position with numpy : 0.00873875617980957 nb_pixel_total : 1196 time to create 1 rle with old method : 0.0014672279357910156 time for calcul the mask position with numpy : 0.00890660285949707 nb_pixel_total : 313 time to create 1 rle with old method : 0.0011272430419921875 time for calcul the mask position with numpy : 0.010639667510986328 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003600120544433594 time for calcul the mask position with numpy : 0.008554458618164062 nb_pixel_total : 12 time to create 1 rle with old method : 4.9114227294921875e-05 time for calcul the mask position with numpy : 0.009748697280883789 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005292892456054688 create new chi : 1.7476816177368164 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0030994415283203125 batch 1 Loaded 87 chid ids of type : 4230 Number RLEs to save : 8893 TO DO : save crop sub photo not yet done ! save time : 0.5802578926086426 map_output_result : {1341310788: (0.0, 'Should be the crop_list due to order', 0.0), 1341310785: (0.0, 'Should be the crop_list due to order', 0.0), 1341310782: (0.0, 'Should be the crop_list due to order', 0.0), 1341310779: (0.0, 'Should be the crop_list due to order', 0.0), 1341310777: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1341310788, 1341310785, 1341310782, 1341310779, 1341310777] Looping around the photos to save general results len do output : 5 /1341310788.Didn't retrieve data . /1341310785.Didn't retrieve data . /1341310782.Didn't retrieve data . /1341310779.Didn't retrieve data . /1341310777.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310788', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310785', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310782', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310779', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310777', None, None, None, None, None, '2645987') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.452211856842041 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.567216396331787 time spend to save output : 0.45302319526672363 total time spend for step 4 : 20.02023959159851 step5:crop_condition Thu Mar 6 22:21:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 446 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 177 About to insert : list_path_to_insert length 177 new photo from crops ! About to upload 177 photos upload in portfolio : 4869462 init cache_photo without model_param we have 177 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741296098_3856831 we have uploaded 177 photos in the portfolio 4869462 time of upload the photos Elapsed time : 63.734089851379395 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 4869462 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741296162_3856831 we have uploaded 37 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.528260231018066 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741296175_3856831 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7402620315551758 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 4869462 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741296176_3856831 we have uploaded 18 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.119445562362671 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 73 About to insert : list_path_to_insert length 73 new photo from crops ! About to upload 73 photos upload in portfolio : 4869462 init cache_photo without model_param we have 73 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741296184_3856831 we have uploaded 73 photos in the portfolio 4869462 time of upload the photos Elapsed time : 21.241912126541138 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4869462 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741296205_3856831 we have uploaded 5 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.0239226818084717 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741296207_3856831 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5660409927368164 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1341310788, 1341310785, 1341310782, 1341310779, 1341310777] Looping around the photos to save general results len do output : 313 /1341317107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341317508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310788', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310785', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310782', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310779', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310777', None, None, None, None, None, '2645987') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 944 time used for this insertion : 0.05513787269592285 save_final save missing photos in datou_result : time spend for datou_step_exec : 114.54325914382935 time spend to save output : 0.0672447681427002 total time spend for step 5 : 114.61050391197205 step6:thcl Thu Mar 6 22:23:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.013990640640258789 time to convert the images to numpy array : 0.07708144187927246 time to import caffe and check if the image exist : 0.02363133430480957 time to convert the images to numpy array : 0.10404372215270996 time to import caffe and check if the image exist : 0.025187969207763672 time to convert the images to numpy array : 0.1037452220916748 time to import caffe and check if the image exist : 0.021822452545166016 time to convert the images to numpy array : 0.10757708549499512 time to import caffe and check if the image exist : 0.0218813419342041 time to convert the images to numpy array : 0.10892820358276367 time to import caffe and check if the image exist : 0.01846933364868164 time to convert the images to numpy array : 0.11594510078430176 time to import caffe and check if the image exist : 0.020597457885742188 time to convert the images to numpy array : 0.11474728584289551 time to import caffe and check if the image exist : 0.02350640296936035 time to convert the images to numpy array : 0.11118412017822266 time to import caffe and check if the image exist : 0.020312070846557617 time to convert the images to numpy array : 0.11531949043273926 time to import caffe and check if the image exist : 0.018248319625854492 time to convert the images to numpy array : 0.11783337593078613 total time to convert the images to numpy array : 0.4778149127960205 list photo_ids error: [] list photo_ids correct : [1341317473, 1341317474, 1341317475, 1341317476, 1341317477, 1341317478, 1341317479, 1341317480, 1341317481, 1341317482, 1341317483, 1341317484, 1341317485, 1341317486, 1341317487, 1341317488, 1341317489, 1341317490, 1341317491, 1341317501, 1341317502, 1341317503, 1341317504, 1341317505, 1341317508, 1341317146, 1341317147, 1341317148, 1341317149, 1341317150, 1341317151, 1341317152, 1341317153, 1341317154, 1341317155, 1341317157, 1341317158, 1341317159, 1341317160, 1341317161, 1341317162, 1341317163, 1341317164, 1341317165, 1341317166, 1341317167, 1341317168, 1341317169, 1341317170, 1341317171, 1341317172, 1341317173, 1341317174, 1341317175, 1341317176, 1341317177, 1341317179, 1341317217, 1341317219, 1341317220, 1341317222, 1341317223, 1341317224, 1341317225, 1341317226, 1341317227, 1341317228, 1341317229, 1341317230, 1341317231, 1341317232, 1341317233, 1341317234, 1341317235, 1341317236, 1341317237, 1341317238, 1341317239, 1341317240, 1341317241, 1341317242, 1341317243, 1341317244, 1341317245, 1341317246, 1341317249, 1341317250, 1341317253, 1341317255, 1341317256, 1341317257, 1341317258, 1341317259, 1341317260, 1341317261, 1341317262, 1341317263, 1341317264, 1341317265, 1341317266, 1341317267, 1341317268, 1341317269, 1341317270, 1341317271, 1341317272, 1341317273, 1341317274, 1341317275, 1341317276, 1341317277, 1341317278, 1341317279, 1341317280, 1341317281, 1341317282, 1341317283, 1341317284, 1341317285, 1341317286, 1341317287, 1341317288, 1341317289, 1341317290, 1341317291, 1341317292, 1341317293, 1341317294, 1341317295, 1341317296, 1341317297, 1341317298, 1341317299, 1341317300, 1341317301, 1341317302, 1341317303, 1341317304, 1341317319, 1341317320, 1341317321, 1341317322, 1341317323, 1341317324, 1341317325, 1341317326, 1341317327, 1341317328, 1341317329, 1341317330, 1341317331, 1341317332, 1341317333, 1341317378, 1341317379, 1341317380, 1341317381, 1341317382, 1341317383, 1341317384, 1341317385, 1341317386, 1341317387, 1341317415, 1341317416, 1341317417, 1341317418, 1341317419, 1341317420, 1341317421, 1341317422, 1341317423, 1341317424, 1341317425, 1341317426, 1341317427, 1341317428, 1341317431, 1341317432, 1341317434, 1341317435, 1341317437, 1341317438, 1341317439, 1341317440, 1341317107, 1341317108, 1341317109, 1341317110, 1341317111, 1341317112, 1341317113, 1341317114, 1341317116, 1341317120, 1341317121, 1341317122, 1341317125, 1341317126, 1341317127, 1341317128, 1341317129, 1341317130, 1341317131, 1341317132, 1341317133, 1341317134, 1341317135, 1341317136, 1341317137, 1341317138, 1341317140, 1341317141, 1341317142, 1341317143, 1341317144, 1341317145, 1341317441, 1341317442, 1341317443, 1341317444, 1341317445, 1341317446, 1341317447, 1341317448, 1341317449, 1341317450, 1341317451, 1341317452, 1341317453, 1341317454, 1341317455, 1341317456, 1341317457, 1341317458, 1341317459, 1341317460, 1341317461, 1341317462, 1341317463, 1341317464, 1341317465, 1341317466, 1341317467, 1341317468, 1341317469, 1341317470, 1341317471, 1341317472, 1341317334, 1341317335, 1341317336, 1341317337, 1341317338, 1341317339, 1341317340, 1341317341, 1341317342, 1341317343, 1341317344, 1341317345, 1341317346, 1341317347, 1341317348, 1341317349, 1341317350, 1341317351, 1341317352, 1341317353, 1341317355, 1341317356, 1341317357, 1341317358, 1341317370, 1341317371, 1341317372, 1341317373, 1341317374, 1341317375, 1341317376, 1341317377, 1341317180, 1341317181, 1341317182, 1341317183, 1341317186, 1341317187, 1341317188, 1341317189, 1341317190, 1341317191, 1341317192, 1341317193, 1341317194, 1341317195, 1341317196, 1341317198, 1341317201, 1341317202, 1341317203, 1341317204, 1341317205, 1341317206, 1341317207, 1341317208, 1341317209, 1341317210, 1341317211, 1341317212, 1341317213, 1341317214, 1341317215, 1341317216] number of photos to traite : 313 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10374 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.5931730270385742 time used to do the prediction : 1.2664611339569092 save descriptor for thcl : 3237 time to traite the descriptors : 1.8190505504608154 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1341317473 To insert : 1341317474 To insert : 1341317475 To insert : 1341317476 To insert : 1341317477 To insert : 1341317478 To insert : 1341317479 To insert : 1341317480 To insert : 1341317481 To insert : 1341317482 To insert : 1341317483 To insert : 1341317484 To insert : 1341317485 To insert : 1341317486 To insert : 1341317487 To insert : 1341317488 To insert : 1341317489 To insert : 1341317490 To insert : 1341317491 To insert : 1341317501 To insert : 1341317502 To insert : 1341317503 To insert : 1341317504 To insert : 1341317505 To insert : 1341317508 To insert : 1341317146 To insert : 1341317147 To insert : 1341317148 To insert : 1341317149 To insert : 1341317150 To insert : 1341317151 To insert : 1341317152 To insert : 1341317153 To insert : 1341317154 To insert : 1341317155 To insert : 1341317157 To insert : 1341317158 To insert : 1341317159 To insert : 1341317160 To insert : 1341317161 To insert : 1341317162 To insert : 1341317163 To insert : 1341317164 To insert : 1341317165 To insert : 1341317166 To insert : 1341317167 To insert : 1341317168 To insert : 1341317169 To insert : 1341317170 To insert : 1341317171 To insert : 1341317172 To insert : 1341317173 To insert : 1341317174 To insert : 1341317175 To insert : 1341317176 To insert : 1341317177 To insert : 1341317179 To insert : 1341317217 To insert : 1341317219 To insert : 1341317220 To insert : 1341317222 To insert : 1341317223 To insert : 1341317224 To insert : 1341317225 To insert : 1341317226 To insert : 1341317227 To insert : 1341317228 To insert : 1341317229 To insert : 1341317230 To insert : 1341317231 To insert : 1341317232 To insert : 1341317233 To insert : 1341317234 To insert : 1341317235 To insert : 1341317236 To insert : 1341317237 To insert : 1341317238 To insert : 1341317239 To insert : 1341317240 To insert : 1341317241 To insert : 1341317242 To insert : 1341317243 To insert : 1341317244 To insert : 1341317245 To insert : 1341317246 To insert : 1341317249 To insert : 1341317250 To insert : 1341317253 To insert : 1341317255 To insert : 1341317256 To insert : 1341317257 To insert : 1341317258 To insert : 1341317259 To insert : 1341317260 To insert : 1341317261 To insert : 1341317262 To insert : 1341317263 To insert : 1341317264 To insert : 1341317265 To insert : 1341317266 To insert : 1341317267 To insert : 1341317268 To insert : 1341317269 To insert : 1341317270 To insert : 1341317271 To insert : 1341317272 To insert : 1341317273 To insert : 1341317274 To insert : 1341317275 To insert : 1341317276 To insert : 1341317277 To insert : 1341317278 To insert : 1341317279 To insert : 1341317280 To insert : 1341317281 To insert : 1341317282 To insert : 1341317283 To insert : 1341317284 To insert : 1341317285 To insert : 1341317286 To insert : 1341317287 To insert : 1341317288 To insert : 1341317289 To insert : 1341317290 To insert : 1341317291 To insert : 1341317292 To insert : 1341317293 To insert : 1341317294 To insert : 1341317295 To insert : 1341317296 To insert : 1341317297 To insert : 1341317298 To insert : 1341317299 To insert : 1341317300 To insert : 1341317301 To insert : 1341317302 To insert : 1341317303 To insert : 1341317304 To insert : 1341317319 To insert : 1341317320 To insert : 1341317321 To insert : 1341317322 To insert : 1341317323 To insert : 1341317324 To insert : 1341317325 To insert : 1341317326 To insert : 1341317327 To insert : 1341317328 To insert : 1341317329 To insert : 1341317330 To insert : 1341317331 To insert : 1341317332 To insert : 1341317333 To insert : 1341317378 To insert : 1341317379 To insert : 1341317380 To insert : 1341317381 To insert : 1341317382 To insert : 1341317383 To insert : 1341317384 To insert : 1341317385 To insert : 1341317386 To insert : 1341317387 To insert : 1341317415 To insert : 1341317416 To insert : 1341317417 To insert : 1341317418 To insert : 1341317419 To insert : 1341317420 To insert : 1341317421 To insert : 1341317422 To insert : 1341317423 To insert : 1341317424 To insert : 1341317425 To insert : 1341317426 To insert : 1341317427 To insert : 1341317428 To insert : 1341317431 To insert : 1341317432 To insert : 1341317434 To insert : 1341317435 To insert : 1341317437 To insert : 1341317438 To insert : 1341317439 To insert : 1341317440 To insert : 1341317107 To insert : 1341317108 To insert : 1341317109 To insert : 1341317110 To insert : 1341317111 To insert : 1341317112 To insert : 1341317113 To insert : 1341317114 To insert : 1341317116 To insert : 1341317120 To insert : 1341317121 To insert : 1341317122 To insert : 1341317125 To insert : 1341317126 To insert : 1341317127 To insert : 1341317128 To insert : 1341317129 To insert : 1341317130 To insert : 1341317131 To insert : 1341317132 To insert : 1341317133 To insert : 1341317134 To insert : 1341317135 To insert : 1341317136 To insert : 1341317137 To insert : 1341317138 To insert : 1341317140 To insert : 1341317141 To insert : 1341317142 To insert : 1341317143 To insert : 1341317144 To insert : 1341317145 To insert : 1341317441 To insert : 1341317442 To insert : 1341317443 To insert : 1341317444 To insert : 1341317445 To insert : 1341317446 To insert : 1341317447 To insert : 1341317448 To insert : 1341317449 To insert : 1341317450 To insert : 1341317451 To insert : 1341317452 To insert : 1341317453 To insert : 1341317454 To insert : 1341317455 To insert : 1341317456 To insert : 1341317457 To insert : 1341317458 To insert : 1341317459 To insert : 1341317460 To insert : 1341317461 To insert : 1341317462 To insert : 1341317463 To insert : 1341317464 To insert : 1341317465 To insert : 1341317466 To insert : 1341317467 To insert : 1341317468 To insert : 1341317469 To insert : 1341317470 To insert : 1341317471 To insert : 1341317472 To insert : 1341317334 To insert : 1341317335 To insert : 1341317336 To insert : 1341317337 To insert : 1341317338 To insert : 1341317339 To insert : 1341317340 To insert : 1341317341 To insert : 1341317342 To insert : 1341317343 To insert : 1341317344 To insert : 1341317345 To insert : 1341317346 To insert : 1341317347 To insert : 1341317348 To insert : 1341317349 To insert : 1341317350 To insert : 1341317351 To insert : 1341317352 To insert : 1341317353 To insert : 1341317355 To insert : 1341317356 To insert : 1341317357 To insert : 1341317358 To insert : 1341317370 To insert : 1341317371 To insert : 1341317372 To insert : 1341317373 To insert : 1341317374 To insert : 1341317375 To insert : 1341317376 To insert : 1341317377 To insert : 1341317180 To insert : 1341317181 To insert : 1341317182 To insert : 1341317183 To insert : 1341317186 To insert : 1341317187 To insert : 1341317188 To insert : 1341317189 To insert : 1341317190 To insert : 1341317191 To insert : 1341317192 To insert : 1341317193 To insert : 1341317194 To insert : 1341317195 To insert : 1341317196 To insert : 1341317198 To insert : 1341317201 To insert : 1341317202 To insert : 1341317203 To insert : 1341317204 To insert : 1341317205 To insert : 1341317206 To insert : 1341317207 To insert : 1341317208 To insert : 1341317209 To insert : 1341317210 To insert : 1341317211 To insert : 1341317212 To insert : 1341317213 To insert : 1341317214 To insert : 1341317215 To insert : 1341317216 time to insert the descriptors : 72.29499244689941 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 484 time used for this insertion : 0.030659914016723633 save missing photos in datou_result : time spend for datou_step_exec : 84.2784469127655 time spend to save output : 0.19323301315307617 total time spend for step 6 : 84.47167992591858 step7:ventilate_hashtags_in_portfolio Thu Mar 6 22:24:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21129194 get user id for portfolio 21129194 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21129194 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Tetrapak','environnement','carton','PEHD','pet_fonce','Papier','pet_clair','PET_fonce','autre','Carton','Film_plastique','refus','PET_clair','flou','mal_croppe','papier','metal')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21129194 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Tetrapak','environnement','carton','PEHD','pet_fonce','Papier','pet_clair','PET_fonce','autre','Carton','Film_plastique','refus','PET_clair','flou','mal_croppe','papier','metal')) AND mptpi.`min_score`=0.6 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21129194 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Tetrapak','environnement','carton','PEHD','pet_fonce','Papier','pet_clair','PET_fonce','autre','Carton','Film_plastique','refus','PET_clair','flou','mal_croppe','papier','metal')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21129194 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Tetrapak','environnement','carton','PEHD','pet_fonce','Papier','pet_clair','PET_fonce','autre','Carton','Film_plastique','refus','PET_clair','flou','mal_croppe','papier','metal')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21129538,21129535,21129536,21129544,21129542,21129550,21129547,21129543,21129545,21129546,21129548,21129549,21129551?tags=pehd,tetrapak,environnement,carton,pet_fonce,papier,pet_clair,autre,film_plastique,refus,flou,mal_croppe,metal&datou_id_consolidate=4235&port_consolidate=21129194 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1341310788, 1341310785, 1341310782, 1341310779, 1341310777] Looping around the photos to save general results len do output : 1 /21129194. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310788', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310785', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310782', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310779', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310777', None, None, None, None, None, '2645987') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013002634048461914 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.594696521759033 time spend to save output : 0.01345062255859375 total time spend for step 7 : 2.608147144317627 step8:final Thu Mar 6 22:24:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1341310788: ('0.17459305497250877',), 1341310785: ('0.17459305497250877',), 1341310782: ('0.17459305497250877',), 1341310779: ('0.17459305497250877',), 1341310777: ('0.17459305497250877',)} new output for save of step final : {1341310788: ('0.17459305497250877',), 1341310785: ('0.17459305497250877',), 1341310782: ('0.17459305497250877',), 1341310779: ('0.17459305497250877',), 1341310777: ('0.17459305497250877',)} [1341310788, 1341310785, 1341310782, 1341310779, 1341310777] Looping around the photos to save general results len do output : 5 /1341310788.Didn't retrieve data . /1341310785.Didn't retrieve data . /1341310782.Didn't retrieve data . /1341310779.Didn't retrieve data . /1341310777.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310788', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310785', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310782', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310779', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310777', None, None, None, None, None, '2645987') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012484073638916016 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1255631446838379 time spend to save output : 0.012940645217895508 total time spend for step 8 : 0.1385037899017334 step9:velours_tree Thu Mar 6 22:24:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21129538,21129535,21129536,21129544,21129542,21129550,21129547,21129543,21129545,21129546,21129548,21129549,21129551 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129538 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129535 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129536 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129544 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129542 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129550 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129547 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129543 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129545 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129546 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129548 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129549 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129551 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 313 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [3 4 2 1 0 0 1 0 2 0 0 0 5 4 0 4 1 4 1 1 4 2 0 4 5 4 4 1 2 5 2 2 1 1 0 4 4 1 4 2 0 0 0 0 2 0 5 4 0 4 4 1 1 2 4 0 0 1 5 4 2 4 4 1 5 2 2 1 1 3 4 0 4 1 3 1 0 0 0 2 0 0 5 4 0 4 1 4 1 2 1 4 2 0 2 2 4 5 2 1 1 2 1 1 4 4 1 3 1 0 0 2 0 0 0 4 4 2 1 1 1 4 2 0 4 5 4 1 4 2 2 5 5 2 1 1 1 4 0 4 1 3 2 2 2 1 0 0 0 2 0 0 0 0 4 4 1 1 1 2 4 1 0 2 4 4 5 1 2 5 5 2 1 1 0 4 1 2 4 1 2 1 1 0 1 1 2 1 2 1 0 1 4 2 2 0 4 2 0 1 1 1 2 4 1 2 2 2 1 4 4 1 1 2 0 0 2 5 3 5 2 1 1 0 5 5 1 0 5 2 1 0 5 5 3 1 3 4 0 2 1 2 4 4 5 4 1 1 2 1 2 3 1 3 0 1 4 5 2 2 5 2 1 1 2 2 3 1 3 4 0 4 5 2 4 1 2 2 3 1 3 4 1 4 5 2 1 1 1 2 2 3 1 3 4 0 1 4 5 2 4 1 1 2 1 2 2 0 5 0 5 0 2] Elapsed time: 0.0732719898223877 graph_id used : 81808 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21129538,21129535,21129536,21129544,21129542,21129550,21129547,21129543,21129545,21129546,21129548,21129549,21129551?tags=pehd,tetrapak,environnement,carton,pet_fonce,papier,pet_clair,autre,film_plastique,refus,flou,mal_croppe,metal&datou_id_consolidate=4235&port_consolidate=21129194&tree_id=81808 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1341310788, 1341310785, 1341310782, 1341310779, 1341310777] Looping around the photos to save general results len do output : 1 /21129194Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310788', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310785', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310782', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310779', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310777', None, None, None, None, None, '2645987') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012827634811401367 save_final save missing photos in datou_result : time spend for datou_step_exec : 21.612696886062622 time spend to save output : 0.013263463973999023 total time spend for step 9 : 21.62596035003662 step10:send_mail_cod Thu Mar 6 22:25:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21129194_06-03-2025_22_25_17.pdf 21129520 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211295201741296317 21129517 imagette211295171741296317 21129526 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211295261741296318 21129524 change filename to text .imagette211295241741296318 21129532 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211295321741296319 21129529 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211295291741296320 21129525 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211295251741296322 21129527 imagette211295271741296322 21129528 imagette211295281741296322 21129530 imagette211295301741296322 21129531 imagette211295311741296322 21129533 change filename to text .change filename to text .imagette211295331741296322 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21129194 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21129538,21129535,21129536,21129544,21129542,21129550,21129547,21129543,21129545,21129546,21129548,21129549,21129551?tags=pehd,tetrapak,environnement,carton,pet_fonce,papier,pet_clair,autre,film_plastique,refus,flou,mal_croppe,metal&datou_id_consolidate=4235&port_consolidate=21129194&tree_id=81808 your option no_mail is active, we will not send the real mail to your client args[1341310788] : ((1341310788, -6.891517446364395, 492609224), (1341310788, -1.0335825334362796, 501862349), '0.17459305497250877') We are sending mail with results at cod@fotonower.com args[1341310785] : ((1341310785, -6.925657692861879, 492609224), (1341310785, -1.0338375069740076, 501862349), '0.17459305497250877') We are sending mail with results at cod@fotonower.com args[1341310782] : ((1341310782, -6.945870569189708, 492609224), (1341310782, -0.9797782328502654, 501862349), '0.17459305497250877') We are sending mail with results at cod@fotonower.com args[1341310779] : ((1341310779, -6.962072541791819, 492609224), (1341310779, -0.960670746299818, 501862349), '0.17459305497250877') We are sending mail with results at cod@fotonower.com args[1341310777] : ((1341310777, -6.966655224133138, 492609224), (1341310777, -0.9584971770153945, 501862349), '0.17459305497250877') We are sending mail with results at cod@fotonower.com refus_total : 0.17459305497250877 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21129194 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21129194_06-03-2025_22_25_17.pdf results_Qualipapia_P21129194_06-03-2025_22_25_17.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21129194_06-03-2025_22_25_17.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21129194','results_Qualipapia_P21129194_06-03-2025_22_25_17.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21129194_06-03-2025_22_25_17.pdf','pdf','','0.19','0.17459305497250877') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1341310788, 1341310785, 1341310782, 1341310779, 1341310777] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310788', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310785', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310782', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310779', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310777', None, None, None, None, None, '2645987') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.011816024780273438 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.3035407066345215 time spend to save output : 0.012122631072998047 total time spend for step 10 : 6.3156633377075195 step11:split_time_score Thu Mar 6 22:25:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 23), ('17', 1)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06032025 21129194 Nombre de photos uploadées : 24 / 23040 (0%) 06032025 21129194 Nombre de photos taguées (types de déchets): 24 / 24 (100%) 06032025 21129194 Nombre de photos taguées (volume) : 0 / 24 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 7.152557373046875e-06 ???????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0013284683227539062 elapsed_time : insert_dashboard_record_day_entry 0.023503780364990234 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2552810083254836 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21116418_06-03-2025_12_35_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116418 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21116418 AND mptpi.`type`=4230 To do Qualite : 0.2971831971307864 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21116889_06-03-2025_13_32_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116889 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21116889 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116890 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116891 order by id desc limit 1 Qualite : 0.2656426077944325 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21116892_06-03-2025_17_57_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116892 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21116892 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116893 order by id desc limit 1 Qualite : 0.2487335489167673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21117391_06-03-2025_17_40_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21117391 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21117391 AND mptpi.`type`=4230 To do Qualite : 0.19606978781104878 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21121258_06-03-2025_19_33_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21121258 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21121258 AND mptpi.`type`=4230 To do Qualite : 0.24433758362757385 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21121259_06-03-2025_18_49_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21121259 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21121259 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127124 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127125 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127127 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127128 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127129 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127131 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127132 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127134 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127135 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127137 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127138 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127139 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127141 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127142 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127144 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127145 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127147 order by id desc limit 1 Qualite : 0.24016860385296235 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21127148_06-03-2025_21_35_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127148 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21127148 AND mptpi.`type`=4230 To do Qualite : 0.24463049736262288 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21127150_06-03-2025_21_48_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127150 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21127150 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127151 order by id desc limit 1 Qualite : 0.17889388846978332 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21127152_06-03-2025_20_54_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127152 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21127152 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129183 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129184 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129185 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129186 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129187 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129188 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129189 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129190 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129191 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129192 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129193 order by id desc limit 1 Qualite : 0.17459305497250877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21129194_06-03-2025_22_25_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129194 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21129194 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129195 order by id desc limit 1 Qualite : 0.16554427250971745 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21129196_06-03-2025_22_20_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129196 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21129196 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06032025': {'nb_upload': 24, 'nb_taggue_class': 24, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1341310788, 1341310785, 1341310782, 1341310779, 1341310777] Looping around the photos to save general results len do output : 1 /21129194Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310788', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310785', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310782', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310779', None, None, None, None, None, '2645987') ('4234', None, None, None, None, None, None, None, '2645987') ('4234', '21129194', '1341310777', None, None, None, None, None, '2645987') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.011723518371582031 save_final save missing photos in datou_result : time spend for datou_step_exec : 27.439162254333496 time spend to save output : 0.011919736862182617 total time spend for step 11 : 27.45108199119568 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 64.17user 39.18system 5:27.48elapsed 31%CPU (0avgtext+0avgdata 2472236maxresident)k 1048392inputs+22024outputs (15874major+3103262minor)pagefaults 0swaps