python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1679606 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2631148'] with mtr_portfolio_ids : ['20997554'] and first list_photo_ids : [] new path : /proc/1679606/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.32337379455566406 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Mar 4 04:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-04 04:20:31.182010: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-04 04:20:31.207282: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-04 04:20:31.209399: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3904000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-04 04:20:31.209462: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-04 04:20:31.213735: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-04 04:20:31.462636: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x408cbce0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-04 04:20:31.462706: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-04 04:20:31.464290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-04 04:20:31.464761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-04 04:20:31.468211: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-04 04:20:31.471336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-04 04:20:31.471864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-04 04:20:31.478143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-04 04:20:31.479598: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-04 04:20:31.485129: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-04 04:20:31.487132: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-04 04:20:31.487231: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-04 04:20:31.488189: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-04 04:20:31.488208: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-04 04:20:31.488220: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-04 04:20:31.489533: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-04 04:20:31.754545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-04 04:20:31.754644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-04 04:20:31.754669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-04 04:20:31.754691: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-04 04:20:31.754712: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-04 04:20:31.754732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-04 04:20:31.754752: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-04 04:20:31.754773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-04 04:20:31.756400: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-04 04:20:31.757691: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-04 04:20:31.757733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-04 04:20:31.757752: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-04 04:20:31.757770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-04 04:20:31.757787: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-04 04:20:31.757804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-04 04:20:31.757822: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-04 04:20:31.757839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-04 04:20:31.759429: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-04 04:20:31.759463: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-04 04:20:31.759473: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-04 04:20:31.759482: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-04 04:20:31.761043: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-04 04:20:38.990156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-04 04:20:39.175607: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 26.00000 max: 213.00000 molded_images shape: (1, 640, 640, 3) min: -88.96563 max: 99.38125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.85625 max: 150.70937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0006382465362548828 length of segment : 21 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0006585121154785156 length of segment : 31 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.000354766845703125 length of segment : 17 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.00042891502380371094 length of segment : 27 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0008566379547119141 length of segment : 16 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0009250640869140625 length of segment : 25 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.00019621849060058594 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.14922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 2282 time to create 1 rle with old method : 0.0028498172760009766 length of segment : 53 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0006091594696044922 length of segment : 18 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 853 time to create 1 rle with old method : 0.0011436939239501953 length of segment : 41 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0005605220794677734 length of segment : 26 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 821 time to create 1 rle with old method : 0.001085042953491211 length of segment : 60 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003485679626464844 length of segment : 33 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005598068237304688 length of segment : 19 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 6271 time to create 1 rle with old method : 0.008449077606201172 length of segment : 90 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 701 time to create 1 rle with old method : 0.0010073184967041016 length of segment : 48 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006926059722900391 length of segment : 35 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005161762237548828 length of segment : 25 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 3547 time to create 1 rle with old method : 0.00446629524230957 length of segment : 77 time for calcul the mask position with numpy : 0.00011134147644042969 nb_pixel_total : 4683 time to create 1 rle with old method : 0.00603032112121582 length of segment : 88 time for calcul the mask position with numpy : 0.00013828277587890625 nb_pixel_total : 6286 time to create 1 rle with old method : 0.007674694061279297 length of segment : 92 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.87578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1396 time to create 1 rle with old method : 0.0019426345825195312 length of segment : 37 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 3345 time to create 1 rle with old method : 0.004385709762573242 length of segment : 72 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0021245479583740234 length of segment : 46 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1535 time to create 1 rle with old method : 0.002129077911376953 length of segment : 59 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005841255187988281 length of segment : 19 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 984 time to create 1 rle with old method : 0.0012972354888916016 length of segment : 76 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.00042510032653808594 length of segment : 14 time for calcul the mask position with numpy : 0.00022840499877929688 nb_pixel_total : 15520 time to create 1 rle with old method : 0.019132614135742188 length of segment : 100 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.00039267539978027344 length of segment : 15 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005526542663574219 length of segment : 26 time for calcul the mask position with numpy : 0.00011754035949707031 nb_pixel_total : 3323 time to create 1 rle with old method : 0.004423379898071289 length of segment : 105 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 972 time to create 1 rle with old method : 0.0031876564025878906 length of segment : 37 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00011992454528808594 length of segment : 10 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 1 time to create 1 rle with old method : 1.71661376953125e-05 length of segment : 1 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00028514862060546875 length of segment : 16 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 666 time to create 1 rle with old method : 0.000972747802734375 length of segment : 32 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0007748603820800781 length of segment : 25 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 15321 time to create 1 rle with old method : 0.017770051956176758 length of segment : 142 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 2190 time to create 1 rle with old method : 0.0027816295623779297 length of segment : 45 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00017333030700683594 length of segment : 8 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.49688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 653 time to create 1 rle with old method : 0.0009412765502929688 length of segment : 31 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 17 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004062652587890625 length of segment : 35 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.0002377033233642578 length of segment : 18 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0006093978881835938 length of segment : 30 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.00038361549377441406 length of segment : 19 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0005636215209960938 length of segment : 29 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00025463104248046875 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -113.42266 max: 128.55312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.000514984130859375 length of segment : 32 time for calcul the mask position with numpy : 0.00030040740966796875 nb_pixel_total : 15948 time to create 1 rle with old method : 0.019678115844726562 length of segment : 256 Processing 1 images image shape: (400, 160, 3) min: 16.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 60.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.10234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 4572 time to create 1 rle with old method : 0.00580143928527832 length of segment : 94 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 2627 time to create 1 rle with old method : 0.003530740737915039 length of segment : 96 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0021529197692871094 length of segment : 18 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 9604 time to create 1 rle with old method : 0.012463092803955078 length of segment : 160 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 2314 time to create 1 rle with old method : 0.003773927688598633 length of segment : 44 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 4825 time to create 1 rle with old method : 0.006043434143066406 length of segment : 84 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1188 time to create 1 rle with old method : 0.001567840576171875 length of segment : 75 time for calcul the mask position with numpy : 0.00020003318786621094 nb_pixel_total : 8735 time to create 1 rle with old method : 0.010793924331665039 length of segment : 146 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.33672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005574226379394531 length of segment : 18 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0004684925079345703 length of segment : 30 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 2298 time to create 1 rle with old method : 0.00301361083984375 length of segment : 79 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0010192394256591797 length of segment : 40 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005881786346435547 length of segment : 24 time for calcul the mask position with numpy : 0.00015234947204589844 nb_pixel_total : 1486 time to create 1 rle with old method : 0.002062559127807617 length of segment : 116 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 2984 time to create 1 rle with old method : 0.0038728713989257812 length of segment : 49 time for calcul the mask position with numpy : 0.0001201629638671875 nb_pixel_total : 3788 time to create 1 rle with old method : 0.0048694610595703125 length of segment : 89 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003936290740966797 length of segment : 49 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 855 time to create 1 rle with old method : 0.0012793540954589844 length of segment : 93 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 1773 time to create 1 rle with old method : 0.0024499893188476562 length of segment : 45 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0005495548248291016 length of segment : 31 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 2014 time to create 1 rle with old method : 0.002688884735107422 length of segment : 44 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 942 time to create 1 rle with old method : 0.0013217926025390625 length of segment : 49 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 993 time to create 1 rle with old method : 0.001363515853881836 length of segment : 68 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1126 time to create 1 rle with old method : 0.0015728473663330078 length of segment : 61 time for calcul the mask position with numpy : 0.0002799034118652344 nb_pixel_total : 16881 time to create 1 rle with old method : 0.02077460289001465 length of segment : 163 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 706 time to create 1 rle with old method : 0.0009045600891113281 length of segment : 67 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0008118152618408203 length of segment : 33 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005896091461181641 length of segment : 24 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0007228851318359375 length of segment : 24 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005869865417480469 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.41094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 927 time to create 1 rle with old method : 0.0012121200561523438 length of segment : 50 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.0008318424224853516 length of segment : 28 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0009431838989257812 length of segment : 43 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.0011096000671386719 length of segment : 32 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 707 time to create 1 rle with old method : 0.001007080078125 length of segment : 30 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0014007091522216797 length of segment : 58 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002963542938232422 length of segment : 25 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 919 time to create 1 rle with old method : 0.0012927055358886719 length of segment : 38 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0004050731658935547 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.09063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005936622619628906 length of segment : 34 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0007646083831787109 length of segment : 17 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 2299 time to create 1 rle with old method : 0.0030112266540527344 length of segment : 43 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 2148 time to create 1 rle with old method : 0.0028607845306396484 length of segment : 41 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0005230903625488281 length of segment : 20 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002651214599609375 length of segment : 21 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 2404 time to create 1 rle with old method : 0.003075838088989258 length of segment : 62 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1587 time to create 1 rle with old method : 0.0021207332611083984 length of segment : 58 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.000331878662109375 length of segment : 19 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 2340 time to create 1 rle with old method : 0.0031044483184814453 length of segment : 60 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.00859 max: 150.78359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 1909 time to create 1 rle with old method : 0.0022859573364257812 length of segment : 54 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0006031990051269531 length of segment : 24 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 633 time to create 1 rle with old method : 0.0010166168212890625 length of segment : 36 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0005335807800292969 length of segment : 18 time for calcul the mask position with numpy : 0.00010585784912109375 nb_pixel_total : 3434 time to create 1 rle with old method : 0.004704952239990234 length of segment : 98 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 1964 time to create 1 rle with old method : 0.0026731491088867188 length of segment : 57 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 981 time to create 1 rle with old method : 0.0013484954833984375 length of segment : 48 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0007636547088623047 length of segment : 26 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 2201 time to create 1 rle with old method : 0.003220796585083008 length of segment : 59 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 571 time to create 1 rle with old method : 0.0009088516235351562 length of segment : 26 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005865097045898438 length of segment : 34 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 2187 time to create 1 rle with old method : 0.003134012222290039 length of segment : 61 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006868839263916016 length of segment : 22 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0008580684661865234 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.28594 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 1416 time to create 1 rle with old method : 0.001730203628540039 length of segment : 61 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.00087738037109375 length of segment : 28 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0008111000061035156 length of segment : 36 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003833770751953125 length of segment : 19 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00027108192443847656 length of segment : 11 Processing 1 images image shape: (400, 160, 3) min: 14.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.49844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00023603439331054688 nb_pixel_total : 10748 time to create 1 rle with old method : 0.019539356231689453 length of segment : 369 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.90703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1136 time to create 1 rle with old method : 0.0016744136810302734 length of segment : 44 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 747 time to create 1 rle with old method : 0.0011796951293945312 length of segment : 51 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006933212280273438 length of segment : 25 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0004973411560058594 length of segment : 28 time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 4961 time to create 1 rle with old method : 0.00677943229675293 length of segment : 128 time for calcul the mask position with numpy : 0.0002529621124267578 nb_pixel_total : 8990 time to create 1 rle with old method : 0.011205673217773438 length of segment : 302 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.001100301742553711 length of segment : 35 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 1752 time to create 1 rle with old method : 0.002476215362548828 length of segment : 78 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 3280 time to create 1 rle with old method : 0.004376411437988281 length of segment : 92 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0020837783813476562 length of segment : 77 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.96563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 4033 time to create 1 rle with old method : 0.0054168701171875 length of segment : 89 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0007243156433105469 length of segment : 75 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 2416 time to create 1 rle with old method : 0.0034284591674804688 length of segment : 61 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0017154216766357422 length of segment : 33 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1384 time to create 1 rle with old method : 0.0018401145935058594 length of segment : 48 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1961 time to create 1 rle with old method : 0.002682209014892578 length of segment : 49 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006287097930908203 length of segment : 29 time for calcul the mask position with numpy : 0.0005147457122802734 nb_pixel_total : 30885 time to create 1 rle with old method : 0.03791618347167969 length of segment : 661 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.0001437664031982422 length of segment : 16 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0007183551788330078 length of segment : 23 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0008404254913330078 length of segment : 56 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0007464885711669922 length of segment : 21 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0016145706176757812 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -107.10625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0011525154113769531 length of segment : 38 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 1073 time to create 1 rle with old method : 0.0019459724426269531 length of segment : 76 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0003743171691894531 length of segment : 15 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1720 time to create 1 rle with old method : 0.002489328384399414 length of segment : 55 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 1740 time to create 1 rle with old method : 0.002335071563720703 length of segment : 63 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 3270 time to create 1 rle with old method : 0.004088640213012695 length of segment : 101 time for calcul the mask position with numpy : 0.00013136863708496094 nb_pixel_total : 2404 time to create 1 rle with old method : 0.0032198429107666016 length of segment : 145 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1039 time to create 1 rle with old method : 0.0013887882232666016 length of segment : 57 Processing 1 images image shape: (400, 400, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -81.24688 max: 147.34609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.0001747608184814453 length of segment : 5 Processing 1 images image shape: (400, 400, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -89.07891 max: 149.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0002894401550292969 nb_pixel_total : 18067 time to create 1 rle with old method : 0.020269393920898438 length of segment : 287 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005757808685302734 length of segment : 20 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 3113 time to create 1 rle with old method : 0.0040400028228759766 length of segment : 81 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.47734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004329681396484375 length of segment : 20 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0004584789276123047 length of segment : 22 Processing 1 images image shape: (400, 160, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.67812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0008950233459472656 length of segment : 23 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.000476837158203125 length of segment : 26 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0007908344268798828 length of segment : 67 Processing 1 images image shape: (240, 400, 3) min: 50.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 945 time to create 1 rle with old method : 0.0012674331665039062 length of segment : 55 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00036406517028808594 length of segment : 23 time for calcul the mask position with numpy : 0.00083160400390625 nb_pixel_total : 68436 time to create 1 rle with old method : 0.10352897644042969 length of segment : 230 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005288124084472656 length of segment : 78 Processing 1 images image shape: (240, 400, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0012602806091308594 length of segment : 57 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007402896881103516 length of segment : 34 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00026988983154296875 length of segment : 57 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 5500 time to create 1 rle with old method : 0.006929636001586914 length of segment : 93 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 27 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1537 time to create 1 rle with old method : 0.002103090286254883 length of segment : 68 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 2129 time to create 1 rle with old method : 0.0028743743896484375 length of segment : 48 Processing 1 images image shape: (240, 400, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00015616416931152344 length of segment : 11 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0009183883666992188 length of segment : 19 Processing 1 images image shape: (240, 400, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.29141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1086 time to create 1 rle with old method : 0.0014164447784423828 length of segment : 45 Processing 1 images image shape: (240, 400, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.33047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.0002601146697998047 length of segment : 26 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00037860870361328125 length of segment : 17 time for calcul the mask position with numpy : 0.00041413307189941406 nb_pixel_total : 37640 time to create 1 rle with old method : 0.04393362998962402 length of segment : 134 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 855 time to create 1 rle with old method : 0.00110626220703125 length of segment : 37 Processing 1 images image shape: (240, 400, 3) min: 9.00000 max: 241.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.14297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 160, 3) min: 65.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 93.12225 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0004487037658691406 length of segment : 34 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 6566 time to create 1 rle with old method : 0.00861668586730957 length of segment : 84 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 41.00000 max: 202.00000 molded_images shape: (1, 640, 640, 3) min: -80.78984 max: 89.68203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.22344 max: 149.57656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0010492801666259766 length of segment : 34 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0006327629089355469 length of segment : 21 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0004265308380126953 length of segment : 27 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0004150867462158203 length of segment : 30 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0006220340728759766 length of segment : 25 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00032019615173339844 length of segment : 19 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.000213623046875 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.08672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 750 time to create 1 rle with old method : 0.0009076595306396484 length of segment : 39 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 799 time to create 1 rle with old method : 0.0010097026824951172 length of segment : 52 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1747 time to create 1 rle with old method : 0.0021593570709228516 length of segment : 50 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005822181701660156 length of segment : 29 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 625 time to create 1 rle with old method : 0.0008068084716796875 length of segment : 48 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0004353523254394531 length of segment : 27 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00014734268188476562 length of segment : 8 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003590583801269531 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -107.87969 max: 147.34219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00039196014404296875 length of segment : 14 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 16 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1484 time to create 1 rle with old method : 0.001882314682006836 length of segment : 48 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0005404949188232422 length of segment : 16 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006284713745117188 length of segment : 24 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005438327789306641 length of segment : 16 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0004036426544189453 length of segment : 29 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.00046372413635253906 length of segment : 21 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.00096893310546875 length of segment : 26 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006711483001708984 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.92266 max: 150.27969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0006062984466552734 length of segment : 38 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00032782554626464844 length of segment : 16 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 631 time to create 1 rle with old method : 0.0008704662322998047 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 20.00000 max: 238.00000 molded_images shape: (1, 640, 640, 3) min: -97.28594 max: 120.38906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 160, 3) min: 42.00000 max: 124.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 15.99062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.98906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.0011601448059082031 length of segment : 57 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1755 time to create 1 rle with old method : 0.002485990524291992 length of segment : 112 time for calcul the mask position with numpy : 0.00013446807861328125 nb_pixel_total : 4857 time to create 1 rle with old method : 0.005881547927856445 length of segment : 156 time for calcul the mask position with numpy : 0.0001392364501953125 nb_pixel_total : 5320 time to create 1 rle with old method : 0.006847381591796875 length of segment : 153 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.45000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004839897155761719 length of segment : 14 time for calcul the mask position with numpy : 0.0001850128173828125 nb_pixel_total : 6922 time to create 1 rle with old method : 0.008925676345825195 length of segment : 157 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1511 time to create 1 rle with old method : 0.0020253658294677734 length of segment : 39 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005664825439453125 length of segment : 68 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1775 time to create 1 rle with old method : 0.0022597312927246094 length of segment : 91 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1545 time to create 1 rle with old method : 0.002083301544189453 length of segment : 43 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.000751495361328125 length of segment : 23 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1368 time to create 1 rle with old method : 0.001796722412109375 length of segment : 79 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 588 time to create 1 rle with old method : 0.0008358955383300781 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.83672 max: 146.29141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 45 time to create 1 rle with old method : 0.0001537799835205078 length of segment : 6 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 2052 time to create 1 rle with old method : 0.0037412643432617188 length of segment : 38 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1059 time to create 1 rle with old method : 0.001527547836303711 length of segment : 28 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0007586479187011719 length of segment : 27 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0006923675537109375 length of segment : 26 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00024175643920898438 length of segment : 9 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1484 time to create 1 rle with old method : 0.0020668506622314453 length of segment : 46 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004963874816894531 length of segment : 20 time for calcul the mask position with numpy : 0.00010132789611816406 nb_pixel_total : 3418 time to create 1 rle with old method : 0.004546642303466797 length of segment : 86 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 6782 time to create 1 rle with old method : 0.008485555648803711 length of segment : 88 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -94.39922 max: 147.75625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 2211 time to create 1 rle with old method : 0.0028929710388183594 length of segment : 45 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0020470619201660156 length of segment : 42 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0016663074493408203 length of segment : 33 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 2281 time to create 1 rle with old method : 0.0029859542846679688 length of segment : 52 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 431 time to create 1 rle with old method : 0.0006122589111328125 length of segment : 16 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0003139972686767578 length of segment : 10 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 943 time to create 1 rle with old method : 0.0012204647064208984 length of segment : 49 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00032329559326171875 length of segment : 15 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006864070892333984 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -81.68828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1180 time to create 1 rle with old method : 0.0014846324920654297 length of segment : 44 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 2427 time to create 1 rle with old method : 0.0030024051666259766 length of segment : 79 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 978 time to create 1 rle with old method : 0.0012199878692626953 length of segment : 49 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1472 time to create 1 rle with old method : 0.0018665790557861328 length of segment : 53 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005879402160644531 length of segment : 31 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1923 time to create 1 rle with old method : 0.002506256103515625 length of segment : 55 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 2035 time to create 1 rle with old method : 0.002512216567993164 length of segment : 50 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004639625549316406 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -89.83281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1226 time to create 1 rle with old method : 0.0015821456909179688 length of segment : 46 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1232 time to create 1 rle with old method : 0.001590728759765625 length of segment : 59 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00023698806762695312 length of segment : 12 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00042057037353515625 length of segment : 14 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0007026195526123047 length of segment : 26 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.000507354736328125 length of segment : 19 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.000476837158203125 length of segment : 29 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.00044035911560058594 length of segment : 24 Processing 1 images image shape: (400, 160, 3) min: 32.00000 max: 209.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 102.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00017070770263671875 nb_pixel_total : 8212 time to create 1 rle with old method : 0.009799718856811523 length of segment : 206 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.48125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004932880401611328 length of segment : 28 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1323 time to create 1 rle with old method : 0.001608133316040039 length of segment : 61 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005881786346435547 length of segment : 24 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 718 time to create 1 rle with old method : 0.0009970664978027344 length of segment : 47 time for calcul the mask position with numpy : 0.0002346038818359375 nb_pixel_total : 10553 time to create 1 rle with old method : 0.013072013854980469 length of segment : 234 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0008087158203125 length of segment : 22 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0009136199951171875 length of segment : 36 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0017273426055908203 length of segment : 57 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1158 time to create 1 rle with old method : 0.0014677047729492188 length of segment : 52 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 896 time to create 1 rle with old method : 0.0012996196746826172 length of segment : 42 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003485679626464844 length of segment : 28 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 3479 time to create 1 rle with old method : 0.0040853023529052734 length of segment : 73 time for calcul the mask position with numpy : 0.0003066062927246094 nb_pixel_total : 17195 time to create 1 rle with old method : 0.020045995712280273 length of segment : 232 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0005729198455810547 length of segment : 25 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 3533 time to create 1 rle with old method : 0.0042629241943359375 length of segment : 74 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.61797 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00039267539978027344 length of segment : 13 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0007338523864746094 length of segment : 64 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 3462 time to create 1 rle with old method : 0.004530906677246094 length of segment : 67 time for calcul the mask position with numpy : 0.00043654441833496094 nb_pixel_total : 16286 time to create 1 rle with old method : 0.020175695419311523 length of segment : 512 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0005013942718505859 length of segment : 22 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 577 time to create 1 rle with old method : 0.0008447170257568359 length of segment : 23 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0007288455963134766 length of segment : 24 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 2386 time to create 1 rle with old method : 0.0029501914978027344 length of segment : 64 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0015673637390136719 length of segment : 34 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0004425048828125 length of segment : 45 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 2349 time to create 1 rle with old method : 0.0031621456146240234 length of segment : 60 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 1158 time to create 1 rle with old method : 0.0015411376953125 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -90.93438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1026 time to create 1 rle with old method : 0.001954317092895508 length of segment : 74 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 2490 time to create 1 rle with old method : 0.004717111587524414 length of segment : 53 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0006735324859619141 length of segment : 21 time for calcul the mask position with numpy : 0.0001862049102783203 nb_pixel_total : 5439 time to create 1 rle with old method : 0.008156538009643555 length of segment : 90 Processing 1 images image shape: (400, 400, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -76.70000 max: 149.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 63 time to create 1 rle with old method : 0.00014162063598632812 length of segment : 7 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.0006017684936523438 length of segment : 25 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00026035308837890625 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 42.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -77.29375 max: 149.05703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 2304 time to create 1 rle with old method : 0.0028679370880126953 length of segment : 82 time for calcul the mask position with numpy : 0.0006375312805175781 nb_pixel_total : 55985 time to create 1 rle with old method : 0.0645139217376709 length of segment : 292 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.0012125968933105469 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -85.29766 max: 141.43984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0004963874816894531 length of segment : 21 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0006837844848632812 length of segment : 25 Processing 1 images image shape: (400, 160, 3) min: 30.00000 max: 226.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 117.15859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0006034374237060547 length of segment : 24 Processing 1 images image shape: (240, 400, 3) min: 53.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.08047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003256797790527344 length of segment : 18 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 983 time to create 1 rle with old method : 0.001956939697265625 length of segment : 54 time for calcul the mask position with numpy : 0.0007698535919189453 nb_pixel_total : 70517 time to create 1 rle with old method : 0.08229708671569824 length of segment : 230 Processing 1 images image shape: (240, 400, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003342628479003906 length of segment : 56 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1421 time to create 1 rle with old method : 0.0018720626831054688 length of segment : 66 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1333 time to create 1 rle with old method : 0.0019156932830810547 length of segment : 101 Processing 1 images image shape: (240, 400, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 1155 time to create 1 rle with old method : 0.002604246139526367 length of segment : 48 time for calcul the mask position with numpy : 0.00013899803161621094 nb_pixel_total : 6144 time to create 1 rle with old method : 0.007932662963867188 length of segment : 59 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1090 time to create 1 rle with old method : 0.0014324188232421875 length of segment : 51 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0006115436553955078 length of segment : 20 Processing 1 images image shape: (240, 400, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.90469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 943 time to create 1 rle with old method : 0.0014157295227050781 length of segment : 43 Processing 1 images image shape: (240, 400, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.09062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00035881996154785156 length of segment : 17 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00019049644470214844 length of segment : 26 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 776 time to create 1 rle with old method : 0.001039266586303711 length of segment : 41 Processing 1 images image shape: (240, 400, 3) min: 43.00000 max: 227.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 120.52969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 160, 3) min: 66.00000 max: 236.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.77410 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Detection mask done ! Trying to reset tf kernel 1680246 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4332 tf kernel not reseted sub process len(results) : 311 len(list_Values) 311 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 311 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 311 chid ids of type : 4228 Number RLEs to save : 17168 save missing photos in datou_result : time spend for datou_step_exec : 27.528076171875 time spend to save output : 1.557523250579834 total time spend for step 1 : 29.085599422454834 step2:brightness Tue Mar 4 04:20:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741058427_1679606_1340727074_3faa594983b58ed3524da3cae6fb2dd6.jpg treat image : temp/1741058427_1679606_1340724365_3708e93ad2f3252f87709799fb835d60.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.013371706008911133 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.031423091888427734 save missing photos in datou_result : time spend for datou_step_exec : 0.9043447971343994 time spend to save output : 0.049553632736206055 total time spend for step 2 : 0.9538984298706055 step3:blur_detection Tue Mar 4 04:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741058427_1679606_1340727074_3faa594983b58ed3524da3cae6fb2dd6.jpg resize: (1440, 2560) 1340727074 -7.060200716111858 treat image : temp/1741058427_1679606_1340724365_3708e93ad2f3252f87709799fb835d60.jpg resize: (1440, 2560) 1340724365 -6.348533795715609 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.011864185333251953 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.01994156837463379 save missing photos in datou_result : time spend for datou_step_exec : 4.242251396179199 time spend to save output : 0.03661918640136719 total time spend for step 3 : 4.278870582580566 step4:rle_unique_nms_with_priority Tue Mar 4 04:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 311 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 179 nb_hashtags : 6 time to prepare the origin masks : 1.91532564163208 time for calcul the mask position with numpy : 0.4476604461669922 nb_pixel_total : 3284591 time to create 1 rle with new method : 0.4953193664550781 time for calcul the mask position with numpy : 0.01501607894897461 nb_pixel_total : 21 time to create 1 rle with old method : 5.221366882324219e-05 time for calcul the mask position with numpy : 0.015636920928955078 nb_pixel_total : 140 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.014954805374145508 nb_pixel_total : 368 time to create 1 rle with old method : 0.00047588348388671875 time for calcul the mask position with numpy : 0.014930963516235352 nb_pixel_total : 36 time to create 1 rle with old method : 8.344650268554688e-05 time for calcul the mask position with numpy : 0.01482534408569336 nb_pixel_total : 2186 time to create 1 rle with old method : 0.0023620128631591797 time for calcul the mask position with numpy : 0.014984130859375 nb_pixel_total : 1 time to create 1 rle with old method : 2.1219253540039062e-05 time for calcul the mask position with numpy : 0.01494598388671875 nb_pixel_total : 6271 time to create 1 rle with old method : 0.006956577301025391 time for calcul the mask position with numpy : 0.01484537124633789 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004067420959472656 time for calcul the mask position with numpy : 0.01497340202331543 nb_pixel_total : 15520 time to create 1 rle with old method : 0.017019987106323242 time for calcul the mask position with numpy : 0.015046358108520508 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002491474151611328 time for calcul the mask position with numpy : 0.014724254608154297 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0012590885162353516 time for calcul the mask position with numpy : 0.014590263366699219 nb_pixel_total : 178 time to create 1 rle with old method : 0.00019812583923339844 time for calcul the mask position with numpy : 0.014792919158935547 nb_pixel_total : 400 time to create 1 rle with old method : 0.0004749298095703125 time for calcul the mask position with numpy : 0.016427993774414062 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005478858947753906 time for calcul the mask position with numpy : 0.016301393508911133 nb_pixel_total : 15831 time to create 1 rle with old method : 0.017863988876342773 time for calcul the mask position with numpy : 0.014936685562133789 nb_pixel_total : 361 time to create 1 rle with old method : 0.00041365623474121094 time for calcul the mask position with numpy : 0.014898300170898438 nb_pixel_total : 984 time to create 1 rle with old method : 0.0011563301086425781 time for calcul the mask position with numpy : 0.014543294906616211 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005450248718261719 time for calcul the mask position with numpy : 0.014611482620239258 nb_pixel_total : 13 time to create 1 rle with old method : 3.409385681152344e-05 time for calcul the mask position with numpy : 0.014572620391845703 nb_pixel_total : 309 time to create 1 rle with old method : 0.0003833770751953125 time for calcul the mask position with numpy : 0.014908790588378906 nb_pixel_total : 170 time to create 1 rle with old method : 0.00020051002502441406 time for calcul the mask position with numpy : 0.015085220336914062 nb_pixel_total : 415 time to create 1 rle with old method : 0.0004954338073730469 time for calcul the mask position with numpy : 0.01491689682006836 nb_pixel_total : 61 time to create 1 rle with old method : 8.702278137207031e-05 time for calcul the mask position with numpy : 0.015111446380615234 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005140304565429688 time for calcul the mask position with numpy : 0.014965057373046875 nb_pixel_total : 3323 time to create 1 rle with old method : 0.003732442855834961 time for calcul the mask position with numpy : 0.014917612075805664 nb_pixel_total : 3547 time to create 1 rle with old method : 0.003951072692871094 time for calcul the mask position with numpy : 0.014888525009155273 nb_pixel_total : 66 time to create 1 rle with old method : 8.249282836914062e-05 time for calcul the mask position with numpy : 0.01489710807800293 nb_pixel_total : 853 time to create 1 rle with old method : 0.0009465217590332031 time for calcul the mask position with numpy : 0.014795303344726562 nb_pixel_total : 211 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.014560461044311523 nb_pixel_total : 666 time to create 1 rle with old method : 0.0007545948028564453 time for calcul the mask position with numpy : 0.014662504196166992 nb_pixel_total : 327 time to create 1 rle with old method : 0.0003464221954345703 time for calcul the mask position with numpy : 0.01471257209777832 nb_pixel_total : 701 time to create 1 rle with old method : 0.000827789306640625 time for calcul the mask position with numpy : 0.014894723892211914 nb_pixel_total : 337 time to create 1 rle with old method : 0.000400543212890625 time for calcul the mask position with numpy : 0.014911890029907227 nb_pixel_total : 2282 time to create 1 rle with old method : 0.0025370121002197266 time for calcul the mask position with numpy : 0.014816761016845703 nb_pixel_total : 972 time to create 1 rle with old method : 0.0011200904846191406 time for calcul the mask position with numpy : 0.014943838119506836 nb_pixel_total : 3345 time to create 1 rle with old method : 0.0036840438842773438 time for calcul the mask position with numpy : 0.014916181564331055 nb_pixel_total : 821 time to create 1 rle with old method : 0.0009367465972900391 time for calcul the mask position with numpy : 0.014893770217895508 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003440380096435547 time for calcul the mask position with numpy : 0.014831781387329102 nb_pixel_total : 248 time to create 1 rle with old method : 0.00029754638671875 time for calcul the mask position with numpy : 0.014736652374267578 nb_pixel_total : 404 time to create 1 rle with old method : 0.00044155120849609375 time for calcul the mask position with numpy : 0.01449441909790039 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0018913745880126953 time for calcul the mask position with numpy : 0.015089273452758789 nb_pixel_total : 246 time to create 1 rle with old method : 0.0002894401550292969 time for calcul the mask position with numpy : 0.014994144439697266 nb_pixel_total : 653 time to create 1 rle with old method : 0.0008153915405273438 time for calcul the mask position with numpy : 0.01506662368774414 nb_pixel_total : 1535 time to create 1 rle with old method : 0.0025606155395507812 time for calcul the mask position with numpy : 0.01677560806274414 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004582405090332031 time for calcul the mask position with numpy : 0.015429496765136719 nb_pixel_total : 1396 time to create 1 rle with old method : 0.0015745162963867188 time for calcul the mask position with numpy : 0.016725778579711914 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005574226379394531 time for calcul the mask position with numpy : 0.014896869659423828 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004410743713378906 time for calcul the mask position with numpy : 0.014973640441894531 nb_pixel_total : 251 time to create 1 rle with old method : 0.00028777122497558594 time for calcul the mask position with numpy : 0.014869213104248047 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002665519714355469 time for calcul the mask position with numpy : 0.014664649963378906 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004410743713378906 time for calcul the mask position with numpy : 0.014821529388427734 nb_pixel_total : 2148 time to create 1 rle with old method : 0.0023314952850341797 time for calcul the mask position with numpy : 0.014549016952514648 nb_pixel_total : 175 time to create 1 rle with old method : 0.0001919269561767578 time for calcul the mask position with numpy : 0.014780521392822266 nb_pixel_total : 213 time to create 1 rle with old method : 0.00024509429931640625 time for calcul the mask position with numpy : 0.014841318130493164 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003094673156738281 time for calcul the mask position with numpy : 0.014904022216796875 nb_pixel_total : 402 time to create 1 rle with old method : 0.0004515647888183594 time for calcul the mask position with numpy : 0.01495218276977539 nb_pixel_total : 927 time to create 1 rle with old method : 0.0010440349578857422 time for calcul the mask position with numpy : 0.014957904815673828 nb_pixel_total : 41 time to create 1 rle with old method : 9.632110595703125e-05 time for calcul the mask position with numpy : 0.015857219696044922 nb_pixel_total : 379 time to create 1 rle with old method : 0.00044417381286621094 time for calcul the mask position with numpy : 0.01485753059387207 nb_pixel_total : 330 time to create 1 rle with old method : 0.0003705024719238281 time for calcul the mask position with numpy : 0.014959573745727539 nb_pixel_total : 571 time to create 1 rle with old method : 0.0006589889526367188 time for calcul the mask position with numpy : 0.014825820922851562 nb_pixel_total : 21 time to create 1 rle with old method : 5.5789947509765625e-05 time for calcul the mask position with numpy : 0.014923810958862305 nb_pixel_total : 3788 time to create 1 rle with old method : 0.004152536392211914 time for calcul the mask position with numpy : 0.014905214309692383 nb_pixel_total : 422 time to create 1 rle with old method : 0.00048470497131347656 time for calcul the mask position with numpy : 0.014661788940429688 nb_pixel_total : 294 time to create 1 rle with old method : 0.00033020973205566406 time for calcul the mask position with numpy : 0.014730691909790039 nb_pixel_total : 2404 time to create 1 rle with old method : 0.0026330947875976562 time for calcul the mask position with numpy : 0.014844417572021484 nb_pixel_total : 13 time to create 1 rle with old method : 5.626678466796875e-05 time for calcul the mask position with numpy : 0.01459646224975586 nb_pixel_total : 831 time to create 1 rle with old method : 0.0009295940399169922 time for calcul the mask position with numpy : 0.014341592788696289 nb_pixel_total : 530 time to create 1 rle with old method : 0.0007109642028808594 time for calcul the mask position with numpy : 0.01458120346069336 nb_pixel_total : 291 time to create 1 rle with old method : 0.00035881996154785156 time for calcul the mask position with numpy : 0.014687776565551758 nb_pixel_total : 919 time to create 1 rle with old method : 0.0010395050048828125 time for calcul the mask position with numpy : 0.014300346374511719 nb_pixel_total : 600 time to create 1 rle with old method : 0.0006577968597412109 time for calcul the mask position with numpy : 0.014653205871582031 nb_pixel_total : 757 time to create 1 rle with old method : 0.0008037090301513672 time for calcul the mask position with numpy : 0.01438283920288086 nb_pixel_total : 981 time to create 1 rle with old method : 0.0010797977447509766 time for calcul the mask position with numpy : 0.01412653923034668 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001285076141357422 time for calcul the mask position with numpy : 0.014724254608154297 nb_pixel_total : 707 time to create 1 rle with old method : 0.0008306503295898438 time for calcul the mask position with numpy : 0.014374971389770508 nb_pixel_total : 2201 time to create 1 rle with old method : 0.0023419857025146484 time for calcul the mask position with numpy : 0.014627456665039062 nb_pixel_total : 88 time to create 1 rle with old method : 0.000156402587890625 time for calcul the mask position with numpy : 0.014810323715209961 nb_pixel_total : 942 time to create 1 rle with old method : 0.0010485649108886719 time for calcul the mask position with numpy : 0.014444112777709961 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005104541778564453 time for calcul the mask position with numpy : 0.014914751052856445 nb_pixel_total : 1005 time to create 1 rle with old method : 0.001146554946899414 time for calcul the mask position with numpy : 0.014783143997192383 nb_pixel_total : 704 time to create 1 rle with old method : 0.0010900497436523438 time for calcul the mask position with numpy : 0.014393806457519531 nb_pixel_total : 711 time to create 1 rle with old method : 0.0008130073547363281 time for calcul the mask position with numpy : 0.014480113983154297 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004646778106689453 time for calcul the mask position with numpy : 0.014414310455322266 nb_pixel_total : 993 time to create 1 rle with old method : 0.0010786056518554688 time for calcul the mask position with numpy : 0.014173746109008789 nb_pixel_total : 411 time to create 1 rle with old method : 0.0004425048828125 time for calcul the mask position with numpy : 0.014275074005126953 nb_pixel_total : 10748 time to create 1 rle with old method : 0.011742591857910156 time for calcul the mask position with numpy : 0.01393270492553711 nb_pixel_total : 1126 time to create 1 rle with old method : 0.0012500286102294922 time for calcul the mask position with numpy : 0.014290809631347656 nb_pixel_total : 1486 time to create 1 rle with old method : 0.0016074180603027344 time for calcul the mask position with numpy : 0.014369726181030273 nb_pixel_total : 1964 time to create 1 rle with old method : 0.0020699501037597656 time for calcul the mask position with numpy : 0.014519214630126953 nb_pixel_total : 1909 time to create 1 rle with old method : 0.0021588802337646484 time for calcul the mask position with numpy : 0.01405024528503418 nb_pixel_total : 2299 time to create 1 rle with old method : 0.0024962425231933594 time for calcul the mask position with numpy : 0.014725923538208008 nb_pixel_total : 158 time to create 1 rle with old method : 0.000194549560546875 time for calcul the mask position with numpy : 0.014392852783203125 nb_pixel_total : 596 time to create 1 rle with old method : 0.0006492137908935547 time for calcul the mask position with numpy : 0.014322280883789062 nb_pixel_total : 16881 time to create 1 rle with old method : 0.018068552017211914 time for calcul the mask position with numpy : 0.014422178268432617 nb_pixel_total : 2627 time to create 1 rle with old method : 0.0028085708618164062 time for calcul the mask position with numpy : 0.014595270156860352 nb_pixel_total : 3434 time to create 1 rle with old method : 0.0037386417388916016 time for calcul the mask position with numpy : 0.014219284057617188 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002162456512451172 time for calcul the mask position with numpy : 0.014064550399780273 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002892017364501953 time for calcul the mask position with numpy : 0.014030218124389648 nb_pixel_total : 9261 time to create 1 rle with old method : 0.009704113006591797 time for calcul the mask position with numpy : 0.014265298843383789 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005204677581787109 time for calcul the mask position with numpy : 0.014147043228149414 nb_pixel_total : 549 time to create 1 rle with old method : 0.0006237030029296875 time for calcul the mask position with numpy : 0.014237165451049805 nb_pixel_total : 449 time to create 1 rle with old method : 0.0004839897155761719 time for calcul the mask position with numpy : 0.014229297637939453 nb_pixel_total : 855 time to create 1 rle with old method : 0.0009453296661376953 time for calcul the mask position with numpy : 0.01403188705444336 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005168914794921875 time for calcul the mask position with numpy : 0.014116764068603516 nb_pixel_total : 4572 time to create 1 rle with old method : 0.0048978328704833984 time for calcul the mask position with numpy : 0.01396632194519043 nb_pixel_total : 2298 time to create 1 rle with old method : 0.0023953914642333984 time for calcul the mask position with numpy : 0.014011383056640625 nb_pixel_total : 501 time to create 1 rle with old method : 0.0005354881286621094 time for calcul the mask position with numpy : 0.014213800430297852 nb_pixel_total : 1587 time to create 1 rle with old method : 0.0017399787902832031 time for calcul the mask position with numpy : 0.014113426208496094 nb_pixel_total : 1416 time to create 1 rle with old method : 0.0015752315521240234 time for calcul the mask position with numpy : 0.013962030410766602 nb_pixel_total : 369 time to create 1 rle with old method : 0.0004360675811767578 time for calcul the mask position with numpy : 0.013915777206420898 nb_pixel_total : 2984 time to create 1 rle with old method : 0.0032587051391601562 time for calcul the mask position with numpy : 0.013900041580200195 nb_pixel_total : 1773 time to create 1 rle with old method : 0.0018758773803710938 time for calcul the mask position with numpy : 0.013943672180175781 nb_pixel_total : 2290 time to create 1 rle with old method : 0.002368927001953125 time for calcul the mask position with numpy : 0.014249086380004883 nb_pixel_total : 283 time to create 1 rle with old method : 0.000347137451171875 time for calcul the mask position with numpy : 0.01404881477355957 nb_pixel_total : 5 time to create 1 rle with old method : 1.9311904907226562e-05 time for calcul the mask position with numpy : 0.01404261589050293 nb_pixel_total : 633 time to create 1 rle with old method : 0.0007002353668212891 time for calcul the mask position with numpy : 0.014075994491577148 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0015666484832763672 time for calcul the mask position with numpy : 0.013895511627197266 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.014002799987792969 nb_pixel_total : 62 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.013711929321289062 nb_pixel_total : 58 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.014103412628173828 nb_pixel_total : 1481 time to create 1 rle with old method : 0.0016129016876220703 time for calcul the mask position with numpy : 0.014313936233520508 nb_pixel_total : 18067 time to create 1 rle with old method : 0.019115209579467773 time for calcul the mask position with numpy : 0.014208555221557617 nb_pixel_total : 8990 time to create 1 rle with old method : 0.009731292724609375 time for calcul the mask position with numpy : 0.013941049575805664 nb_pixel_total : 1384 time to create 1 rle with old method : 0.0014591217041015625 time for calcul the mask position with numpy : 0.014018774032592773 nb_pixel_total : 286 time to create 1 rle with old method : 0.0003104209899902344 time for calcul the mask position with numpy : 0.014239788055419922 nb_pixel_total : 413 time to create 1 rle with old method : 0.00048828125 time for calcul the mask position with numpy : 0.015006780624389648 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002086162567138672 time for calcul the mask position with numpy : 0.014826059341430664 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007541179656982422 time for calcul the mask position with numpy : 0.014835596084594727 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002086162567138672 time for calcul the mask position with numpy : 0.014872312545776367 nb_pixel_total : 423 time to create 1 rle with old method : 0.0004971027374267578 time for calcul the mask position with numpy : 0.014858484268188477 nb_pixel_total : 598 time to create 1 rle with old method : 0.0006580352783203125 time for calcul the mask position with numpy : 0.01469564437866211 nb_pixel_total : 2416 time to create 1 rle with old method : 0.0027985572814941406 time for calcul the mask position with numpy : 0.014790534973144531 nb_pixel_total : 30824 time to create 1 rle with old method : 0.03457045555114746 time for calcul the mask position with numpy : 0.016260623931884766 nb_pixel_total : 248 time to create 1 rle with old method : 0.00040459632873535156 time for calcul the mask position with numpy : 0.017802715301513672 nb_pixel_total : 1961 time to create 1 rle with old method : 0.0022308826446533203 time for calcul the mask position with numpy : 0.014671564102172852 nb_pixel_total : 1157 time to create 1 rle with old method : 0.001313924789428711 time for calcul the mask position with numpy : 0.014586448669433594 nb_pixel_total : 747 time to create 1 rle with old method : 0.001089334487915039 time for calcul the mask position with numpy : 0.014709949493408203 nb_pixel_total : 1720 time to create 1 rle with old method : 0.0018718242645263672 time for calcul the mask position with numpy : 0.014664888381958008 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005004405975341797 time for calcul the mask position with numpy : 0.014735221862792969 nb_pixel_total : 1039 time to create 1 rle with old method : 0.0011696815490722656 time for calcul the mask position with numpy : 0.014374494552612305 nb_pixel_total : 3270 time to create 1 rle with old method : 0.003659486770629883 time for calcul the mask position with numpy : 0.014800786972045898 nb_pixel_total : 1073 time to create 1 rle with old method : 0.0012485980987548828 time for calcul the mask position with numpy : 0.014599084854125977 nb_pixel_total : 2394 time to create 1 rle with old method : 0.0026764869689941406 time for calcul the mask position with numpy : 0.014539003372192383 nb_pixel_total : 3280 time to create 1 rle with old method : 0.003563404083251953 time for calcul the mask position with numpy : 0.014713764190673828 nb_pixel_total : 661 time to create 1 rle with old method : 0.0007567405700683594 time for calcul the mask position with numpy : 0.014461755752563477 nb_pixel_total : 4961 time to create 1 rle with old method : 0.00557255744934082 time for calcul the mask position with numpy : 0.014568090438842773 nb_pixel_total : 3093 time to create 1 rle with old method : 0.0032701492309570312 time for calcul the mask position with numpy : 0.01442265510559082 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0011432170867919922 time for calcul the mask position with numpy : 0.014330625534057617 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006031990051269531 time for calcul the mask position with numpy : 0.01455235481262207 nb_pixel_total : 330 time to create 1 rle with old method : 0.0003504753112792969 time for calcul the mask position with numpy : 0.014346122741699219 nb_pixel_total : 4033 time to create 1 rle with old method : 0.004389762878417969 time for calcul the mask position with numpy : 0.014348506927490234 nb_pixel_total : 1740 time to create 1 rle with old method : 0.0019524097442626953 time for calcul the mask position with numpy : 0.014000415802001953 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003190040588378906 time for calcul the mask position with numpy : 0.013914823532104492 nb_pixel_total : 1136 time to create 1 rle with old method : 0.0011789798736572266 time for calcul the mask position with numpy : 0.013962984085083008 nb_pixel_total : 505 time to create 1 rle with old method : 0.0005373954772949219 time for calcul the mask position with numpy : 0.013919591903686523 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005154609680175781 time for calcul the mask position with numpy : 0.014275789260864258 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005598068237304688 time for calcul the mask position with numpy : 0.01390528678894043 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004451274871826172 time for calcul the mask position with numpy : 0.01455998420715332 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007081031799316406 time for calcul the mask position with numpy : 0.014920473098754883 nb_pixel_total : 1537 time to create 1 rle with old method : 0.001734018325805664 time for calcul the mask position with numpy : 0.014966011047363281 nb_pixel_total : 640 time to create 1 rle with old method : 0.0008258819580078125 time for calcul the mask position with numpy : 0.01634049415588379 nb_pixel_total : 5381 time to create 1 rle with old method : 0.006127357482910156 time for calcul the mask position with numpy : 0.014996767044067383 nb_pixel_total : 1086 time to create 1 rle with old method : 0.0012633800506591797 time for calcul the mask position with numpy : 0.015294790267944336 nb_pixel_total : 28 time to create 1 rle with old method : 5.745887756347656e-05 time for calcul the mask position with numpy : 0.014972686767578125 nb_pixel_total : 67244 time to create 1 rle with old method : 0.07435250282287598 time for calcul the mask position with numpy : 0.014508485794067383 nb_pixel_total : 32 time to create 1 rle with old method : 5.245208740234375e-05 time for calcul the mask position with numpy : 0.014587163925170898 nb_pixel_total : 96 time to create 1 rle with old method : 0.00010776519775390625 time for calcul the mask position with numpy : 0.014611959457397461 nb_pixel_total : 37374 time to create 1 rle with old method : 0.040320634841918945 time for calcul the mask position with numpy : 0.014538764953613281 nb_pixel_total : 945 time to create 1 rle with old method : 0.0010781288146972656 time for calcul the mask position with numpy : 0.014693737030029297 nb_pixel_total : 256 time to create 1 rle with old method : 0.0002727508544921875 time for calcul the mask position with numpy : 0.01459503173828125 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.014780044555664062 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0011060237884521484 time for calcul the mask position with numpy : 0.014918804168701172 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003020763397216797 time for calcul the mask position with numpy : 0.014878988265991211 nb_pixel_total : 139 time to create 1 rle with old method : 0.00019216537475585938 time for calcul the mask position with numpy : 0.014375686645507812 nb_pixel_total : 527 time to create 1 rle with old method : 0.0009219646453857422 time for calcul the mask position with numpy : 0.014859676361083984 nb_pixel_total : 302 time to create 1 rle with old method : 0.0003478527069091797 time for calcul the mask position with numpy : 0.014483928680419922 nb_pixel_total : 6396 time to create 1 rle with old method : 0.006892681121826172 time for calcul the mask position with numpy : 0.014870166778564453 nb_pixel_total : 855 time to create 1 rle with old method : 0.0012176036834716797 create new chi : 4.03724479675293 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.015522003173828125 batch 1 Loaded 180 chid ids of type : 4230 Number RLEs to save : 20259 TO DO : save crop sub photo not yet done ! save time : 12.491432666778564 nb_obj : 131 nb_hashtags : 4 time to prepare the origin masks : 4.079474449157715 time for calcul the mask position with numpy : 0.07007479667663574 nb_pixel_total : 3400900 time to create 1 rle with new method : 0.1340656280517578 time for calcul the mask position with numpy : 0.012034177780151367 nb_pixel_total : 84 time to create 1 rle with old method : 0.00011515617370605469 time for calcul the mask position with numpy : 0.011827468872070312 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004169940948486328 time for calcul the mask position with numpy : 0.011304855346679688 nb_pixel_total : 267 time to create 1 rle with old method : 0.00032973289489746094 time for calcul the mask position with numpy : 0.011943340301513672 nb_pixel_total : 211 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.011727094650268555 nb_pixel_total : 625 time to create 1 rle with old method : 0.0007255077362060547 time for calcul the mask position with numpy : 0.011471033096313477 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005154609680175781 time for calcul the mask position with numpy : 0.010961294174194336 nb_pixel_total : 367 time to create 1 rle with old method : 0.0004241466522216797 time for calcul the mask position with numpy : 0.011101961135864258 nb_pixel_total : 284 time to create 1 rle with old method : 0.00034117698669433594 time for calcul the mask position with numpy : 0.012087583541870117 nb_pixel_total : 421 time to create 1 rle with old method : 0.0004837512969970703 time for calcul the mask position with numpy : 0.011339187622070312 nb_pixel_total : 737 time to create 1 rle with old method : 0.0008373260498046875 time for calcul the mask position with numpy : 0.011484861373901367 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001575946807861328 time for calcul the mask position with numpy : 0.01125478744506836 nb_pixel_total : 238 time to create 1 rle with old method : 0.00032901763916015625 time for calcul the mask position with numpy : 0.011075019836425781 nb_pixel_total : 750 time to create 1 rle with old method : 0.0008497238159179688 time for calcul the mask position with numpy : 0.011186838150024414 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002751350402832031 time for calcul the mask position with numpy : 0.011741161346435547 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005197525024414062 time for calcul the mask position with numpy : 0.021799564361572266 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003418922424316406 time for calcul the mask position with numpy : 0.020763397216796875 nb_pixel_total : 1747 time to create 1 rle with old method : 0.0027451515197753906 time for calcul the mask position with numpy : 0.019008874893188477 nb_pixel_total : 383 time to create 1 rle with old method : 0.0006718635559082031 time for calcul the mask position with numpy : 0.01812267303466797 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005793571472167969 time for calcul the mask position with numpy : 0.0137786865234375 nb_pixel_total : 12 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.013705968856811523 nb_pixel_total : 799 time to create 1 rle with old method : 0.0013442039489746094 time for calcul the mask position with numpy : 0.015158891677856445 nb_pixel_total : 241 time to create 1 rle with old method : 0.00045371055603027344 time for calcul the mask position with numpy : 0.01346278190612793 nb_pixel_total : 1484 time to create 1 rle with old method : 0.0026161670684814453 time for calcul the mask position with numpy : 0.012822628021240234 nb_pixel_total : 631 time to create 1 rle with old method : 0.0011260509490966797 time for calcul the mask position with numpy : 0.012041330337524414 nb_pixel_total : 247 time to create 1 rle with old method : 0.00046181678771972656 time for calcul the mask position with numpy : 0.011868476867675781 nb_pixel_total : 427 time to create 1 rle with old method : 0.0007181167602539062 time for calcul the mask position with numpy : 0.01194453239440918 nb_pixel_total : 185 time to create 1 rle with old method : 0.0003414154052734375 time for calcul the mask position with numpy : 0.011917829513549805 nb_pixel_total : 374 time to create 1 rle with old method : 0.0006251335144042969 time for calcul the mask position with numpy : 0.012514591217041016 nb_pixel_total : 297 time to create 1 rle with old method : 0.0005359649658203125 time for calcul the mask position with numpy : 0.01293182373046875 nb_pixel_total : 2281 time to create 1 rle with old method : 0.004046440124511719 time for calcul the mask position with numpy : 0.013878107070922852 nb_pixel_total : 2052 time to create 1 rle with old method : 0.003641366958618164 time for calcul the mask position with numpy : 0.014786243438720703 nb_pixel_total : 1180 time to create 1 rle with old method : 0.002087831497192383 time for calcul the mask position with numpy : 0.014173030853271484 nb_pixel_total : 131 time to create 1 rle with old method : 0.0002818107604980469 time for calcul the mask position with numpy : 0.01376485824584961 nb_pixel_total : 1339 time to create 1 rle with old method : 0.002535104751586914 time for calcul the mask position with numpy : 0.013464927673339844 nb_pixel_total : 1059 time to create 1 rle with old method : 0.0019419193267822266 time for calcul the mask position with numpy : 0.014438152313232422 nb_pixel_total : 133 time to create 1 rle with old method : 0.00035452842712402344 time for calcul the mask position with numpy : 0.013265371322631836 nb_pixel_total : 516 time to create 1 rle with old method : 0.0009868144989013672 time for calcul the mask position with numpy : 0.01401972770690918 nb_pixel_total : 338 time to create 1 rle with old method : 0.0006449222564697266 time for calcul the mask position with numpy : 0.013869047164916992 nb_pixel_total : 2427 time to create 1 rle with old method : 0.004411935806274414 time for calcul the mask position with numpy : 0.014098882675170898 nb_pixel_total : 1226 time to create 1 rle with old method : 0.002317190170288086 time for calcul the mask position with numpy : 0.01349496841430664 nb_pixel_total : 25 time to create 1 rle with old method : 8.130073547363281e-05 time for calcul the mask position with numpy : 0.014350175857543945 nb_pixel_total : 431 time to create 1 rle with old method : 0.0007536411285400391 time for calcul the mask position with numpy : 0.014202356338500977 nb_pixel_total : 943 time to create 1 rle with old method : 0.006568193435668945 time for calcul the mask position with numpy : 0.015260934829711914 nb_pixel_total : 184 time to create 1 rle with old method : 0.0003857612609863281 time for calcul the mask position with numpy : 0.015638351440429688 nb_pixel_total : 345 time to create 1 rle with old method : 0.0006229877471923828 time for calcul the mask position with numpy : 0.014772891998291016 nb_pixel_total : 588 time to create 1 rle with old method : 0.0011415481567382812 time for calcul the mask position with numpy : 0.013972997665405273 nb_pixel_total : 308 time to create 1 rle with old method : 0.0006387233734130859 time for calcul the mask position with numpy : 0.014426469802856445 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0023789405822753906 time for calcul the mask position with numpy : 0.013968706130981445 nb_pixel_total : 2035 time to create 1 rle with old method : 0.003736734390258789 time for calcul the mask position with numpy : 0.011384010314941406 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0016107559204101562 time for calcul the mask position with numpy : 0.011020898818969727 nb_pixel_total : 315 time to create 1 rle with old method : 0.00037360191345214844 time for calcul the mask position with numpy : 0.011197090148925781 nb_pixel_total : 6922 time to create 1 rle with old method : 0.007829904556274414 time for calcul the mask position with numpy : 0.011465787887573242 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005471706390380859 time for calcul the mask position with numpy : 0.011053323745727539 nb_pixel_total : 369 time to create 1 rle with old method : 0.0004372596740722656 time for calcul the mask position with numpy : 0.011192560195922852 nb_pixel_total : 1923 time to create 1 rle with old method : 0.0021729469299316406 time for calcul the mask position with numpy : 0.011229515075683594 nb_pixel_total : 978 time to create 1 rle with old method : 0.0011320114135742188 time for calcul the mask position with numpy : 0.011757135391235352 nb_pixel_total : 8212 time to create 1 rle with old method : 0.010870695114135742 time for calcul the mask position with numpy : 0.01144862174987793 nb_pixel_total : 512 time to create 1 rle with old method : 0.0005986690521240234 time for calcul the mask position with numpy : 0.011661767959594727 nb_pixel_total : 2211 time to create 1 rle with old method : 0.0025331974029541016 time for calcul the mask position with numpy : 0.011976003646850586 nb_pixel_total : 211 time to create 1 rle with old method : 0.00025963783264160156 time for calcul the mask position with numpy : 0.012577533721923828 nb_pixel_total : 1545 time to create 1 rle with old method : 0.001722097396850586 time for calcul the mask position with numpy : 0.012375593185424805 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006148815155029297 time for calcul the mask position with numpy : 0.011294841766357422 nb_pixel_total : 1755 time to create 1 rle with old method : 0.002090930938720703 time for calcul the mask position with numpy : 0.01170969009399414 nb_pixel_total : 1472 time to create 1 rle with old method : 0.0017092227935791016 time for calcul the mask position with numpy : 0.01132345199584961 nb_pixel_total : 4857 time to create 1 rle with old method : 0.005563974380493164 time for calcul the mask position with numpy : 0.01097249984741211 nb_pixel_total : 849 time to create 1 rle with old method : 0.001079559326171875 time for calcul the mask position with numpy : 0.011610984802246094 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005147457122802734 time for calcul the mask position with numpy : 0.010999202728271484 nb_pixel_total : 1775 time to create 1 rle with old method : 0.0020341873168945312 time for calcul the mask position with numpy : 0.01120901107788086 nb_pixel_total : 3418 time to create 1 rle with old method : 0.0038619041442871094 time for calcul the mask position with numpy : 0.011100053787231445 nb_pixel_total : 3516 time to create 1 rle with old method : 0.004235029220581055 time for calcul the mask position with numpy : 0.010759353637695312 nb_pixel_total : 1232 time to create 1 rle with old method : 0.001508474349975586 time for calcul the mask position with numpy : 0.010963201522827148 nb_pixel_total : 1484 time to create 1 rle with old method : 0.0018203258514404297 time for calcul the mask position with numpy : 0.01323080062866211 nb_pixel_total : 852 time to create 1 rle with old method : 0.0012178421020507812 time for calcul the mask position with numpy : 0.012394428253173828 nb_pixel_total : 45 time to create 1 rle with old method : 8.034706115722656e-05 time for calcul the mask position with numpy : 0.011645317077636719 nb_pixel_total : 1511 time to create 1 rle with old method : 0.0018208026885986328 time for calcul the mask position with numpy : 0.01282954216003418 nb_pixel_total : 443 time to create 1 rle with old method : 0.0007631778717041016 time for calcul the mask position with numpy : 0.011370420455932617 nb_pixel_total : 87 time to create 1 rle with old method : 0.00016927719116210938 time for calcul the mask position with numpy : 0.011810302734375 nb_pixel_total : 149 time to create 1 rle with old method : 0.00019407272338867188 time for calcul the mask position with numpy : 0.011577606201171875 nb_pixel_total : 63 time to create 1 rle with old method : 9.72747802734375e-05 time for calcul the mask position with numpy : 0.011454105377197266 nb_pixel_total : 776 time to create 1 rle with old method : 0.0009286403656005859 time for calcul the mask position with numpy : 0.015630006790161133 nb_pixel_total : 7542 time to create 1 rle with old method : 0.008566856384277344 time for calcul the mask position with numpy : 0.012444734573364258 nb_pixel_total : 54976 time to create 1 rle with old method : 0.06072211265563965 time for calcul the mask position with numpy : 0.010854482650756836 nb_pixel_total : 5439 time to create 1 rle with old method : 0.006385087966918945 time for calcul the mask position with numpy : 0.010972738265991211 nb_pixel_total : 17 time to create 1 rle with old method : 6.008148193359375e-05 time for calcul the mask position with numpy : 0.011551856994628906 nb_pixel_total : 328 time to create 1 rle with old method : 0.00038933753967285156 time for calcul the mask position with numpy : 0.011725425720214844 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003440380096435547 time for calcul the mask position with numpy : 0.01746392250061035 nb_pixel_total : 415 time to create 1 rle with old method : 0.00048613548278808594 time for calcul the mask position with numpy : 0.020807981491088867 nb_pixel_total : 15 time to create 1 rle with old method : 6.508827209472656e-05 time for calcul the mask position with numpy : 0.022678375244140625 nb_pixel_total : 130 time to create 1 rle with old method : 0.0003154277801513672 time for calcul the mask position with numpy : 0.02329421043395996 nb_pixel_total : 10553 time to create 1 rle with old method : 0.017754077911376953 time for calcul the mask position with numpy : 0.019350528717041016 nb_pixel_total : 944 time to create 1 rle with old method : 0.0016913414001464844 time for calcul the mask position with numpy : 0.023545503616333008 nb_pixel_total : 339 time to create 1 rle with old method : 0.0004889965057373047 time for calcul the mask position with numpy : 0.019928693771362305 nb_pixel_total : 2386 time to create 1 rle with old method : 0.0029115676879882812 time for calcul the mask position with numpy : 0.01898479461669922 nb_pixel_total : 69 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.018706798553466797 nb_pixel_total : 266 time to create 1 rle with old method : 0.00034117698669433594 time for calcul the mask position with numpy : 0.019918441772460938 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004191398620605469 time for calcul the mask position with numpy : 0.02165532112121582 nb_pixel_total : 16267 time to create 1 rle with old method : 0.020328521728515625 time for calcul the mask position with numpy : 0.0206296443939209 nb_pixel_total : 37 time to create 1 rle with old method : 0.00011038780212402344 time for calcul the mask position with numpy : 0.020533323287963867 nb_pixel_total : 1120 time to create 1 rle with old method : 0.0014569759368896484 time for calcul the mask position with numpy : 0.02033853530883789 nb_pixel_total : 718 time to create 1 rle with old method : 0.0009832382202148438 time for calcul the mask position with numpy : 0.025526046752929688 nb_pixel_total : 341 time to create 1 rle with old method : 0.0007576942443847656 time for calcul the mask position with numpy : 0.024134159088134766 nb_pixel_total : 2490 time to create 1 rle with old method : 0.003461122512817383 time for calcul the mask position with numpy : 0.022978782653808594 nb_pixel_total : 2304 time to create 1 rle with old method : 0.0030994415283203125 time for calcul the mask position with numpy : 0.022183656692504883 nb_pixel_total : 1026 time to create 1 rle with old method : 0.001295328140258789 time for calcul the mask position with numpy : 0.015009880065917969 nb_pixel_total : 3466 time to create 1 rle with old method : 0.004160165786743164 time for calcul the mask position with numpy : 0.012596607208251953 nb_pixel_total : 692 time to create 1 rle with old method : 0.0008540153503417969 time for calcul the mask position with numpy : 0.012000799179077148 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003540515899658203 time for calcul the mask position with numpy : 0.011351823806762695 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007002353668212891 time for calcul the mask position with numpy : 0.010885238647460938 nb_pixel_total : 544 time to create 1 rle with old method : 0.000762939453125 time for calcul the mask position with numpy : 0.010561704635620117 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004622936248779297 time for calcul the mask position with numpy : 0.01146245002746582 nb_pixel_total : 982 time to create 1 rle with old method : 0.001111745834350586 time for calcul the mask position with numpy : 0.010635852813720703 nb_pixel_total : 3462 time to create 1 rle with old method : 0.0038928985595703125 time for calcul the mask position with numpy : 0.010593652725219727 nb_pixel_total : 249 time to create 1 rle with old method : 0.0002791881561279297 time for calcul the mask position with numpy : 0.010540008544921875 nb_pixel_total : 1158 time to create 1 rle with old method : 0.0012538433074951172 time for calcul the mask position with numpy : 0.011179208755493164 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002422332763671875 time for calcul the mask position with numpy : 0.010990381240844727 nb_pixel_total : 577 time to create 1 rle with old method : 0.0006723403930664062 time for calcul the mask position with numpy : 0.01054239273071289 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005545616149902344 time for calcul the mask position with numpy : 0.010445356369018555 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005612373352050781 time for calcul the mask position with numpy : 0.010756969451904297 nb_pixel_total : 1421 time to create 1 rle with old method : 0.0015256404876708984 time for calcul the mask position with numpy : 0.010570049285888672 nb_pixel_total : 6144 time to create 1 rle with old method : 0.0068628787994384766 time for calcul the mask position with numpy : 0.010831594467163086 nb_pixel_total : 943 time to create 1 rle with old method : 0.0010857582092285156 time for calcul the mask position with numpy : 0.011293649673461914 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003464221954345703 time for calcul the mask position with numpy : 0.011824369430541992 nb_pixel_total : 69308 time to create 1 rle with old method : 0.07916378974914551 time for calcul the mask position with numpy : 0.011797189712524414 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002722740173339844 time for calcul the mask position with numpy : 0.013374805450439453 nb_pixel_total : 1155 time to create 1 rle with old method : 0.0015838146209716797 time for calcul the mask position with numpy : 0.013093948364257812 nb_pixel_total : 983 time to create 1 rle with old method : 0.001405954360961914 time for calcul the mask position with numpy : 0.014771223068237305 nb_pixel_total : 14 time to create 1 rle with old method : 7.343292236328125e-05 time for calcul the mask position with numpy : 0.013538122177124023 nb_pixel_total : 247 time to create 1 rle with old method : 0.00030303001403808594 time for calcul the mask position with numpy : 0.011869192123413086 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002810955047607422 time for calcul the mask position with numpy : 0.012269258499145508 nb_pixel_total : 85 time to create 1 rle with old method : 0.00012803077697753906 time for calcul the mask position with numpy : 0.01190495491027832 nb_pixel_total : 776 time to create 1 rle with old method : 0.0008959770202636719 create new chi : 2.366220235824585 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0017993450164794922 batch 1 Loaded 132 chid ids of type : 4230 Number RLEs to save : 14083 TO DO : save crop sub photo not yet done ! save time : 0.9881420135498047 map_output_result : {1340727074: (0.0, 'Should be the crop_list due to order', 0.0), 1340724365: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340727074, 1340724365] Looping around the photos to save general results len do output : 2 /1340727074.Didn't retrieve data . /1340724365.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340727074', None, None, None, None, None, '2631148') ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340724365', None, None, None, None, None, '2631148') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015383005142211914 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.59372615814209 time spend to save output : 0.015577316284179688 total time spend for step 4 : 26.60930347442627 step5:crop_condition Tue Mar 4 04:21:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 312 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 175 About to insert : list_path_to_insert length 175 new photo from crops ! About to upload 175 photos upload in portfolio : 4869462 init cache_photo without model_param we have 175 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741058493_1679606 we have uploaded 175 photos in the portfolio 4869462 time of upload the photos Elapsed time : 44.347100019454956 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 4869462 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741058538_1679606 we have uploaded 35 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.675013303756714 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741058550_1679606 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.6261019706726074 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 4869462 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741058553_1679606 we have uploaded 18 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.865720748901367 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 4869462 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741058558_1679606 we have uploaded 10 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.269343614578247 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741058562_1679606 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6482522487640381 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340727074, 1340724365] Looping around the photos to save general results len do output : 241 /1340729536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340729958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340727074', None, None, None, None, None, '2631148') ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340724365', None, None, None, None, None, '2631148') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 725 time used for this insertion : 0.04896068572998047 save_final save missing photos in datou_result : time spend for datou_step_exec : 73.43437600135803 time spend to save output : 0.05542182922363281 total time spend for step 5 : 73.48979783058167 step6:thcl Tue Mar 4 04:22:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.014570236206054688 time to convert the images to numpy array : 0.0742030143737793 time to import caffe and check if the image exist : 0.014897346496582031 time to convert the images to numpy array : 0.07699108123779297 time to import caffe and check if the image exist : 0.0246734619140625 time to convert the images to numpy array : 0.0755302906036377 time to import caffe and check if the image exist : 0.015410661697387695 time to convert the images to numpy array : 0.08564901351928711 time to import caffe and check if the image exist : 0.02010631561279297 time to convert the images to numpy array : 0.08443140983581543 time to import caffe and check if the image exist : 0.027689695358276367 time to convert the images to numpy array : 0.07787442207336426 time to import caffe and check if the image exist : 0.036478281021118164 time to convert the images to numpy array : 0.07120847702026367 time to import caffe and check if the image exist : 0.018403291702270508 time to convert the images to numpy array : 0.08920145034790039 time to import caffe and check if the image exist : 0.022713661193847656 time to convert the images to numpy array : 0.08730340003967285 time to import caffe and check if the image exist : 0.019736289978027344 time to convert the images to numpy array : 0.0910186767578125 total time to convert the images to numpy array : 0.34850001335144043 list photo_ids error: [] list photo_ids correct : [1340729925, 1340729926, 1340729927, 1340729928, 1340729929, 1340729943, 1340729944, 1340729946, 1340729947, 1340729948, 1340729949, 1340729951, 1340729953, 1340729954, 1340729955, 1340729958, 1340729680, 1340729682, 1340729684, 1340729686, 1340729688, 1340729690, 1340729692, 1340729694, 1340729696, 1340729698, 1340729700, 1340729702, 1340729704, 1340729706, 1340729708, 1340729710, 1340729712, 1340729714, 1340729716, 1340729718, 1340729720, 1340729722, 1340729724, 1340729726, 1340729728, 1340729831, 1340729832, 1340729833, 1340729834, 1340729835, 1340729836, 1340729837, 1340729838, 1340729839, 1340729840, 1340729841, 1340729842, 1340729843, 1340729844, 1340729845, 1340729846, 1340729847, 1340729849, 1340729850, 1340729851, 1340729852, 1340729853, 1340729854, 1340729855, 1340729856, 1340729611, 1340729612, 1340729613, 1340729614, 1340729615, 1340729616, 1340729617, 1340729618, 1340729619, 1340729620, 1340729621, 1340729622, 1340729623, 1340729624, 1340729625, 1340729626, 1340729627, 1340729628, 1340729629, 1340729630, 1340729631, 1340729632, 1340729633, 1340729634, 1340729635, 1340729561, 1340729562, 1340729563, 1340729564, 1340729565, 1340729566, 1340729567, 1340729568, 1340729569, 1340729570, 1340729571, 1340729572, 1340729573, 1340729574, 1340729575, 1340729576, 1340729577, 1340729578, 1340729579, 1340729580, 1340729581, 1340729582, 1340729583, 1340729584, 1340729585, 1340729586, 1340729587, 1340729588, 1340729589, 1340729590, 1340729591, 1340729592, 1340729593, 1340729594, 1340729595, 1340729596, 1340729597, 1340729598, 1340729599, 1340729600, 1340729601, 1340729602, 1340729603, 1340729604, 1340729605, 1340729606, 1340729607, 1340729608, 1340729609, 1340729610, 1340729730, 1340729732, 1340729734, 1340729736, 1340729738, 1340729740, 1340729742, 1340729744, 1340729746, 1340729748, 1340729750, 1340729752, 1340729754, 1340729756, 1340729758, 1340729760, 1340729762, 1340729764, 1340729766, 1340729768, 1340729770, 1340729772, 1340729774, 1340729776, 1340729778, 1340729857, 1340729859, 1340729861, 1340729863, 1340729865, 1340729867, 1340729868, 1340729870, 1340729872, 1340729874, 1340729886, 1340729887, 1340729910, 1340729911, 1340729912, 1340729914, 1340729915, 1340729916, 1340729917, 1340729918, 1340729919, 1340729920, 1340729921, 1340729922, 1340729924, 1340729636, 1340729637, 1340729638, 1340729639, 1340729640, 1340729641, 1340729642, 1340729644, 1340729646, 1340729648, 1340729650, 1340729652, 1340729654, 1340729656, 1340729658, 1340729660, 1340729662, 1340729664, 1340729666, 1340729668, 1340729670, 1340729672, 1340729674, 1340729676, 1340729678, 1340729536, 1340729537, 1340729538, 1340729539, 1340729540, 1340729541, 1340729542, 1340729543, 1340729544, 1340729545, 1340729546, 1340729547, 1340729548, 1340729549, 1340729550, 1340729551, 1340729552, 1340729553, 1340729554, 1340729555, 1340729556, 1340729557, 1340729558, 1340729559, 1340729560] number of photos to traite : 241 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10595 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.1463673114776611 time used to do the prediction : 0.931419849395752 save descriptor for thcl : 3237 time to traite the descriptors : 1.4174730777740479 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340729925 To insert : 1340729926 To insert : 1340729927 To insert : 1340729928 To insert : 1340729929 To insert : 1340729943 To insert : 1340729944 To insert : 1340729946 To insert : 1340729947 To insert : 1340729948 To insert : 1340729949 To insert : 1340729951 To insert : 1340729953 To insert : 1340729954 To insert : 1340729955 To insert : 1340729958 To insert : 1340729680 To insert : 1340729682 To insert : 1340729684 To insert : 1340729686 To insert : 1340729688 To insert : 1340729690 To insert : 1340729692 To insert : 1340729694 To insert : 1340729696 To insert : 1340729698 To insert : 1340729700 To insert : 1340729702 To insert : 1340729704 To insert : 1340729706 To insert : 1340729708 To insert : 1340729710 To insert : 1340729712 To insert : 1340729714 To insert : 1340729716 To insert : 1340729718 To insert : 1340729720 To insert : 1340729722 To insert : 1340729724 To insert : 1340729726 To insert : 1340729728 To insert : 1340729831 To insert : 1340729832 To insert : 1340729833 To insert : 1340729834 To insert : 1340729835 To insert : 1340729836 To insert : 1340729837 To insert : 1340729838 To insert : 1340729839 To insert : 1340729840 To insert : 1340729841 To insert : 1340729842 To insert : 1340729843 To insert : 1340729844 To insert : 1340729845 To insert : 1340729846 To insert : 1340729847 To insert : 1340729849 To insert : 1340729850 To insert : 1340729851 To insert : 1340729852 To insert : 1340729853 To insert : 1340729854 To insert : 1340729855 To insert : 1340729856 To insert : 1340729611 To insert : 1340729612 To insert : 1340729613 To insert : 1340729614 To insert : 1340729615 To insert : 1340729616 To insert : 1340729617 To insert : 1340729618 To insert : 1340729619 To insert : 1340729620 To insert : 1340729621 To insert : 1340729622 To insert : 1340729623 To insert : 1340729624 To insert : 1340729625 To insert : 1340729626 To insert : 1340729627 To insert : 1340729628 To insert : 1340729629 To insert : 1340729630 To insert : 1340729631 To insert : 1340729632 To insert : 1340729633 To insert : 1340729634 To insert : 1340729635 To insert : 1340729561 To insert : 1340729562 To insert : 1340729563 To insert : 1340729564 To insert : 1340729565 To insert : 1340729566 To insert : 1340729567 To insert : 1340729568 To insert : 1340729569 To insert : 1340729570 To insert : 1340729571 To insert : 1340729572 To insert : 1340729573 To insert : 1340729574 To insert : 1340729575 To insert : 1340729576 To insert : 1340729577 To insert : 1340729578 To insert : 1340729579 To insert : 1340729580 To insert : 1340729581 To insert : 1340729582 To insert : 1340729583 To insert : 1340729584 To insert : 1340729585 To insert : 1340729586 To insert : 1340729587 To insert : 1340729588 To insert : 1340729589 To insert : 1340729590 To insert : 1340729591 To insert : 1340729592 To insert : 1340729593 To insert : 1340729594 To insert : 1340729595 To insert : 1340729596 To insert : 1340729597 To insert : 1340729598 To insert : 1340729599 To insert : 1340729600 To insert : 1340729601 To insert : 1340729602 To insert : 1340729603 To insert : 1340729604 To insert : 1340729605 To insert : 1340729606 To insert : 1340729607 To insert : 1340729608 To insert : 1340729609 To insert : 1340729610 To insert : 1340729730 To insert : 1340729732 To insert : 1340729734 To insert : 1340729736 To insert : 1340729738 To insert : 1340729740 To insert : 1340729742 To insert : 1340729744 To insert : 1340729746 To insert : 1340729748 To insert : 1340729750 To insert : 1340729752 To insert : 1340729754 To insert : 1340729756 To insert : 1340729758 To insert : 1340729760 To insert : 1340729762 To insert : 1340729764 To insert : 1340729766 To insert : 1340729768 To insert : 1340729770 To insert : 1340729772 To insert : 1340729774 To insert : 1340729776 To insert : 1340729778 To insert : 1340729857 To insert : 1340729859 To insert : 1340729861 To insert : 1340729863 To insert : 1340729865 To insert : 1340729867 To insert : 1340729868 To insert : 1340729870 To insert : 1340729872 To insert : 1340729874 To insert : 1340729886 To insert : 1340729887 To insert : 1340729910 To insert : 1340729911 To insert : 1340729912 To insert : 1340729914 To insert : 1340729915 To insert : 1340729916 To insert : 1340729917 To insert : 1340729918 To insert : 1340729919 To insert : 1340729920 To insert : 1340729921 To insert : 1340729922 To insert : 1340729924 To insert : 1340729636 To insert : 1340729637 To insert : 1340729638 To insert : 1340729639 To insert : 1340729640 To insert : 1340729641 To insert : 1340729642 To insert : 1340729644 To insert : 1340729646 To insert : 1340729648 To insert : 1340729650 To insert : 1340729652 To insert : 1340729654 To insert : 1340729656 To insert : 1340729658 To insert : 1340729660 To insert : 1340729662 To insert : 1340729664 To insert : 1340729666 To insert : 1340729668 To insert : 1340729670 To insert : 1340729672 To insert : 1340729674 To insert : 1340729676 To insert : 1340729678 To insert : 1340729536 To insert : 1340729537 To insert : 1340729538 To insert : 1340729539 To insert : 1340729540 To insert : 1340729541 To insert : 1340729542 To insert : 1340729543 To insert : 1340729544 To insert : 1340729545 To insert : 1340729546 To insert : 1340729547 To insert : 1340729548 To insert : 1340729549 To insert : 1340729550 To insert : 1340729551 To insert : 1340729552 To insert : 1340729553 To insert : 1340729554 To insert : 1340729555 To insert : 1340729556 To insert : 1340729557 To insert : 1340729558 To insert : 1340729559 To insert : 1340729560 time to insert the descriptors : 43.36198043823242 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 354 time used for this insertion : 0.04673123359680176 save missing photos in datou_result : time spend for datou_step_exec : 51.167598485946655 time spend to save output : 0.09514999389648438 total time spend for step 6 : 51.26274847984314 step7:ventilate_hashtags_in_portfolio Tue Mar 4 04:23:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20997554 get user id for portfolio 20997554 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20997554 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_clair','pet_fonce','pehd','PEHD','Film_plastique','mal_croppe','pet_clair','flou','environnement','autre','refus','papier','metal','PET_fonce','Papier','carton','Tetrapak','Carton')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20997554 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_clair','pet_fonce','pehd','PEHD','Film_plastique','mal_croppe','pet_clair','flou','environnement','autre','refus','papier','metal','PET_fonce','Papier','carton','Tetrapak','Carton')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20997554 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_clair','pet_fonce','pehd','PEHD','Film_plastique','mal_croppe','pet_clair','flou','environnement','autre','refus','papier','metal','PET_fonce','Papier','carton','Tetrapak','Carton')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20997554 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_clair','pet_fonce','pehd','PEHD','Film_plastique','mal_croppe','pet_clair','flou','environnement','autre','refus','papier','metal','PET_fonce','Papier','carton','Tetrapak','Carton')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20997924,20997931,20997921,20997922,20997923,20997925,20997926,20997927,20997928,20997932,20997930,20997935,20997934?tags=pet_clair,pet_fonce,pehd,film_plastique,mal_croppe,flou,environnement,autre,refus,papier,metal,carton,tetrapak&datou_id_consolidate=4235&port_consolidate=20997554 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340727074, 1340724365] Looping around the photos to save general results len do output : 1 /20997554. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340727074', None, None, None, None, None, '2631148') ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340724365', None, None, None, None, None, '2631148') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.020253896713256836 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.7940151691436768 time spend to save output : 0.020596742630004883 total time spend for step 7 : 2.8146119117736816 step8:final Tue Mar 4 04:23:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340727074: ('0.8018356790551675',), 1340724365: ('0.8018356790551675',)} new output for save of step final : {1340727074: ('0.8018356790551675',), 1340724365: ('0.8018356790551675',)} [1340727074, 1340724365] Looping around the photos to save general results len do output : 2 /1340727074.Didn't retrieve data . /1340724365.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340727074', None, None, None, None, None, '2631148') ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340724365', None, None, None, None, None, '2631148') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014534950256347656 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11743450164794922 time spend to save output : 0.01474618911743164 total time spend for step 8 : 0.13218069076538086 step9:velours_tree Tue Mar 4 04:23:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20997924,20997931,20997921,20997922,20997923,20997925,20997926,20997927,20997928,20997932,20997930,20997935,20997934 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997924 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997931 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997921 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997922 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997923 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997925 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997926 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997927 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997928 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997932 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997930 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997935 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997934 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 241 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 1 0 1 1 0 0 1 2 0 2 0 2 0 1 2 2 0 2 4 0 0 0 4 2 2 4 1 2 2 0 0 1 1 1 0 2 0 2 2 5 2 1 5 2 3 3 5 2 5 2 5 2 1 5 2 2 3 0 1 2 1 5 3 1 3 1 2 0 5 3 3 3 5 0 0 1 2 1 1 3 3 4 1 1 0 2 0 1 1 2 3 1 1 1 2 4 1 1 4 1 3 4 1 4 2 1 0 1 0 2 1 2 2 2 2 2 2 4 0 0 0 4 2 2 1 4 1 1 2 3 1 2 5 0 0 2 2 2 1 2 3 5 2 1 5 1 1 2 1 1 1 2 1 2 2 3 1 0 4 0 1 2 0 1 1 1 2 1 1 1 1 1 1 4 0 4 1 1 1 2 1 3 5 2 1 2 2 1 0 3 3 1 1 4 1 1 4 1 2 2 3 1 5 1 1 3 1 1 1 0 0 0 2 0 5 2 4 1 5 2 4 2 2 5 5 5 0 0 2 4 0 2 1 1 2 2 0 3 2 4] Elapsed time: 0.03579521179199219 graph_id used : 81328 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20997924,20997931,20997921,20997922,20997923,20997925,20997926,20997927,20997928,20997932,20997930,20997935,20997934?tags=pet_clair,pet_fonce,pehd,film_plastique,mal_croppe,flou,environnement,autre,refus,papier,metal,carton,tetrapak&datou_id_consolidate=4235&port_consolidate=20997554&tree_id=81328 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340727074, 1340724365] Looping around the photos to save general results len do output : 1 /20997554Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340727074', None, None, None, None, None, '2631148') ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340724365', None, None, None, None, None, '2631148') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.023125171661376953 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.73520302772522 time spend to save output : 0.02345728874206543 total time spend for step 9 : 15.758660316467285 step10:send_mail_cod Tue Mar 4 04:23:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20997554_04-03-2025_04_23_52.pdf 20997906 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209979061741058632 20997913 change filename to text .imagette209979131741058633 20997903 imagette209979031741058633 20997904 imagette209979041741058633 20997905 imagette209979051741058633 20997907 imagette209979071741058633 20997909 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209979091741058633 20997910 imagette209979101741058634 20997914 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209979141741058634 20997912 change filename to text .change filename to text .imagette209979121741058635 20997917 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209979171741058635 20997916 imagette209979161741058636 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20997554 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20997924,20997931,20997921,20997922,20997923,20997925,20997926,20997927,20997928,20997932,20997930,20997935,20997934?tags=pet_clair,pet_fonce,pehd,film_plastique,mal_croppe,flou,environnement,autre,refus,papier,metal,carton,tetrapak&datou_id_consolidate=4235&port_consolidate=20997554&tree_id=81328 your option no_mail is active, we will not send the real mail to your client args[1340727074] : ((1340727074, -7.060200716111858, 492609224), (1340727074, 0.32267079955958405, 2107752395), '0.8018356790551675') We are sending mail with results at cod@fotonower.com args[1340724365] : ((1340724365, -6.348533795715609, 492609224), (1340724365, 0.3533888020676717, 2107752395), '0.8018356790551675') We are sending mail with results at cod@fotonower.com refus_total : 0.8018356790551675 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20997554 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20997554_04-03-2025_04_23_52.pdf results_Qualipapia_P20997554_04-03-2025_04_23_52.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20997554_04-03-2025_04_23_52.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20997554','results_Qualipapia_P20997554_04-03-2025_04_23_52.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20997554_04-03-2025_04_23_52.pdf','pdf','','0.17','0.8018356790551675') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340727074, 1340724365] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340727074', None, None, None, None, None, '2631148') ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340724365', None, None, None, None, None, '2631148') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.015978097915649414 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.315685033798218 time spend to save output : 0.016098499298095703 total time spend for step 10 : 4.3317835330963135 step11:split_time_score Tue Mar 4 04:23:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 04032025 20997554 Nombre de photos uploadées : 2 / 23040 (0%) 04032025 20997554 Nombre de photos taguées (types de déchets): 0 / 2 (0%) 04032025 20997554 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00017833709716796875 elapsed_time : insert_dashboard_record_day_entry 0.02190232276916504 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.7879451131457706 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20996346_04-03-2025_02_17_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20996346 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20996346 AND mptpi.`type`=4230 To do Qualite : 0.7988748458656145 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20996347_04-03-2025_02_19_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20996347 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20996347 AND mptpi.`type`=4230 To do Qualite : 0.7060747519362418 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20997068_04-03-2025_02_58_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20997068 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20997068 AND mptpi.`type`=4230 To do Qualite : 0.8018356790551675 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20997554_04-03-2025_04_23_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20997554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20997554 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'04032025': {'nb_upload': 2, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340727074, 1340724365] Looping around the photos to save general results len do output : 1 /20997554Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340727074', None, None, None, None, None, '2631148') ('4234', None, None, None, None, None, None, None, '2631148') ('4234', '20997554', '1340724365', None, None, None, None, None, '2631148') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.019572734832763672 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.4218626022338867 time spend to save output : 0.019741058349609375 total time spend for step 11 : 0.4416036605834961 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 49.46user 30.75system 3:31.80elapsed 37%CPU (0avgtext+0avgdata 4534120maxresident)k 6544inputs+20424outputs (113major+3918737minor)pagefaults 0swaps