python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 949903 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2626027'] with mtr_portfolio_ids : ['20947069'] and first list_photo_ids : [] new path : /proc/949903/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.31008219718933105 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Mar 1 07:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5525 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-01 07:20:33.718427: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-01 07:20:33.751158: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-01 07:20:33.753846: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5b08000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-01 07:20:33.753906: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-01 07:20:33.759784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-01 07:20:34.008544: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x204d3d80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-01 07:20:34.008599: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-01 07:20:34.010325: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 07:20:34.012238: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 07:20:34.049401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 07:20:34.072036: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 07:20:34.076149: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 07:20:34.114377: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 07:20:34.120151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 07:20:34.187004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 07:20:34.188851: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 07:20:34.189479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 07:20:34.191431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-01 07:20:34.191462: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-01 07:20:34.191477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-01 07:20:34.193176: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-01 07:20:34.586937: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 07:20:34.587027: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 07:20:34.587049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 07:20:34.587067: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 07:20:34.587085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 07:20:34.587102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 07:20:34.587120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 07:20:34.587137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 07:20:34.588312: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 07:20:34.589468: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 07:20:34.589502: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 07:20:34.589520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 07:20:34.589537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 07:20:34.589554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 07:20:34.589571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 07:20:34.589587: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 07:20:34.589604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 07:20:34.590768: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 07:20:34.590804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-01 07:20:34.590814: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-01 07:20:34.590824: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-01 07:20:34.592061: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-01 07:20:43.487337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 07:20:43.852901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.58672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0005056858062744141 length of segment : 19 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1412 time to create 1 rle with old method : 0.00247955322265625 length of segment : 51 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005855560302734375 length of segment : 20 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00033020973205566406 length of segment : 14 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.001489877700805664 length of segment : 34 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0005788803100585938 length of segment : 24 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0010564327239990234 length of segment : 29 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0006134510040283203 length of segment : 34 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 690 time to create 1 rle with old method : 0.0009136199951171875 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.18438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00028228759765625 length of segment : 17 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1160 time to create 1 rle with old method : 0.0015447139739990234 length of segment : 46 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005934238433837891 length of segment : 25 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004546642303466797 length of segment : 23 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004227161407470703 length of segment : 26 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003821849822998047 length of segment : 25 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00043392181396484375 length of segment : 12 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00019788742065429688 length of segment : 15 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0007007122039794922 length of segment : 51 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0009400844573974609 length of segment : 20 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 2715 time to create 1 rle with old method : 0.0032918453216552734 length of segment : 61 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0006470680236816406 length of segment : 56 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003790855407714844 length of segment : 13 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00016617774963378906 length of segment : 10 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0005612373352050781 length of segment : 26 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1747 time to create 1 rle with old method : 0.0023217201232910156 length of segment : 41 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.000244140625 length of segment : 15 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 2067 time to create 1 rle with old method : 0.002739429473876953 length of segment : 98 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 628 time to create 1 rle with old method : 0.0009205341339111328 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.82500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0003180503845214844 length of segment : 20 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0003476142883300781 length of segment : 19 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.000179290771484375 length of segment : 11 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0008308887481689453 length of segment : 28 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00022077560424804688 length of segment : 10 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.00040721893310546875 length of segment : 14 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1568 time to create 1 rle with old method : 0.0020689964294433594 length of segment : 49 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 601 time to create 1 rle with old method : 0.0009403228759765625 length of segment : 19 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0011646747589111328 length of segment : 26 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 2400 time to create 1 rle with old method : 0.003083944320678711 length of segment : 47 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0004127025604248047 length of segment : 24 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0004227161407470703 length of segment : 29 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00022101402282714844 length of segment : 17 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007319450378417969 length of segment : 31 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004570484161376953 length of segment : 24 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0006420612335205078 length of segment : 18 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00040435791015625 length of segment : 23 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00021982192993164062 length of segment : 12 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00031566619873046875 length of segment : 16 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003752708435058594 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.60234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00047135353088378906 length of segment : 16 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0019505023956298828 length of segment : 34 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 1940 time to create 1 rle with old method : 0.014180660247802734 length of segment : 41 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.0004279613494873047 length of segment : 16 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00032401084899902344 length of segment : 24 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0007116794586181641 length of segment : 29 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0025420188903808594 length of segment : 60 Processing 1 images image shape: (400, 400, 3) min: 75.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -48.70000 max: 149.75234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.21563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 581 time to create 1 rle with old method : 0.0009131431579589844 length of segment : 20 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007877349853515625 length of segment : 33 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00032782554626464844 length of segment : 18 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005977153778076172 length of segment : 22 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.00042629241943359375 length of segment : 19 Processing 1 images image shape: (400, 160, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.07656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0008378028869628906 length of segment : 32 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1212 time to create 1 rle with old method : 0.001562356948852539 length of segment : 99 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 795 time to create 1 rle with old method : 0.0010380744934082031 length of segment : 35 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005373954772949219 length of segment : 25 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.0001819133758544922 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006041526794433594 length of segment : 42 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 646 time to create 1 rle with old method : 0.0009908676147460938 length of segment : 16 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003712177276611328 length of segment : 26 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002624988555908203 length of segment : 24 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 958 time to create 1 rle with old method : 0.0011720657348632812 length of segment : 77 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0008022785186767578 length of segment : 42 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002455711364746094 length of segment : 13 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005953311920166016 length of segment : 29 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.000576019287109375 length of segment : 48 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 684 time to create 1 rle with old method : 0.0009067058563232422 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.75469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00029277801513671875 length of segment : 15 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004668235778808594 length of segment : 21 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005066394805908203 length of segment : 32 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0006043910980224609 length of segment : 23 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 675 time to create 1 rle with old method : 0.0011138916015625 length of segment : 30 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0008263587951660156 length of segment : 30 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.00028324127197265625 length of segment : 13 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007193088531494141 length of segment : 48 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.00047779083251953125 length of segment : 28 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001976490020751953 length of segment : 13 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007903575897216797 length of segment : 31 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 681 time to create 1 rle with old method : 0.000980377197265625 length of segment : 50 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.00057220458984375 length of segment : 29 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 2562 time to create 1 rle with old method : 0.003446340560913086 length of segment : 42 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0006430149078369141 length of segment : 32 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003445148468017578 length of segment : 18 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.00022935867309570312 length of segment : 14 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006213188171386719 length of segment : 35 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 2066 time to create 1 rle with old method : 0.002660989761352539 length of segment : 65 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002906322479248047 length of segment : 33 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1481 time to create 1 rle with old method : 0.0017600059509277344 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.33672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004870891571044922 length of segment : 15 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 975 time to create 1 rle with old method : 0.0012974739074707031 length of segment : 36 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003764629364013672 length of segment : 23 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.00036215782165527344 length of segment : 26 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.0005273818969726562 length of segment : 14 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0009980201721191406 length of segment : 40 time for calcul the mask position with numpy : 0.00018405914306640625 nb_pixel_total : 8734 time to create 1 rle with old method : 0.010767459869384766 length of segment : 109 time for calcul the mask position with numpy : 0.00012183189392089844 nb_pixel_total : 1060 time to create 1 rle with old method : 0.0018880367279052734 length of segment : 55 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00048041343688964844 length of segment : 15 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 1834 time to create 1 rle with old method : 0.003138303756713867 length of segment : 58 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.000370025634765625 length of segment : 18 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0004553794860839844 length of segment : 22 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0009882450103759766 length of segment : 27 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0006697177886962891 length of segment : 26 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0008232593536376953 length of segment : 30 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0014705657958984375 length of segment : 43 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00021767616271972656 length of segment : 11 time for calcul the mask position with numpy : 0.0001595020294189453 nb_pixel_total : 8508 time to create 1 rle with old method : 0.009479522705078125 length of segment : 109 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003044605255126953 length of segment : 20 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1051 time to create 1 rle with old method : 0.0014171600341796875 length of segment : 46 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1805 time to create 1 rle with old method : 0.0021462440490722656 length of segment : 56 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -107.23125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1704 time to create 1 rle with old method : 0.002118825912475586 length of segment : 54 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00027441978454589844 length of segment : 15 time for calcul the mask position with numpy : 0.00014472007751464844 nb_pixel_total : 7032 time to create 1 rle with old method : 0.008835554122924805 length of segment : 109 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0007266998291015625 length of segment : 30 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1894 time to create 1 rle with old method : 0.0024051666259765625 length of segment : 68 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00023794174194335938 length of segment : 11 time for calcul the mask position with numpy : 0.00012540817260742188 nb_pixel_total : 6878 time to create 1 rle with old method : 0.00800466537475586 length of segment : 108 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1165 time to create 1 rle with old method : 0.0015268325805664062 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 64.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -44.27813 max: 145.71719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.43828 max: 150.63125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0005371570587158203 length of segment : 13 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002639293670654297 length of segment : 20 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.23672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.0004029273986816406 length of segment : 31 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005414485931396484 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 2939 time to create 1 rle with old method : 0.003964424133300781 length of segment : 39 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 650 time to create 1 rle with old method : 0.0008881092071533203 length of segment : 34 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 979 time to create 1 rle with old method : 0.001359701156616211 length of segment : 26 time for calcul the mask position with numpy : 0.0006775856018066406 nb_pixel_total : 24653 time to create 1 rle with old method : 0.02939009666442871 length of segment : 406 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 761 time to create 1 rle with old method : 0.0010104179382324219 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.26250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.00047779083251953125 length of segment : 23 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006284713745117188 length of segment : 26 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005033016204833984 length of segment : 23 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 740 time to create 1 rle with old method : 0.0008714199066162109 length of segment : 39 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003325939178466797 length of segment : 23 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005376338958740234 length of segment : 26 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 2067 time to create 1 rle with old method : 0.002404451370239258 length of segment : 75 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006508827209472656 length of segment : 27 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005571842193603516 length of segment : 43 time for calcul the mask position with numpy : 0.00013327598571777344 nb_pixel_total : 4141 time to create 1 rle with old method : 0.00506138801574707 length of segment : 54 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 3073 time to create 1 rle with old method : 0.003499746322631836 length of segment : 65 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 637 time to create 1 rle with old method : 0.0007991790771484375 length of segment : 24 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005028247833251953 length of segment : 24 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007929801940917969 length of segment : 24 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002589225769042969 length of segment : 12 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00027632713317871094 length of segment : 18 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 571 time to create 1 rle with old method : 0.0010235309600830078 length of segment : 37 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002532005310058594 length of segment : 32 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0014433860778808594 length of segment : 53 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.00043272972106933594 length of segment : 23 time for calcul the mask position with numpy : 0.0001995563507080078 nb_pixel_total : 9951 time to create 1 rle with old method : 0.011344432830810547 length of segment : 134 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00024771690368652344 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.38359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007815361022949219 length of segment : 27 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 713 time to create 1 rle with old method : 0.0008022785186767578 length of segment : 61 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.0009310245513916016 length of segment : 35 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 684 time to create 1 rle with old method : 0.0008242130279541016 length of segment : 42 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0007281303405761719 length of segment : 55 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.0007464885711669922 length of segment : 25 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002269744873046875 length of segment : 17 time for calcul the mask position with numpy : 2.6464462280273438e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.000110626220703125 length of segment : 12 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002570152282714844 length of segment : 24 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1179 time to create 1 rle with old method : 0.001481771469116211 length of segment : 64 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1456 time to create 1 rle with old method : 0.0017480850219726562 length of segment : 71 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 2356 time to create 1 rle with old method : 0.0028476715087890625 length of segment : 51 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005164146423339844 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -100.13359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0010979175567626953 length of segment : 39 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004858970642089844 length of segment : 23 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 13 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00018167495727539062 length of segment : 17 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005068778991699219 length of segment : 25 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0005464553833007812 length of segment : 21 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0006031990051269531 length of segment : 49 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00019073486328125 length of segment : 7 Processing 1 images image shape: (400, 400, 3) min: 81.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -42.70000 max: 96.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.01250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005125999450683594 length of segment : 39 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 1746 time to create 1 rle with old method : 0.002197742462158203 length of segment : 92 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1849 time to create 1 rle with old method : 0.0022039413452148438 length of segment : 56 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006213188171386719 length of segment : 29 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0004088878631591797 length of segment : 33 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 781 time to create 1 rle with old method : 0.0010309219360351562 length of segment : 33 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 972 time to create 1 rle with old method : 0.0011782646179199219 length of segment : 62 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003006458282470703 length of segment : 17 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0016574859619140625 length of segment : 54 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1280 time to create 1 rle with old method : 0.0015838146209716797 length of segment : 47 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 985 time to create 1 rle with old method : 0.0012431144714355469 length of segment : 61 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 798 time to create 1 rle with old method : 0.0011241436004638672 length of segment : 29 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.0010228157043457031 length of segment : 33 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005161762237548828 length of segment : 29 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 851 time to create 1 rle with old method : 0.0012841224670410156 length of segment : 52 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1146 time to create 1 rle with old method : 0.0015382766723632812 length of segment : 61 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 785 time to create 1 rle with old method : 0.0009715557098388672 length of segment : 29 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002989768981933594 length of segment : 34 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005152225494384766 length of segment : 28 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009670257568359375 length of segment : 52 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002512931823730469 length of segment : 13 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002269744873046875 length of segment : 18 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.20937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 9.822845458984375e-05 nb_pixel_total : 2288 time to create 1 rle with old method : 0.002959728240966797 length of segment : 61 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0005080699920654297 length of segment : 16 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 3234 time to create 1 rle with old method : 0.003912925720214844 length of segment : 57 time for calcul the mask position with numpy : 0.00029087066650390625 nb_pixel_total : 15087 time to create 1 rle with old method : 0.0170896053314209 length of segment : 112 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0017154216766357422 length of segment : 23 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 603 time to create 1 rle with old method : 0.0007536411285400391 length of segment : 24 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 2738 time to create 1 rle with old method : 0.0032646656036376953 length of segment : 71 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.00046181678771972656 length of segment : 16 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 2122 time to create 1 rle with old method : 0.0026891231536865234 length of segment : 112 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 619 time to create 1 rle with old method : 0.0007941722869873047 length of segment : 23 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.00047850608825683594 length of segment : 48 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0007202625274658203 length of segment : 31 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0015697479248046875 length of segment : 26 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002410411834716797 length of segment : 22 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 2755 time to create 1 rle with old method : 0.003411531448364258 length of segment : 99 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0006144046783447266 length of segment : 41 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.001165628433227539 length of segment : 19 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1887 time to create 1 rle with old method : 0.0023450851440429688 length of segment : 56 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00018405914306640625 length of segment : 7 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00017714500427246094 length of segment : 14 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006802082061767578 length of segment : 26 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 3180 time to create 1 rle with old method : 0.003886699676513672 length of segment : 57 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0005140304565429688 length of segment : 12 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004928112030029297 length of segment : 19 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0012965202331542969 length of segment : 32 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003190040588378906 length of segment : 17 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0005943775177001953 length of segment : 36 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0006105899810791016 length of segment : 22 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004260540008544922 length of segment : 42 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002982616424560547 length of segment : 12 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.0001316070556640625 length of segment : 10 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1344 time to create 1 rle with old method : 0.0015680789947509766 length of segment : 54 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1326 time to create 1 rle with old method : 0.0016353130340576172 length of segment : 38 Processing 1 images image shape: (240, 400, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004227161407470703 length of segment : 20 time for calcul the mask position with numpy : 0.0004057884216308594 nb_pixel_total : 36362 time to create 1 rle with old method : 0.04087066650390625 length of segment : 145 time for calcul the mask position with numpy : 0.0001251697540283203 nb_pixel_total : 6554 time to create 1 rle with old method : 0.007546186447143555 length of segment : 88 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011849403381347656 length of segment : 30 Processing 1 images image shape: (240, 400, 3) min: 37.00000 max: 223.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 114.83437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0003159046173095703 nb_pixel_total : 27879 time to create 1 rle with old method : 0.030614614486694336 length of segment : 136 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003104209899902344 length of segment : 25 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 1208 time to create 1 rle with old method : 0.0014760494232177734 length of segment : 45 Processing 1 images image shape: (240, 160, 3) min: 0.00000 max: 228.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 116.14025 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.53594 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0020036697387695312 length of segment : 52 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004248619079589844 length of segment : 32 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 659 time to create 1 rle with old method : 0.0008585453033447266 length of segment : 28 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0012471675872802734 length of segment : 37 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0003323554992675781 length of segment : 18 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 734 time to create 1 rle with old method : 0.0009233951568603516 length of segment : 30 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0007386207580566406 length of segment : 33 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00017571449279785156 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.90313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1201 time to create 1 rle with old method : 0.0015568733215332031 length of segment : 44 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005133152008056641 length of segment : 48 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.00027489662170410156 length of segment : 21 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004410743713378906 length of segment : 26 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005884170532226562 length of segment : 32 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00016760826110839844 length of segment : 17 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 749 time to create 1 rle with old method : 0.0009744167327880859 length of segment : 32 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1446 time to create 1 rle with old method : 0.0016942024230957031 length of segment : 54 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003094673156738281 length of segment : 15 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003631114959716797 length of segment : 28 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1910 time to create 1 rle with old method : 0.0023186206817626953 length of segment : 62 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1952 time to create 1 rle with old method : 0.002266407012939453 length of segment : 62 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00030684471130371094 length of segment : 13 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003094673156738281 length of segment : 12 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 2308 time to create 1 rle with old method : 0.0026426315307617188 length of segment : 58 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.88359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003330707550048828 length of segment : 20 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003726482391357422 length of segment : 19 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.00045108795166015625 length of segment : 21 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 974 time to create 1 rle with old method : 0.0013289451599121094 length of segment : 27 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.000194549560546875 length of segment : 12 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 2695 time to create 1 rle with old method : 0.0031549930572509766 length of segment : 56 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00029277801513671875 length of segment : 27 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002799034118652344 length of segment : 10 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002582073211669922 length of segment : 13 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0002827644348144531 length of segment : 20 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004360675811767578 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.62578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003476142883300781 length of segment : 25 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0003075599670410156 length of segment : 13 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005049705505371094 length of segment : 22 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004649162292480469 length of segment : 16 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 662 time to create 1 rle with old method : 0.0008220672607421875 length of segment : 30 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002627372741699219 length of segment : 39 time for calcul the mask position with numpy : 2.6702880859375e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00016951560974121094 length of segment : 6 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1625 time to create 1 rle with old method : 0.0018467903137207031 length of segment : 43 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 996 time to create 1 rle with old method : 0.0011434555053710938 length of segment : 42 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 17 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 974 time to create 1 rle with old method : 0.001107931137084961 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 67.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -42.35625 max: 150.80703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0007174015045166016 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.37578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.00037169456481933594 length of segment : 18 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003619194030761719 length of segment : 23 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1494 time to create 1 rle with old method : 0.0018854141235351562 length of segment : 69 Processing 1 images image shape: (400, 160, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.42031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0004966259002685547 length of segment : 30 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006177425384521484 length of segment : 36 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00022482872009277344 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.55938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005600452423095703 length of segment : 40 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0008144378662109375 length of segment : 17 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0006427764892578125 length of segment : 30 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00034809112548828125 length of segment : 25 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0013833045959472656 length of segment : 60 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 1202 time to create 1 rle with old method : 0.0014705657958984375 length of segment : 78 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.0008754730224609375 length of segment : 37 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 2642 time to create 1 rle with old method : 0.0030705928802490234 length of segment : 61 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.00034618377685546875 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 25 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.001079559326171875 length of segment : 46 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005156993865966797 length of segment : 21 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007162094116210938 length of segment : 34 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002028942108154297 length of segment : 16 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 1395 time to create 1 rle with old method : 0.0015866756439208984 length of segment : 40 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005290508270263672 length of segment : 41 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00023365020751953125 length of segment : 15 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0003147125244140625 length of segment : 12 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003924369812011719 length of segment : 17 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00014591217041015625 length of segment : 10 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1561 time to create 1 rle with old method : 0.0018742084503173828 length of segment : 37 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00024271011352539062 length of segment : 15 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 3102 time to create 1 rle with old method : 0.0036993026733398438 length of segment : 65 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007567405700683594 length of segment : 30 time for calcul the mask position with numpy : 2.6941299438476562e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00012302398681640625 length of segment : 12 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1036 time to create 1 rle with old method : 0.0013043880462646484 length of segment : 34 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00017309188842773438 length of segment : 20 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005664825439453125 length of segment : 35 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 2559 time to create 1 rle with old method : 0.0029518604278564453 length of segment : 43 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.0010983943939208984 length of segment : 39 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.0001773834228515625 length of segment : 24 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 736 time to create 1 rle with old method : 0.0008842945098876953 length of segment : 47 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006344318389892578 length of segment : 48 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0006670951843261719 length of segment : 42 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1110 time to create 1 rle with old method : 0.0013756752014160156 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.28594 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007207393646240234 length of segment : 33 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0014045238494873047 length of segment : 40 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.0007371902465820312 length of segment : 38 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0009768009185791016 length of segment : 37 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003342628479003906 length of segment : 18 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005993843078613281 length of segment : 18 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005257129669189453 length of segment : 34 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007028579711914062 length of segment : 22 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00024890899658203125 length of segment : 17 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00020194053649902344 length of segment : 19 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1106 time to create 1 rle with old method : 0.0013453960418701172 length of segment : 68 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003457069396972656 length of segment : 16 time for calcul the mask position with numpy : 0.0001423358917236328 nb_pixel_total : 8149 time to create 1 rle with old method : 0.009382009506225586 length of segment : 112 time for calcul the mask position with numpy : 0.0001347064971923828 nb_pixel_total : 8631 time to create 1 rle with old method : 0.009710073471069336 length of segment : 113 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.00022339820861816406 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00025534629821777344 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.73906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006616115570068359 length of segment : 42 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0006079673767089844 length of segment : 15 time for calcul the mask position with numpy : 0.00010943412780761719 nb_pixel_total : 6956 time to create 1 rle with old method : 0.0077250003814697266 length of segment : 111 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0006227493286132812 length of segment : 34 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00022125244140625 length of segment : 17 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002548694610595703 length of segment : 15 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1414 time to create 1 rle with old method : 0.0015740394592285156 length of segment : 106 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 6638 time to create 1 rle with old method : 0.007572650909423828 length of segment : 108 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0014369487762451172 length of segment : 35 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003552436828613281 length of segment : 12 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00017905235290527344 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 72.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -39.60625 max: 150.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 510 time to create 1 rle with old method : 0.0009243488311767578 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.43047 max: 150.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004754066467285156 length of segment : 23 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 7492 time to create 1 rle with old method : 0.008377552032470703 length of segment : 152 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.00045418739318847656 length of segment : 29 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 54 time to create 1 rle with old method : 0.00010013580322265625 length of segment : 9 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.44766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.000560760498046875 length of segment : 41 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.00038695335388183594 length of segment : 24 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004718303680419922 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 1920 time to create 1 rle with old method : 0.003383636474609375 length of segment : 32 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 966 time to create 1 rle with old method : 0.001306295394897461 length of segment : 46 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 6183 time to create 1 rle with old method : 0.007442474365234375 length of segment : 98 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0006718635559082031 length of segment : 34 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0010180473327636719 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.11016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0006654262542724609 length of segment : 26 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 808 time to create 1 rle with old method : 0.00110626220703125 length of segment : 38 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0010514259338378906 length of segment : 27 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0005536079406738281 length of segment : 26 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0009560585021972656 length of segment : 25 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0004525184631347656 length of segment : 21 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002968311309814453 length of segment : 11 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 3066 time to create 1 rle with old method : 0.0038657188415527344 length of segment : 64 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0009427070617675781 length of segment : 29 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1672 time to create 1 rle with old method : 0.0021047592163085938 length of segment : 59 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 436 time to create 1 rle with old method : 0.0005974769592285156 length of segment : 31 time for calcul the mask position with numpy : 0.0002181529998779297 nb_pixel_total : 11829 time to create 1 rle with old method : 0.013838529586791992 length of segment : 147 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.00048065185546875 length of segment : 24 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006539821624755859 length of segment : 27 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0004897117614746094 length of segment : 44 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0004172325134277344 length of segment : 31 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 10477 time to create 1 rle with old method : 0.011856317520141602 length of segment : 159 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004839897155761719 length of segment : 24 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004482269287109375 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.0006959438323974609 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.51250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 761 time to create 1 rle with old method : 0.0009589195251464844 length of segment : 63 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.000385284423828125 length of segment : 27 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 993 time to create 1 rle with old method : 0.0012993812561035156 length of segment : 50 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005373954772949219 length of segment : 22 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0003294944763183594 length of segment : 24 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 22 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1591 time to create 1 rle with old method : 0.001993894577026367 length of segment : 46 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00035071372985839844 length of segment : 19 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002067089080810547 length of segment : 14 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.000179290771484375 length of segment : 14 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001819133758544922 length of segment : 18 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004904270172119141 length of segment : 34 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00027632713317871094 length of segment : 17 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002472400665283203 length of segment : 17 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 2445 time to create 1 rle with old method : 0.003719329833984375 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.79375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 662 time to create 1 rle with old method : 0.0008971691131591797 length of segment : 22 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006372928619384766 length of segment : 15 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003650188446044922 length of segment : 33 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 739 time to create 1 rle with old method : 0.0011794567108154297 length of segment : 24 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.0002865791320800781 length of segment : 14 time for calcul the mask position with numpy : 0.00015234947204589844 nb_pixel_total : 6008 time to create 1 rle with old method : 0.0075037479400634766 length of segment : 191 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 3516 time to create 1 rle with old method : 0.0046193599700927734 length of segment : 123 time for calcul the mask position with numpy : 0.0001266002655029297 nb_pixel_total : 3770 time to create 1 rle with old method : 0.004651784896850586 length of segment : 128 Processing 1 images image shape: (400, 400, 3) min: 76.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -47.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.51250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004589557647705078 length of segment : 34 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1918 time to create 1 rle with old method : 0.002504587173461914 length of segment : 55 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.0010442733764648438 length of segment : 34 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.000858306884765625 length of segment : 22 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005249977111816406 length of segment : 25 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005538463592529297 length of segment : 28 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0007512569427490234 length of segment : 86 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0005352497100830078 length of segment : 52 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00028252601623535156 length of segment : 22 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1090 time to create 1 rle with old method : 0.001424551010131836 length of segment : 59 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1697 time to create 1 rle with old method : 0.002185344696044922 length of segment : 58 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0013346672058105469 length of segment : 54 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002865791320800781 length of segment : 24 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.03359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00022912025451660156 length of segment : 30 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 746 time to create 1 rle with old method : 0.0010399818420410156 length of segment : 51 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006597042083740234 length of segment : 29 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 837 time to create 1 rle with old method : 0.0011854171752929688 length of segment : 29 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 3179 time to create 1 rle with old method : 0.004160881042480469 length of segment : 67 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.00048470497131347656 length of segment : 14 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1668 time to create 1 rle with old method : 0.0021295547485351562 length of segment : 48 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004820823669433594 length of segment : 16 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1838 time to create 1 rle with old method : 0.002253293991088867 length of segment : 58 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 795 time to create 1 rle with old method : 0.0013349056243896484 length of segment : 24 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0009582042694091797 length of segment : 23 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 648 time to create 1 rle with old method : 0.0008854866027832031 length of segment : 88 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003705024719238281 length of segment : 26 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1336 time to create 1 rle with old method : 0.0017070770263671875 length of segment : 46 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0004143714904785156 length of segment : 35 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00020432472229003906 length of segment : 15 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0006098747253417969 length of segment : 23 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005221366882324219 length of segment : 19 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 3146 time to create 1 rle with old method : 0.004096269607543945 length of segment : 59 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.000713348388671875 length of segment : 23 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005021095275878906 length of segment : 36 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.0002472400665283203 length of segment : 20 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004897117614746094 length of segment : 13 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001575946807861328 length of segment : 12 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 900 time to create 1 rle with old method : 0.0014719963073730469 length of segment : 68 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00041866302490234375 length of segment : 21 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.00047516822814941406 length of segment : 26 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0004284381866455078 length of segment : 22 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 784 time to create 1 rle with old method : 0.001552581787109375 length of segment : 29 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0013849735260009766 length of segment : 26 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0017943382263183594 length of segment : 25 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0004401206970214844 length of segment : 17 time for calcul the mask position with numpy : 0.00010538101196289062 nb_pixel_total : 3216 time to create 1 rle with old method : 0.008230924606323242 length of segment : 58 Processing 1 images image shape: (240, 400, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0004029273986816406 nb_pixel_total : 37827 time to create 1 rle with old method : 0.045183420181274414 length of segment : 142 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002334117889404297 length of segment : 25 Processing 1 images image shape: (240, 400, 3) min: 48.00000 max: 235.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.94766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.00046181678771972656 length of segment : 22 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00036454200744628906 length of segment : 22 time for calcul the mask position with numpy : 0.0004420280456542969 nb_pixel_total : 24024 time to create 1 rle with old method : 0.03191256523132324 length of segment : 194 time for calcul the mask position with numpy : 0.0004515647888183594 nb_pixel_total : 36468 time to create 1 rle with old method : 0.0409541130065918 length of segment : 147 Processing 1 images image shape: (240, 160, 3) min: 0.00000 max: 222.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 114.76122 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Detection mask done ! Trying to reset tf kernel 950577 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 460 len(list_Values) 460 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 460 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 460 chid ids of type : 4228 Number RLEs to save : 17379 save missing photos in datou_result : time spend for datou_step_exec : 30.26156783103943 time spend to save output : 1.3498847484588623 total time spend for step 1 : 31.61145257949829 step2:brightness Sat Mar 1 07:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740810029_949903_1340322893_7bcb86fa1605201c1b5537475cacd42a.jpg treat image : temp/1740810029_949903_1340317758_27c0e78d69df2a8860397f772cb7ab4a.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.0163116455078125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.015974044799804688 save missing photos in datou_result : time spend for datou_step_exec : 0.8337476253509521 time spend to save output : 0.0371551513671875 total time spend for step 2 : 0.8709027767181396 step3:blur_detection Sat Mar 1 07:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740810029_949903_1340322893_7bcb86fa1605201c1b5537475cacd42a.jpg resize: (1440, 2560) 1340322893 -7.959428363210358 treat image : temp/1740810029_949903_1340317758_27c0e78d69df2a8860397f772cb7ab4a.jpg resize: (1440, 2560) 1340317758 -7.864988979799694 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.34392595291137695 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.12092351913452148 save missing photos in datou_result : time spend for datou_step_exec : 3.489227056503296 time spend to save output : 0.4704568386077881 total time spend for step 3 : 3.959683895111084 step4:rle_unique_nms_with_priority Sat Mar 1 07:21:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 460 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 238 nb_hashtags : 7 time to prepare the origin masks : 1.8623688220977783 time for calcul the mask position with numpy : 0.5058166980743408 nb_pixel_total : 3417426 time to create 1 rle with new method : 0.3746030330657959 time for calcul the mask position with numpy : 0.019069194793701172 nb_pixel_total : 2024 time to create 1 rle with old method : 0.00237274169921875 time for calcul the mask position with numpy : 0.023581266403198242 nb_pixel_total : 302 time to create 1 rle with old method : 0.0003399848937988281 time for calcul the mask position with numpy : 0.013997554779052734 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007071495056152344 time for calcul the mask position with numpy : 0.01429891586303711 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003170967102050781 time for calcul the mask position with numpy : 0.014253854751586914 nb_pixel_total : 323 time to create 1 rle with old method : 0.00035262107849121094 time for calcul the mask position with numpy : 0.014194250106811523 nb_pixel_total : 168 time to create 1 rle with old method : 0.00018858909606933594 time for calcul the mask position with numpy : 0.015137434005737305 nb_pixel_total : 315 time to create 1 rle with old method : 0.0003857612609863281 time for calcul the mask position with numpy : 0.015607118606567383 nb_pixel_total : 187 time to create 1 rle with old method : 0.00022101402282714844 time for calcul the mask position with numpy : 0.014844894409179688 nb_pixel_total : 261 time to create 1 rle with old method : 0.00032520294189453125 time for calcul the mask position with numpy : 0.014347076416015625 nb_pixel_total : 269 time to create 1 rle with old method : 0.0002899169921875 time for calcul the mask position with numpy : 0.014479875564575195 nb_pixel_total : 142 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.014819145202636719 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0011973381042480469 time for calcul the mask position with numpy : 0.014389991760253906 nb_pixel_total : 537 time to create 1 rle with old method : 0.0006191730499267578 time for calcul the mask position with numpy : 0.01435708999633789 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005977153778076172 time for calcul the mask position with numpy : 0.014478683471679688 nb_pixel_total : 162 time to create 1 rle with old method : 0.00017213821411132812 time for calcul the mask position with numpy : 0.014219284057617188 nb_pixel_total : 310 time to create 1 rle with old method : 0.00037360191345214844 time for calcul the mask position with numpy : 0.014461994171142578 nb_pixel_total : 228 time to create 1 rle with old method : 0.0002770423889160156 time for calcul the mask position with numpy : 0.014699459075927734 nb_pixel_total : 690 time to create 1 rle with old method : 0.0007522106170654297 time for calcul the mask position with numpy : 0.014915943145751953 nb_pixel_total : 155 time to create 1 rle with old method : 0.00018262863159179688 time for calcul the mask position with numpy : 0.014528274536132812 nb_pixel_total : 216 time to create 1 rle with old method : 0.0002605915069580078 time for calcul the mask position with numpy : 0.014672994613647461 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002465248107910156 time for calcul the mask position with numpy : 0.014854907989501953 nb_pixel_total : 249 time to create 1 rle with old method : 0.00034737586975097656 time for calcul the mask position with numpy : 0.015109777450561523 nb_pixel_total : 661 time to create 1 rle with old method : 0.0007734298706054688 time for calcul the mask position with numpy : 0.015134572982788086 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0016324520111083984 time for calcul the mask position with numpy : 0.015126943588256836 nb_pixel_total : 154 time to create 1 rle with old method : 0.0001914501190185547 time for calcul the mask position with numpy : 0.015146255493164062 nb_pixel_total : 581 time to create 1 rle with old method : 0.0007219314575195312 time for calcul the mask position with numpy : 0.015116691589355469 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005357265472412109 time for calcul the mask position with numpy : 0.014737367630004883 nb_pixel_total : 1160 time to create 1 rle with old method : 0.0012536048889160156 time for calcul the mask position with numpy : 0.014798641204833984 nb_pixel_total : 620 time to create 1 rle with old method : 0.0007534027099609375 time for calcul the mask position with numpy : 0.015006780624389648 nb_pixel_total : 124 time to create 1 rle with old method : 0.00016236305236816406 time for calcul the mask position with numpy : 0.015047073364257812 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007045269012451172 time for calcul the mask position with numpy : 0.015064239501953125 nb_pixel_total : 2715 time to create 1 rle with old method : 0.0030596256256103516 time for calcul the mask position with numpy : 0.01530909538269043 nb_pixel_total : 1212 time to create 1 rle with old method : 0.00142669677734375 time for calcul the mask position with numpy : 0.015313386917114258 nb_pixel_total : 1747 time to create 1 rle with old method : 0.0020635128021240234 time for calcul the mask position with numpy : 0.017287254333496094 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003345012664794922 time for calcul the mask position with numpy : 0.017045021057128906 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.01754927635192871 nb_pixel_total : 119 time to create 1 rle with old method : 0.0001659393310546875 time for calcul the mask position with numpy : 0.017565250396728516 nb_pixel_total : 94 time to create 1 rle with old method : 0.00012302398681640625 time for calcul the mask position with numpy : 0.01462101936340332 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005087852478027344 time for calcul the mask position with numpy : 0.014821290969848633 nb_pixel_total : 272 time to create 1 rle with old method : 0.0002980232238769531 time for calcul the mask position with numpy : 0.014781713485717773 nb_pixel_total : 601 time to create 1 rle with old method : 0.0006811618804931641 time for calcul the mask position with numpy : 0.014767646789550781 nb_pixel_total : 130 time to create 1 rle with old method : 0.00023174285888671875 time for calcul the mask position with numpy : 0.014514446258544922 nb_pixel_total : 115 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.014408111572265625 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004253387451171875 time for calcul the mask position with numpy : 0.014473676681518555 nb_pixel_total : 563 time to create 1 rle with old method : 0.0006287097930908203 time for calcul the mask position with numpy : 0.014741659164428711 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001316070556640625 time for calcul the mask position with numpy : 0.014644145965576172 nb_pixel_total : 218 time to create 1 rle with old method : 0.00025463104248046875 time for calcul the mask position with numpy : 0.014638423919677734 nb_pixel_total : 302 time to create 1 rle with old method : 0.0003521442413330078 time for calcul the mask position with numpy : 0.014787912368774414 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005192756652832031 time for calcul the mask position with numpy : 0.014584064483642578 nb_pixel_total : 375 time to create 1 rle with old method : 0.000438690185546875 time for calcul the mask position with numpy : 0.014643669128417969 nb_pixel_total : 154 time to create 1 rle with old method : 0.0001952648162841797 time for calcul the mask position with numpy : 0.015002965927124023 nb_pixel_total : 428 time to create 1 rle with old method : 0.0004990100860595703 time for calcul the mask position with numpy : 0.015086174011230469 nb_pixel_total : 813 time to create 1 rle with old method : 0.0009636878967285156 time for calcul the mask position with numpy : 0.015115976333618164 nb_pixel_total : 526 time to create 1 rle with old method : 0.0006384849548339844 time for calcul the mask position with numpy : 0.015150785446166992 nb_pixel_total : 1568 time to create 1 rle with old method : 0.0018048286437988281 time for calcul the mask position with numpy : 0.015184640884399414 nb_pixel_total : 2400 time to create 1 rle with old method : 0.004131317138671875 time for calcul the mask position with numpy : 0.017228126525878906 nb_pixel_total : 1940 time to create 1 rle with old method : 0.0031807422637939453 time for calcul the mask position with numpy : 0.017163991928100586 nb_pixel_total : 32 time to create 1 rle with old method : 0.000133514404296875 time for calcul the mask position with numpy : 0.01708078384399414 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002601146697998047 time for calcul the mask position with numpy : 0.017113685607910156 nb_pixel_total : 208 time to create 1 rle with old method : 0.00038433074951171875 time for calcul the mask position with numpy : 0.016198396682739258 nb_pixel_total : 326 time to create 1 rle with old method : 0.0003871917724609375 time for calcul the mask position with numpy : 0.014639616012573242 nb_pixel_total : 795 time to create 1 rle with old method : 0.0009167194366455078 time for calcul the mask position with numpy : 0.014441967010498047 nb_pixel_total : 366 time to create 1 rle with old method : 0.00040411949157714844 time for calcul the mask position with numpy : 0.014430046081542969 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003075599670410156 time for calcul the mask position with numpy : 0.01475381851196289 nb_pixel_total : 159 time to create 1 rle with old method : 0.000263214111328125 time for calcul the mask position with numpy : 0.014978170394897461 nb_pixel_total : 313 time to create 1 rle with old method : 0.00036263465881347656 time for calcul the mask position with numpy : 0.014976739883422852 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003561973571777344 time for calcul the mask position with numpy : 0.016519784927368164 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006768703460693359 time for calcul the mask position with numpy : 0.017171621322631836 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002493858337402344 time for calcul the mask position with numpy : 0.017179250717163086 nb_pixel_total : 681 time to create 1 rle with old method : 0.0011522769927978516 time for calcul the mask position with numpy : 0.017093181610107422 nb_pixel_total : 319 time to create 1 rle with old method : 0.0005524158477783203 time for calcul the mask position with numpy : 0.017156124114990234 nb_pixel_total : 110 time to create 1 rle with old method : 0.00013828277587890625 time for calcul the mask position with numpy : 0.014824151992797852 nb_pixel_total : 139 time to create 1 rle with old method : 0.00015926361083984375 time for calcul the mask position with numpy : 0.014525651931762695 nb_pixel_total : 1834 time to create 1 rle with old method : 0.0019190311431884766 time for calcul the mask position with numpy : 0.014545679092407227 nb_pixel_total : 371 time to create 1 rle with old method : 0.00044083595275878906 time for calcul the mask position with numpy : 0.014707803726196289 nb_pixel_total : 37 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.014715909957885742 nb_pixel_total : 293 time to create 1 rle with old method : 0.0003688335418701172 time for calcul the mask position with numpy : 0.014904499053955078 nb_pixel_total : 262 time to create 1 rle with old method : 0.00044536590576171875 time for calcul the mask position with numpy : 0.017058372497558594 nb_pixel_total : 34 time to create 1 rle with old method : 0.00011277198791503906 time for calcul the mask position with numpy : 0.0170590877532959 nb_pixel_total : 539 time to create 1 rle with old method : 0.0008795261383056641 time for calcul the mask position with numpy : 0.017173290252685547 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0017726421356201172 time for calcul the mask position with numpy : 0.017151355743408203 nb_pixel_total : 518 time to create 1 rle with old method : 0.0008497238159179688 time for calcul the mask position with numpy : 0.016588926315307617 nb_pixel_total : 151 time to create 1 rle with old method : 0.00019168853759765625 time for calcul the mask position with numpy : 0.014742136001586914 nb_pixel_total : 1058 time to create 1 rle with old method : 0.0012662410736083984 time for calcul the mask position with numpy : 0.01472020149230957 nb_pixel_total : 958 time to create 1 rle with old method : 0.0011348724365234375 time for calcul the mask position with numpy : 0.015093326568603516 nb_pixel_total : 151 time to create 1 rle with old method : 0.00019168853759765625 time for calcul the mask position with numpy : 0.01515960693359375 nb_pixel_total : 387 time to create 1 rle with old method : 0.00045800209045410156 time for calcul the mask position with numpy : 0.0185239315032959 nb_pixel_total : 415 time to create 1 rle with old method : 0.0006978511810302734 time for calcul the mask position with numpy : 0.01736307144165039 nb_pixel_total : 75 time to create 1 rle with old method : 0.00015926361083984375 time for calcul the mask position with numpy : 0.01722097396850586 nb_pixel_total : 371 time to create 1 rle with old method : 0.0006244182586669922 time for calcul the mask position with numpy : 0.01727294921875 nb_pixel_total : 252 time to create 1 rle with old method : 0.0004303455352783203 time for calcul the mask position with numpy : 0.01727294921875 nb_pixel_total : 179 time to create 1 rle with old method : 0.0003147125244140625 time for calcul the mask position with numpy : 0.015019416809082031 nb_pixel_total : 560 time to create 1 rle with old method : 0.0006496906280517578 time for calcul the mask position with numpy : 0.014612197875976562 nb_pixel_total : 179 time to create 1 rle with old method : 0.0001964569091796875 time for calcul the mask position with numpy : 0.01476430892944336 nb_pixel_total : 680 time to create 1 rle with old method : 0.0007684230804443359 time for calcul the mask position with numpy : 0.014478921890258789 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005228519439697266 time for calcul the mask position with numpy : 0.01449275016784668 nb_pixel_total : 684 time to create 1 rle with old method : 0.0007779598236083984 time for calcul the mask position with numpy : 0.014909029006958008 nb_pixel_total : 2562 time to create 1 rle with old method : 0.0028836727142333984 time for calcul the mask position with numpy : 0.014899969100952148 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002689361572265625 time for calcul the mask position with numpy : 0.014961481094360352 nb_pixel_total : 335 time to create 1 rle with old method : 0.0003910064697265625 time for calcul the mask position with numpy : 0.015007257461547852 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005223751068115234 time for calcul the mask position with numpy : 0.014537811279296875 nb_pixel_total : 188 time to create 1 rle with old method : 0.00022220611572265625 time for calcul the mask position with numpy : 0.014579534530639648 nb_pixel_total : 975 time to create 1 rle with old method : 0.0010485649108886719 time for calcul the mask position with numpy : 0.014636993408203125 nb_pixel_total : 7032 time to create 1 rle with old method : 0.007716655731201172 time for calcul the mask position with numpy : 0.014657020568847656 nb_pixel_total : 38 time to create 1 rle with old method : 0.00010418891906738281 time for calcul the mask position with numpy : 0.015145540237426758 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007448196411132812 time for calcul the mask position with numpy : 0.015299558639526367 nb_pixel_total : 8734 time to create 1 rle with old method : 0.010431051254272461 time for calcul the mask position with numpy : 0.015219926834106445 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002117156982421875 time for calcul the mask position with numpy : 0.015177011489868164 nb_pixel_total : 675 time to create 1 rle with old method : 0.0008766651153564453 time for calcul the mask position with numpy : 0.015186309814453125 nb_pixel_total : 131 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.015202522277832031 nb_pixel_total : 30 time to create 1 rle with old method : 9.918212890625e-05 time for calcul the mask position with numpy : 0.015096902847290039 nb_pixel_total : 236 time to create 1 rle with old method : 0.00028967857360839844 time for calcul the mask position with numpy : 0.01489710807800293 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005354881286621094 time for calcul the mask position with numpy : 0.01486825942993164 nb_pixel_total : 1481 time to create 1 rle with old method : 0.0016787052154541016 time for calcul the mask position with numpy : 0.014433145523071289 nb_pixel_total : 162 time to create 1 rle with old method : 0.0001811981201171875 time for calcul the mask position with numpy : 0.014490127563476562 nb_pixel_total : 1704 time to create 1 rle with old method : 0.0019378662109375 time for calcul the mask position with numpy : 0.014638185501098633 nb_pixel_total : 1894 time to create 1 rle with old method : 0.002213001251220703 time for calcul the mask position with numpy : 0.014705896377563477 nb_pixel_total : 435 time to create 1 rle with old method : 0.0005164146423339844 time for calcul the mask position with numpy : 0.014188289642333984 nb_pixel_total : 589 time to create 1 rle with old method : 0.0006546974182128906 time for calcul the mask position with numpy : 0.015032291412353516 nb_pixel_total : 646 time to create 1 rle with old method : 0.0011589527130126953 time for calcul the mask position with numpy : 0.01704096794128418 nb_pixel_total : 263 time to create 1 rle with old method : 0.0004470348358154297 time for calcul the mask position with numpy : 0.017203569412231445 nb_pixel_total : 556 time to create 1 rle with old method : 0.0009677410125732422 time for calcul the mask position with numpy : 0.01716446876525879 nb_pixel_total : 2066 time to create 1 rle with old method : 0.0033452510833740234 time for calcul the mask position with numpy : 0.01717662811279297 nb_pixel_total : 13 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.016604185104370117 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003714561462402344 time for calcul the mask position with numpy : 0.014847755432128906 nb_pixel_total : 1165 time to create 1 rle with old method : 0.001313924789428711 time for calcul the mask position with numpy : 0.014900445938110352 nb_pixel_total : 214 time to create 1 rle with old method : 0.00026154518127441406 time for calcul the mask position with numpy : 0.014985084533691406 nb_pixel_total : 389 time to create 1 rle with old method : 0.000476837158203125 time for calcul the mask position with numpy : 0.014901399612426758 nb_pixel_total : 135 time to create 1 rle with old method : 0.00015735626220703125 time for calcul the mask position with numpy : 0.014516830444335938 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001609325408935547 time for calcul the mask position with numpy : 0.01457667350769043 nb_pixel_total : 24653 time to create 1 rle with old method : 0.027274370193481445 time for calcul the mask position with numpy : 0.01497793197631836 nb_pixel_total : 761 time to create 1 rle with old method : 0.0009093284606933594 time for calcul the mask position with numpy : 0.014919519424438477 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.014807939529418945 nb_pixel_total : 156 time to create 1 rle with old method : 0.0001900196075439453 time for calcul the mask position with numpy : 0.014316320419311523 nb_pixel_total : 261 time to create 1 rle with old method : 0.00029969215393066406 time for calcul the mask position with numpy : 0.014310836791992188 nb_pixel_total : 372 time to create 1 rle with old method : 0.00043463706970214844 time for calcul the mask position with numpy : 0.0144500732421875 nb_pixel_total : 163 time to create 1 rle with old method : 0.000186920166015625 time for calcul the mask position with numpy : 0.014427900314331055 nb_pixel_total : 616 time to create 1 rle with old method : 0.0007386207580566406 time for calcul the mask position with numpy : 0.014872074127197266 nb_pixel_total : 684 time to create 1 rle with old method : 0.0007960796356201172 time for calcul the mask position with numpy : 0.014671802520751953 nb_pixel_total : 369 time to create 1 rle with old method : 0.0004286766052246094 time for calcul the mask position with numpy : 0.014693021774291992 nb_pixel_total : 576 time to create 1 rle with old method : 0.0006756782531738281 time for calcul the mask position with numpy : 0.014602184295654297 nb_pixel_total : 2067 time to create 1 rle with old method : 0.0024755001068115234 time for calcul the mask position with numpy : 0.01468038558959961 nb_pixel_total : 198 time to create 1 rle with old method : 0.00022220611572265625 time for calcul the mask position with numpy : 0.014794111251831055 nb_pixel_total : 727 time to create 1 rle with old method : 0.0008537769317626953 time for calcul the mask position with numpy : 0.014917373657226562 nb_pixel_total : 571 time to create 1 rle with old method : 0.0006649494171142578 time for calcul the mask position with numpy : 0.014973878860473633 nb_pixel_total : 770 time to create 1 rle with old method : 0.0008971691131591797 time for calcul the mask position with numpy : 0.014929771423339844 nb_pixel_total : 205 time to create 1 rle with old method : 0.00028634071350097656 time for calcul the mask position with numpy : 0.014983892440795898 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001697540283203125 time for calcul the mask position with numpy : 0.014842033386230469 nb_pixel_total : 1456 time to create 1 rle with old method : 0.0016913414001464844 time for calcul the mask position with numpy : 0.014871835708618164 nb_pixel_total : 713 time to create 1 rle with old method : 0.0008077621459960938 time for calcul the mask position with numpy : 0.014914989471435547 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0014340877532958984 time for calcul the mask position with numpy : 0.014929056167602539 nb_pixel_total : 381 time to create 1 rle with old method : 0.0004405975341796875 time for calcul the mask position with numpy : 0.01482391357421875 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0019903182983398438 time for calcul the mask position with numpy : 0.014297008514404297 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004189014434814453 time for calcul the mask position with numpy : 0.014057397842407227 nb_pixel_total : 12 time to create 1 rle with old method : 3.266334533691406e-05 time for calcul the mask position with numpy : 0.014017343521118164 nb_pixel_total : 637 time to create 1 rle with old method : 0.0007150173187255859 time for calcul the mask position with numpy : 0.014150857925415039 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004718303680419922 time for calcul the mask position with numpy : 0.014229536056518555 nb_pixel_total : 2 time to create 1 rle with old method : 2.574920654296875e-05 time for calcul the mask position with numpy : 0.01428985595703125 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005371570587158203 time for calcul the mask position with numpy : 0.014331340789794922 nb_pixel_total : 418 time to create 1 rle with old method : 0.00044727325439453125 time for calcul the mask position with numpy : 0.014280557632446289 nb_pixel_total : 1179 time to create 1 rle with old method : 0.0013077259063720703 time for calcul the mask position with numpy : 0.014155864715576172 nb_pixel_total : 384 time to create 1 rle with old method : 0.00040531158447265625 time for calcul the mask position with numpy : 0.014567375183105469 nb_pixel_total : 307 time to create 1 rle with old method : 0.00035643577575683594 time for calcul the mask position with numpy : 0.014872312545776367 nb_pixel_total : 325 time to create 1 rle with old method : 0.0003936290740966797 time for calcul the mask position with numpy : 0.014862060546875 nb_pixel_total : 377 time to create 1 rle with old method : 0.00045800209045410156 time for calcul the mask position with numpy : 0.014425992965698242 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001838207244873047 time for calcul the mask position with numpy : 0.014486074447631836 nb_pixel_total : 5836 time to create 1 rle with old method : 0.006443500518798828 time for calcul the mask position with numpy : 0.01446223258972168 nb_pixel_total : 798 time to create 1 rle with old method : 0.0008418560028076172 time for calcul the mask position with numpy : 0.014158010482788086 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001621246337890625 time for calcul the mask position with numpy : 0.014321327209472656 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0018317699432373047 time for calcul the mask position with numpy : 0.014834165573120117 nb_pixel_total : 430 time to create 1 rle with old method : 0.0004968643188476562 time for calcul the mask position with numpy : 0.014741659164428711 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005240440368652344 time for calcul the mask position with numpy : 0.01484823226928711 nb_pixel_total : 979 time to create 1 rle with old method : 0.0011806488037109375 time for calcul the mask position with numpy : 0.01492762565612793 nb_pixel_total : 470 time to create 1 rle with old method : 0.0005490779876708984 time for calcul the mask position with numpy : 0.014693737030029297 nb_pixel_total : 154 time to create 1 rle with old method : 0.00021266937255859375 time for calcul the mask position with numpy : 0.014509201049804688 nb_pixel_total : 2356 time to create 1 rle with old method : 0.002670764923095703 time for calcul the mask position with numpy : 0.014734506607055664 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001366138458251953 time for calcul the mask position with numpy : 0.014794349670410156 nb_pixel_total : 972 time to create 1 rle with old method : 0.0011184215545654297 time for calcul the mask position with numpy : 0.014910221099853516 nb_pixel_total : 11 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.014865398406982422 nb_pixel_total : 200 time to create 1 rle with old method : 0.00023984909057617188 time for calcul the mask position with numpy : 0.014679670333862305 nb_pixel_total : 1849 time to create 1 rle with old method : 0.0021762847900390625 time for calcul the mask position with numpy : 0.014836788177490234 nb_pixel_total : 72 time to create 1 rle with old method : 0.00010633468627929688 time for calcul the mask position with numpy : 0.014891624450683594 nb_pixel_total : 159 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.014851570129394531 nb_pixel_total : 3060 time to create 1 rle with old method : 0.003477811813354492 time for calcul the mask position with numpy : 0.014870405197143555 nb_pixel_total : 781 time to create 1 rle with old method : 0.0009026527404785156 time for calcul the mask position with numpy : 0.0149078369140625 nb_pixel_total : 13 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.01486659049987793 nb_pixel_total : 4141 time to create 1 rle with old method : 0.004728794097900391 time for calcul the mask position with numpy : 0.015031576156616211 nb_pixel_total : 560 time to create 1 rle with old method : 0.00066375732421875 time for calcul the mask position with numpy : 0.014842748641967773 nb_pixel_total : 421 time to create 1 rle with old method : 0.00044608116149902344 time for calcul the mask position with numpy : 0.015050649642944336 nb_pixel_total : 183 time to create 1 rle with old method : 0.00023436546325683594 time for calcul the mask position with numpy : 0.014955997467041016 nb_pixel_total : 650 time to create 1 rle with old method : 0.0007271766662597656 time for calcul the mask position with numpy : 0.014950990676879883 nb_pixel_total : 740 time to create 1 rle with old method : 0.0008547306060791016 time for calcul the mask position with numpy : 0.014893770217895508 nb_pixel_total : 2939 time to create 1 rle with old method : 0.0033676624298095703 time for calcul the mask position with numpy : 0.014894485473632812 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004379749298095703 time for calcul the mask position with numpy : 0.014920234680175781 nb_pixel_total : 10 time to create 1 rle with old method : 2.47955322265625e-05 time for calcul the mask position with numpy : 0.014908313751220703 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004012584686279297 time for calcul the mask position with numpy : 0.014824628829956055 nb_pixel_total : 785 time to create 1 rle with old method : 0.0009276866912841797 time for calcul the mask position with numpy : 0.014607667922973633 nb_pixel_total : 132 time to create 1 rle with old method : 0.000164031982421875 time for calcul the mask position with numpy : 0.014851093292236328 nb_pixel_total : 159 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.01497197151184082 nb_pixel_total : 335 time to create 1 rle with old method : 0.00038886070251464844 time for calcul the mask position with numpy : 0.014943599700927734 nb_pixel_total : 322 time to create 1 rle with old method : 0.00041174888610839844 time for calcul the mask position with numpy : 0.015133142471313477 nb_pixel_total : 564 time to create 1 rle with old method : 0.0006704330444335938 time for calcul the mask position with numpy : 0.015115022659301758 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004057884216308594 time for calcul the mask position with numpy : 0.015073299407958984 nb_pixel_total : 518 time to create 1 rle with old method : 0.0007462501525878906 time for calcul the mask position with numpy : 0.015076398849487305 nb_pixel_total : 3234 time to create 1 rle with old method : 0.0036754608154296875 time for calcul the mask position with numpy : 0.015109539031982422 nb_pixel_total : 110 time to create 1 rle with old method : 0.00016021728515625 time for calcul the mask position with numpy : 0.015127897262573242 nb_pixel_total : 1887 time to create 1 rle with old method : 0.002189159393310547 time for calcul the mask position with numpy : 0.015024662017822266 nb_pixel_total : 22 time to create 1 rle with old method : 6.461143493652344e-05 time for calcul the mask position with numpy : 0.015044450759887695 nb_pixel_total : 318 time to create 1 rle with old method : 0.00040984153747558594 time for calcul the mask position with numpy : 0.015280961990356445 nb_pixel_total : 36362 time to create 1 rle with old method : 0.04347586631774902 time for calcul the mask position with numpy : 0.015146970748901367 nb_pixel_total : 15044 time to create 1 rle with old method : 0.016991376876831055 time for calcul the mask position with numpy : 0.01838541030883789 nb_pixel_total : 27879 time to create 1 rle with old method : 0.031055450439453125 time for calcul the mask position with numpy : 0.014765501022338867 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002543926239013672 time for calcul the mask position with numpy : 0.014992713928222656 nb_pixel_total : 447 time to create 1 rle with old method : 0.0005867481231689453 time for calcul the mask position with numpy : 0.015198469161987305 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002033710479736328 time for calcul the mask position with numpy : 0.015148401260375977 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004596710205078125 time for calcul the mask position with numpy : 0.015103340148925781 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011920928955078125 time for calcul the mask position with numpy : 0.01494598388671875 nb_pixel_total : 331 time to create 1 rle with old method : 0.00042128562927246094 time for calcul the mask position with numpy : 0.014348745346069336 nb_pixel_total : 210 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.014518499374389648 nb_pixel_total : 1044 time to create 1 rle with old method : 0.001207113265991211 time for calcul the mask position with numpy : 0.014636993408203125 nb_pixel_total : 1344 time to create 1 rle with old method : 0.001531362533569336 time for calcul the mask position with numpy : 0.014801979064941406 nb_pixel_total : 292 time to create 1 rle with old method : 0.00037384033203125 time for calcul the mask position with numpy : 0.014621734619140625 nb_pixel_total : 5223 time to create 1 rle with old method : 0.005841255187988281 time for calcul the mask position with numpy : 0.014750242233276367 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005419254302978516 time for calcul the mask position with numpy : 0.014394998550415039 nb_pixel_total : 2755 time to create 1 rle with old method : 0.003176450729370117 time for calcul the mask position with numpy : 0.014882564544677734 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001354217529296875 time for calcul the mask position with numpy : 0.014602422714233398 nb_pixel_total : 59 time to create 1 rle with old method : 0.00011682510375976562 time for calcul the mask position with numpy : 0.01446223258972168 nb_pixel_total : 2288 time to create 1 rle with old method : 0.0025434494018554688 time for calcul the mask position with numpy : 0.014340400695800781 nb_pixel_total : 267 time to create 1 rle with old method : 0.00032401084899902344 time for calcul the mask position with numpy : 0.014697074890136719 nb_pixel_total : 48 time to create 1 rle with old method : 6.794929504394531e-05 time for calcul the mask position with numpy : 0.014780044555664062 nb_pixel_total : 37 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.014665603637695312 nb_pixel_total : 1252 time to create 1 rle with old method : 0.001348257064819336 time for calcul the mask position with numpy : 0.01405644416809082 nb_pixel_total : 618 time to create 1 rle with old method : 0.0006642341613769531 time for calcul the mask position with numpy : 0.013948678970336914 nb_pixel_total : 3180 time to create 1 rle with old method : 0.0034630298614501953 time for calcul the mask position with numpy : 0.014399290084838867 nb_pixel_total : 512 time to create 1 rle with old method : 0.0005712509155273438 time for calcul the mask position with numpy : 0.014539480209350586 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003769397735595703 time for calcul the mask position with numpy : 0.014604568481445312 nb_pixel_total : 76 time to create 1 rle with old method : 9.799003601074219e-05 time for calcul the mask position with numpy : 0.014691591262817383 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009138584136962891 create new chi : 4.8185060024261475 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.18727827072143555 batch 1 Loaded 239 chid ids of type : 4230 Number RLEs to save : 17361 TO DO : save crop sub photo not yet done ! save time : 7.4561779499053955 nb_obj : 220 nb_hashtags : 7 time to prepare the origin masks : 6.426098108291626 time for calcul the mask position with numpy : 0.05965304374694824 nb_pixel_total : 3417351 time to create 1 rle with new method : 0.1158287525177002 time for calcul the mask position with numpy : 0.013013362884521484 nb_pixel_total : 400 time to create 1 rle with old method : 0.00048279762268066406 time for calcul the mask position with numpy : 0.01262044906616211 nb_pixel_total : 95 time to create 1 rle with old method : 0.00014638900756835938 time for calcul the mask position with numpy : 0.012080192565917969 nb_pixel_total : 328 time to create 1 rle with old method : 0.0003886222839355469 time for calcul the mask position with numpy : 0.012491464614868164 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003018379211425781 time for calcul the mask position with numpy : 0.012756824493408203 nb_pixel_total : 318 time to create 1 rle with old method : 0.00040268898010253906 time for calcul the mask position with numpy : 0.012714862823486328 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002613067626953125 time for calcul the mask position with numpy : 0.011435270309448242 nb_pixel_total : 220 time to create 1 rle with old method : 0.0002644062042236328 time for calcul the mask position with numpy : 0.011527538299560547 nb_pixel_total : 247 time to create 1 rle with old method : 0.0002963542938232422 time for calcul the mask position with numpy : 0.011348724365234375 nb_pixel_total : 198 time to create 1 rle with old method : 0.00025773048400878906 time for calcul the mask position with numpy : 0.016613245010375977 nb_pixel_total : 14 time to create 1 rle with old method : 4.410743713378906e-05 time for calcul the mask position with numpy : 0.016316652297973633 nb_pixel_total : 662 time to create 1 rle with old method : 0.0007970333099365234 time for calcul the mask position with numpy : 0.01705145835876465 nb_pixel_total : 173 time to create 1 rle with old method : 0.00021839141845703125 time for calcul the mask position with numpy : 0.016828536987304688 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003223419189453125 time for calcul the mask position with numpy : 0.017514467239379883 nb_pixel_total : 160 time to create 1 rle with old method : 0.00023627281188964844 time for calcul the mask position with numpy : 0.018007755279541016 nb_pixel_total : 734 time to create 1 rle with old method : 0.0008220672607421875 time for calcul the mask position with numpy : 0.01744556427001953 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005297660827636719 time for calcul the mask position with numpy : 0.01736283302307129 nb_pixel_total : 327 time to create 1 rle with old method : 0.00040268898010253906 time for calcul the mask position with numpy : 0.011225223541259766 nb_pixel_total : 749 time to create 1 rle with old method : 0.0008614063262939453 time for calcul the mask position with numpy : 0.011228322982788086 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002834796905517578 time for calcul the mask position with numpy : 0.011156558990478516 nb_pixel_total : 2695 time to create 1 rle with old method : 0.0030481815338134766 time for calcul the mask position with numpy : 0.011915445327758789 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0020389556884765625 time for calcul the mask position with numpy : 0.013438701629638672 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002467632293701172 time for calcul the mask position with numpy : 0.013446807861328125 nb_pixel_total : 974 time to create 1 rle with old method : 0.001142740249633789 time for calcul the mask position with numpy : 0.013035774230957031 nb_pixel_total : 1201 time to create 1 rle with old method : 0.0014028549194335938 time for calcul the mask position with numpy : 0.013251781463623047 nb_pixel_total : 109 time to create 1 rle with old method : 0.00015020370483398438 time for calcul the mask position with numpy : 0.012021064758300781 nb_pixel_total : 996 time to create 1 rle with old method : 0.0011470317840576172 time for calcul the mask position with numpy : 0.01183629035949707 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003447532653808594 time for calcul the mask position with numpy : 0.011792659759521484 nb_pixel_total : 11 time to create 1 rle with old method : 6.008148193359375e-05 time for calcul the mask position with numpy : 0.012134313583374023 nb_pixel_total : 126 time to create 1 rle with old method : 0.00016999244689941406 time for calcul the mask position with numpy : 0.011635303497314453 nb_pixel_total : 123 time to create 1 rle with old method : 0.00015616416931152344 time for calcul the mask position with numpy : 0.011744976043701172 nb_pixel_total : 80 time to create 1 rle with old method : 0.0001380443572998047 time for calcul the mask position with numpy : 0.011272192001342773 nb_pixel_total : 1910 time to create 1 rle with old method : 0.002180814743041992 time for calcul the mask position with numpy : 0.011538505554199219 nb_pixel_total : 2308 time to create 1 rle with old method : 0.002563953399658203 time for calcul the mask position with numpy : 0.01109933853149414 nb_pixel_total : 1625 time to create 1 rle with old method : 0.0018568038940429688 time for calcul the mask position with numpy : 0.011271476745605469 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005421638488769531 time for calcul the mask position with numpy : 0.011224746704101562 nb_pixel_total : 332 time to create 1 rle with old method : 0.0003910064697265625 time for calcul the mask position with numpy : 0.011099100112915039 nb_pixel_total : 1494 time to create 1 rle with old method : 0.0017528533935546875 time for calcul the mask position with numpy : 0.011098384857177734 nb_pixel_total : 659 time to create 1 rle with old method : 0.0007867813110351562 time for calcul the mask position with numpy : 0.010959625244140625 nb_pixel_total : 542 time to create 1 rle with old method : 0.0006661415100097656 time for calcul the mask position with numpy : 0.011176824569702148 nb_pixel_total : 165 time to create 1 rle with old method : 0.00021123886108398438 time for calcul the mask position with numpy : 0.011207103729248047 nb_pixel_total : 569 time to create 1 rle with old method : 0.0006999969482421875 time for calcul the mask position with numpy : 0.011450052261352539 nb_pixel_total : 1044 time to create 1 rle with old method : 0.001245260238647461 time for calcul the mask position with numpy : 0.01105189323425293 nb_pixel_total : 207 time to create 1 rle with old method : 0.00025963783264160156 time for calcul the mask position with numpy : 0.01120615005493164 nb_pixel_total : 410 time to create 1 rle with old method : 0.0004990100860595703 time for calcul the mask position with numpy : 0.011368036270141602 nb_pixel_total : 1446 time to create 1 rle with old method : 0.0017523765563964844 time for calcul the mask position with numpy : 0.011452198028564453 nb_pixel_total : 206 time to create 1 rle with old method : 0.00028228759765625 time for calcul the mask position with numpy : 0.011719703674316406 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005860328674316406 time for calcul the mask position with numpy : 0.011525154113769531 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003635883331298828 time for calcul the mask position with numpy : 0.01152491569519043 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002918243408203125 time for calcul the mask position with numpy : 0.011420011520385742 nb_pixel_total : 320 time to create 1 rle with old method : 0.00040459632873535156 time for calcul the mask position with numpy : 0.011509418487548828 nb_pixel_total : 160 time to create 1 rle with old method : 0.00019860267639160156 time for calcul the mask position with numpy : 0.01159214973449707 nb_pixel_total : 231 time to create 1 rle with old method : 0.0002923011779785156 time for calcul the mask position with numpy : 0.01134634017944336 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005135536193847656 time for calcul the mask position with numpy : 0.011413812637329102 nb_pixel_total : 200 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.01063394546508789 nb_pixel_total : 510 time to create 1 rle with old method : 0.0006222724914550781 time for calcul the mask position with numpy : 0.010921478271484375 nb_pixel_total : 818 time to create 1 rle with old method : 0.0009799003601074219 time for calcul the mask position with numpy : 0.010674476623535156 nb_pixel_total : 17 time to create 1 rle with old method : 5.030632019042969e-05 time for calcul the mask position with numpy : 0.011166572570800781 nb_pixel_total : 80 time to create 1 rle with old method : 0.00011539459228515625 time for calcul the mask position with numpy : 0.0108795166015625 nb_pixel_total : 248 time to create 1 rle with old method : 0.0002963542938232422 time for calcul the mask position with numpy : 0.010874748229980469 nb_pixel_total : 548 time to create 1 rle with old method : 0.0007016658782958984 time for calcul the mask position with numpy : 0.010820627212524414 nb_pixel_total : 568 time to create 1 rle with old method : 0.0006847381591796875 time for calcul the mask position with numpy : 0.01265716552734375 nb_pixel_total : 539 time to create 1 rle with old method : 0.0006403923034667969 time for calcul the mask position with numpy : 0.011799812316894531 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002613067626953125 time for calcul the mask position with numpy : 0.011366128921508789 nb_pixel_total : 349 time to create 1 rle with old method : 0.0006380081176757812 time for calcul the mask position with numpy : 0.011692523956298828 nb_pixel_total : 1414 time to create 1 rle with old method : 0.0023229122161865234 time for calcul the mask position with numpy : 0.011646509170532227 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005962848663330078 time for calcul the mask position with numpy : 0.01171422004699707 nb_pixel_total : 54 time to create 1 rle with old method : 0.00011038780212402344 time for calcul the mask position with numpy : 0.012109041213989258 nb_pixel_total : 251 time to create 1 rle with old method : 0.0004305839538574219 time for calcul the mask position with numpy : 0.012083292007446289 nb_pixel_total : 554 time to create 1 rle with old method : 0.0009336471557617188 time for calcul the mask position with numpy : 0.012050628662109375 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004963874816894531 time for calcul the mask position with numpy : 0.012038230895996094 nb_pixel_total : 885 time to create 1 rle with old method : 0.0010383129119873047 time for calcul the mask position with numpy : 0.010996818542480469 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007264614105224609 time for calcul the mask position with numpy : 0.011155843734741211 nb_pixel_total : 491 time to create 1 rle with old method : 0.0005857944488525391 time for calcul the mask position with numpy : 0.011079549789428711 nb_pixel_total : 1202 time to create 1 rle with old method : 0.0014431476593017578 time for calcul the mask position with numpy : 0.011113405227661133 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001761913299560547 time for calcul the mask position with numpy : 0.011712312698364258 nb_pixel_total : 402 time to create 1 rle with old method : 0.0004878044128417969 time for calcul the mask position with numpy : 0.011473417282104492 nb_pixel_total : 405 time to create 1 rle with old method : 0.0004703998565673828 time for calcul the mask position with numpy : 0.011871099472045898 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005614757537841797 time for calcul the mask position with numpy : 0.011354446411132812 nb_pixel_total : 391 time to create 1 rle with old method : 0.000492095947265625 time for calcul the mask position with numpy : 0.011328935623168945 nb_pixel_total : 117 time to create 1 rle with old method : 0.00015926361083984375 time for calcul the mask position with numpy : 0.011068582534790039 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002899169921875 time for calcul the mask position with numpy : 0.011055231094360352 nb_pixel_total : 82 time to create 1 rle with old method : 0.00012445449829101562 time for calcul the mask position with numpy : 0.011048078536987305 nb_pixel_total : 7492 time to create 1 rle with old method : 0.008455753326416016 time for calcul the mask position with numpy : 0.011118173599243164 nb_pixel_total : 170 time to create 1 rle with old method : 0.00022554397583007812 time for calcul the mask position with numpy : 0.010985612869262695 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002086162567138672 time for calcul the mask position with numpy : 0.011255264282226562 nb_pixel_total : 558 time to create 1 rle with old method : 0.0007112026214599609 time for calcul the mask position with numpy : 0.011218786239624023 nb_pixel_total : 723 time to create 1 rle with old method : 0.0008726119995117188 time for calcul the mask position with numpy : 0.011622428894042969 nb_pixel_total : 2559 time to create 1 rle with old method : 0.002919435501098633 time for calcul the mask position with numpy : 0.012124061584472656 nb_pixel_total : 736 time to create 1 rle with old method : 0.0012149810791015625 time for calcul the mask position with numpy : 0.012161731719970703 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002586841583251953 time for calcul the mask position with numpy : 0.012187480926513672 nb_pixel_total : 370 time to create 1 rle with old method : 0.0006191730499267578 time for calcul the mask position with numpy : 0.012161016464233398 nb_pixel_total : 1395 time to create 1 rle with old method : 0.002277374267578125 time for calcul the mask position with numpy : 0.012131690979003906 nb_pixel_total : 457 time to create 1 rle with old method : 0.0007576942443847656 time for calcul the mask position with numpy : 0.012304306030273438 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0019974708557128906 time for calcul the mask position with numpy : 0.011673688888549805 nb_pixel_total : 875 time to create 1 rle with old method : 0.0010471343994140625 time for calcul the mask position with numpy : 0.011365890502929688 nb_pixel_total : 6956 time to create 1 rle with old method : 0.008069515228271484 time for calcul the mask position with numpy : 0.011377573013305664 nb_pixel_total : 1561 time to create 1 rle with old method : 0.0018727779388427734 time for calcul the mask position with numpy : 0.011331796646118164 nb_pixel_total : 3102 time to create 1 rle with old method : 0.0036978721618652344 time for calcul the mask position with numpy : 0.01100468635559082 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006761550903320312 time for calcul the mask position with numpy : 0.010840177536010742 nb_pixel_total : 8149 time to create 1 rle with old method : 0.009131193161010742 time for calcul the mask position with numpy : 0.010875463485717773 nb_pixel_total : 2642 time to create 1 rle with old method : 0.003093242645263672 time for calcul the mask position with numpy : 0.010792255401611328 nb_pixel_total : 612 time to create 1 rle with old method : 0.0007877349853515625 time for calcul the mask position with numpy : 0.0108642578125 nb_pixel_total : 81 time to create 1 rle with old method : 0.00012683868408203125 time for calcul the mask position with numpy : 0.010966300964355469 nb_pixel_total : 6 time to create 1 rle with old method : 6.270408630371094e-05 time for calcul the mask position with numpy : 0.01106572151184082 nb_pixel_total : 1110 time to create 1 rle with old method : 0.0013170242309570312 time for calcul the mask position with numpy : 0.011569023132324219 nb_pixel_total : 325 time to create 1 rle with old method : 0.0004096031188964844 time for calcul the mask position with numpy : 0.011606931686401367 nb_pixel_total : 605 time to create 1 rle with old method : 0.0010294914245605469 time for calcul the mask position with numpy : 0.011991739273071289 nb_pixel_total : 586 time to create 1 rle with old method : 0.001004934310913086 time for calcul the mask position with numpy : 0.012043952941894531 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004668235778808594 time for calcul the mask position with numpy : 0.01183176040649414 nb_pixel_total : 548 time to create 1 rle with old method : 0.0008919239044189453 time for calcul the mask position with numpy : 0.011789083480834961 nb_pixel_total : 152 time to create 1 rle with old method : 0.0002777576446533203 time for calcul the mask position with numpy : 0.011640787124633789 nb_pixel_total : 1036 time to create 1 rle with old method : 0.0017392635345458984 time for calcul the mask position with numpy : 0.011672735214233398 nb_pixel_total : 49 time to create 1 rle with old method : 0.00012755393981933594 time for calcul the mask position with numpy : 0.010810613632202148 nb_pixel_total : 284 time to create 1 rle with old method : 0.00034356117248535156 time for calcul the mask position with numpy : 0.010788679122924805 nb_pixel_total : 1182 time to create 1 rle with old method : 0.001346588134765625 time for calcul the mask position with numpy : 0.010800600051879883 nb_pixel_total : 185 time to create 1 rle with old method : 0.00021195411682128906 time for calcul the mask position with numpy : 0.01098179817199707 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0012993812561035156 time for calcul the mask position with numpy : 0.010935068130493164 nb_pixel_total : 145 time to create 1 rle with old method : 0.00018334388732910156 time for calcul the mask position with numpy : 0.010807514190673828 nb_pixel_total : 204 time to create 1 rle with old method : 0.00026297569274902344 time for calcul the mask position with numpy : 0.010335445404052734 nb_pixel_total : 177 time to create 1 rle with old method : 0.00024175643920898438 time for calcul the mask position with numpy : 0.010358810424804688 nb_pixel_total : 459 time to create 1 rle with old method : 0.000518798828125 time for calcul the mask position with numpy : 0.01011800765991211 nb_pixel_total : 130 time to create 1 rle with old method : 0.00016832351684570312 time for calcul the mask position with numpy : 0.010172843933105469 nb_pixel_total : 302 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.01014566421508789 nb_pixel_total : 194 time to create 1 rle with old method : 0.00023984909057617188 time for calcul the mask position with numpy : 0.010193347930908203 nb_pixel_total : 280 time to create 1 rle with old method : 0.00031280517578125 time for calcul the mask position with numpy : 0.010205745697021484 nb_pixel_total : 331 time to create 1 rle with old method : 0.00038504600524902344 time for calcul the mask position with numpy : 0.010118961334228516 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001380443572998047 time for calcul the mask position with numpy : 0.013406753540039062 nb_pixel_total : 40 time to create 1 rle with old method : 8.749961853027344e-05 time for calcul the mask position with numpy : 0.01108098030090332 nb_pixel_total : 518 time to create 1 rle with old method : 0.0005674362182617188 time for calcul the mask position with numpy : 0.010504007339477539 nb_pixel_total : 337 time to create 1 rle with old method : 0.0003795623779296875 time for calcul the mask position with numpy : 0.010810136795043945 nb_pixel_total : 6183 time to create 1 rle with old method : 0.0072841644287109375 time for calcul the mask position with numpy : 0.010627269744873047 nb_pixel_total : 1591 time to create 1 rle with old method : 0.0018749237060546875 time for calcul the mask position with numpy : 0.010654687881469727 nb_pixel_total : 746 time to create 1 rle with old method : 0.0008862018585205078 time for calcul the mask position with numpy : 0.010703086853027344 nb_pixel_total : 166 time to create 1 rle with old method : 0.00020074844360351562 time for calcul the mask position with numpy : 0.010772466659545898 nb_pixel_total : 436 time to create 1 rle with old method : 0.000492095947265625 time for calcul the mask position with numpy : 0.010486841201782227 nb_pixel_total : 993 time to create 1 rle with old method : 0.0011870861053466797 time for calcul the mask position with numpy : 0.010338783264160156 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003120899200439453 time for calcul the mask position with numpy : 0.010699033737182617 nb_pixel_total : 133 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.010533332824707031 nb_pixel_total : 761 time to create 1 rle with old method : 0.0008094310760498047 time for calcul the mask position with numpy : 0.010385274887084961 nb_pixel_total : 165 time to create 1 rle with old method : 0.00021767616271972656 time for calcul the mask position with numpy : 0.010274648666381836 nb_pixel_total : 347 time to create 1 rle with old method : 0.00039458274841308594 time for calcul the mask position with numpy : 0.01037907600402832 nb_pixel_total : 544 time to create 1 rle with old method : 0.0005955696105957031 time for calcul the mask position with numpy : 0.010255098342895508 nb_pixel_total : 607 time to create 1 rle with old method : 0.0007104873657226562 time for calcul the mask position with numpy : 0.01006627082824707 nb_pixel_total : 381 time to create 1 rle with old method : 0.0004940032958984375 time for calcul the mask position with numpy : 0.010295391082763672 nb_pixel_total : 1672 time to create 1 rle with old method : 0.0019009113311767578 time for calcul the mask position with numpy : 0.010287761688232422 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005283355712890625 time for calcul the mask position with numpy : 0.010259628295898438 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005357265472412109 time for calcul the mask position with numpy : 0.010088920593261719 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004107952117919922 time for calcul the mask position with numpy : 0.01011967658996582 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004165172576904297 time for calcul the mask position with numpy : 0.010048389434814453 nb_pixel_total : 95 time to create 1 rle with old method : 0.00019860267639160156 time for calcul the mask position with numpy : 0.01035928726196289 nb_pixel_total : 4763 time to create 1 rle with old method : 0.0052373409271240234 time for calcul the mask position with numpy : 0.010444164276123047 nb_pixel_total : 265 time to create 1 rle with old method : 0.00033402442932128906 time for calcul the mask position with numpy : 0.011496305465698242 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001773834228515625 time for calcul the mask position with numpy : 0.010189533233642578 nb_pixel_total : 739 time to create 1 rle with old method : 0.000993967056274414 time for calcul the mask position with numpy : 0.010164260864257812 nb_pixel_total : 11796 time to create 1 rle with old method : 0.013179540634155273 time for calcul the mask position with numpy : 0.01085209846496582 nb_pixel_total : 590 time to create 1 rle with old method : 0.0007257461547851562 time for calcul the mask position with numpy : 0.011328935623168945 nb_pixel_total : 1697 time to create 1 rle with old method : 0.0019364356994628906 time for calcul the mask position with numpy : 0.012955188751220703 nb_pixel_total : 386 time to create 1 rle with old method : 0.0004394054412841797 time for calcul the mask position with numpy : 0.010627985000610352 nb_pixel_total : 241 time to create 1 rle with old method : 0.0002932548522949219 time for calcul the mask position with numpy : 0.010497331619262695 nb_pixel_total : 370 time to create 1 rle with old method : 0.0004417896270751953 time for calcul the mask position with numpy : 0.010409116744995117 nb_pixel_total : 21 time to create 1 rle with old method : 5.173683166503906e-05 time for calcul the mask position with numpy : 0.010796785354614258 nb_pixel_total : 193 time to create 1 rle with old method : 0.00023865699768066406 time for calcul the mask position with numpy : 0.010432243347167969 nb_pixel_total : 1565 time to create 1 rle with old method : 0.0017383098602294922 time for calcul the mask position with numpy : 0.010827302932739258 nb_pixel_total : 670 time to create 1 rle with old method : 0.0007879734039306641 time for calcul the mask position with numpy : 0.010721683502197266 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004589557647705078 time for calcul the mask position with numpy : 0.010661840438842773 nb_pixel_total : 1090 time to create 1 rle with old method : 0.0011408329010009766 time for calcul the mask position with numpy : 0.012131452560424805 nb_pixel_total : 2445 time to create 1 rle with old method : 0.002629995346069336 time for calcul the mask position with numpy : 0.010728120803833008 nb_pixel_total : 94 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.01078343391418457 nb_pixel_total : 1918 time to create 1 rle with old method : 0.002185821533203125 time for calcul the mask position with numpy : 0.01050710678100586 nb_pixel_total : 662 time to create 1 rle with old method : 0.0007531642913818359 time for calcul the mask position with numpy : 0.010735511779785156 nb_pixel_total : 727 time to create 1 rle with old method : 0.0008909702301025391 time for calcul the mask position with numpy : 0.010349273681640625 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006594657897949219 time for calcul the mask position with numpy : 0.0103759765625 nb_pixel_total : 758 time to create 1 rle with old method : 0.0008814334869384766 time for calcul the mask position with numpy : 0.010451078414916992 nb_pixel_total : 472 time to create 1 rle with old method : 0.0005052089691162109 time for calcul the mask position with numpy : 0.010331392288208008 nb_pixel_total : 3024 time to create 1 rle with old method : 0.0034685134887695312 time for calcul the mask position with numpy : 0.010452985763549805 nb_pixel_total : 412 time to create 1 rle with old method : 0.0004832744598388672 time for calcul the mask position with numpy : 0.010540246963500977 nb_pixel_total : 206 time to create 1 rle with old method : 0.000263214111328125 time for calcul the mask position with numpy : 0.010632038116455078 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003094673156738281 time for calcul the mask position with numpy : 0.01052403450012207 nb_pixel_total : 966 time to create 1 rle with old method : 0.0011515617370605469 time for calcul the mask position with numpy : 0.010704517364501953 nb_pixel_total : 808 time to create 1 rle with old method : 0.0009419918060302734 time for calcul the mask position with numpy : 0.010469675064086914 nb_pixel_total : 837 time to create 1 rle with old method : 0.0010437965393066406 time for calcul the mask position with numpy : 0.010747909545898438 nb_pixel_total : 1920 time to create 1 rle with old method : 0.0021915435791015625 time for calcul the mask position with numpy : 0.010812997817993164 nb_pixel_total : 111 time to create 1 rle with old method : 0.00015044212341308594 time for calcul the mask position with numpy : 0.010599374771118164 nb_pixel_total : 167 time to create 1 rle with old method : 0.00019812583923339844 time for calcul the mask position with numpy : 0.010608196258544922 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005249977111816406 time for calcul the mask position with numpy : 0.010637760162353516 nb_pixel_total : 316 time to create 1 rle with old method : 0.0003886222839355469 time for calcul the mask position with numpy : 0.010628700256347656 nb_pixel_total : 306 time to create 1 rle with old method : 0.0004019737243652344 time for calcul the mask position with numpy : 0.010559558868408203 nb_pixel_total : 3179 time to create 1 rle with old method : 0.0035915374755859375 time for calcul the mask position with numpy : 0.010981082916259766 nb_pixel_total : 795 time to create 1 rle with old method : 0.0010030269622802734 time for calcul the mask position with numpy : 0.011014699935913086 nb_pixel_total : 1336 time to create 1 rle with old method : 0.001535654067993164 time for calcul the mask position with numpy : 0.012304067611694336 nb_pixel_total : 37827 time to create 1 rle with old method : 0.042319536209106445 time for calcul the mask position with numpy : 0.01108407974243164 nb_pixel_total : 23797 time to create 1 rle with old method : 0.025612592697143555 time for calcul the mask position with numpy : 0.010453224182128906 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002601146697998047 time for calcul the mask position with numpy : 0.010273218154907227 nb_pixel_total : 319 time to create 1 rle with old method : 0.0003609657287597656 time for calcul the mask position with numpy : 0.011753082275390625 nb_pixel_total : 272 time to create 1 rle with old method : 0.00033020973205566406 time for calcul the mask position with numpy : 0.010904073715209961 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003285408020019531 time for calcul the mask position with numpy : 0.010913372039794922 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002071857452392578 time for calcul the mask position with numpy : 0.011137247085571289 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002491474151611328 time for calcul the mask position with numpy : 0.01110386848449707 nb_pixel_total : 373 time to create 1 rle with old method : 0.00046062469482421875 time for calcul the mask position with numpy : 0.01103663444519043 nb_pixel_total : 1838 time to create 1 rle with old method : 0.0021767616271972656 time for calcul the mask position with numpy : 0.010918855667114258 nb_pixel_total : 205 time to create 1 rle with old method : 0.00026345252990722656 time for calcul the mask position with numpy : 0.011049509048461914 nb_pixel_total : 784 time to create 1 rle with old method : 0.0008890628814697266 time for calcul the mask position with numpy : 0.010819196701049805 nb_pixel_total : 39 time to create 1 rle with old method : 9.72747802734375e-05 time for calcul the mask position with numpy : 0.010555744171142578 nb_pixel_total : 495 time to create 1 rle with old method : 0.0005502700805664062 time for calcul the mask position with numpy : 0.010862112045288086 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006453990936279297 time for calcul the mask position with numpy : 0.012856721878051758 nb_pixel_total : 648 time to create 1 rle with old method : 0.0007686614990234375 time for calcul the mask position with numpy : 0.010906219482421875 nb_pixel_total : 124 time to create 1 rle with old method : 0.00017499923706054688 time for calcul the mask position with numpy : 0.010786771774291992 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005459785461425781 time for calcul the mask position with numpy : 0.012156009674072266 nb_pixel_total : 1668 time to create 1 rle with old method : 0.0018923282623291016 time for calcul the mask position with numpy : 0.010897159576416016 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003781318664550781 time for calcul the mask position with numpy : 0.010767936706542969 nb_pixel_total : 35668 time to create 1 rle with old method : 0.03994941711425781 time for calcul the mask position with numpy : 0.010922670364379883 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004067420959472656 time for calcul the mask position with numpy : 0.010824441909790039 nb_pixel_total : 597 time to create 1 rle with old method : 0.0006716251373291016 time for calcul the mask position with numpy : 0.010794639587402344 nb_pixel_total : 3146 time to create 1 rle with old method : 0.0034499168395996094 time for calcul the mask position with numpy : 0.010715484619140625 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003275871276855469 time for calcul the mask position with numpy : 0.010843276977539062 nb_pixel_total : 443 time to create 1 rle with old method : 0.0004918575286865234 time for calcul the mask position with numpy : 0.01083230972290039 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003600120544433594 time for calcul the mask position with numpy : 0.010811090469360352 nb_pixel_total : 94 time to create 1 rle with old method : 0.00013399124145507812 time for calcul the mask position with numpy : 0.010933399200439453 nb_pixel_total : 135 time to create 1 rle with old method : 0.00018334388732910156 time for calcul the mask position with numpy : 0.01120901107788086 nb_pixel_total : 174 time to create 1 rle with old method : 0.00022649765014648438 create new chi : 3.000303030014038 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.002283811569213867 batch 1 Loaded 221 chid ids of type : 4230 Number RLEs to save : 16747 TO DO : save crop sub photo not yet done ! save time : 1.056929588317871 map_output_result : {1340322893: (0.0, 'Should be the crop_list due to order', 0.0), 1340317758: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340322893, 1340317758] Looping around the photos to save general results len do output : 2 /1340322893.Didn't retrieve data . /1340317758.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340322893', None, None, None, None, None, '2626027') ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340317758', None, None, None, None, None, '2626027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.22651982307434082 save_final save missing photos in datou_result : time spend for datou_step_exec : 31.461938619613647 time spend to save output : 0.22678518295288086 total time spend for step 4 : 31.68872380256653 step5:crop_condition Sat Mar 1 07:21:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 460 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 275 About to insert : list_path_to_insert length 275 new photo from crops ! About to upload 275 photos upload in portfolio : 4869462 init cache_photo without model_param we have 275 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740810104_949903 we have uploaded 275 photos in the portfolio 4869462 time of upload the photos Elapsed time : 73.13703656196594 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 53 About to insert : list_path_to_insert length 53 new photo from crops ! About to upload 53 photos upload in portfolio : 4869462 init cache_photo without model_param we have 53 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740810178_949903 we have uploaded 53 photos in the portfolio 4869462 time of upload the photos Elapsed time : 15.642795085906982 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740810194_949903 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.0995559692382812 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 4869462 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740810196_949903 we have uploaded 26 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.788297653198242 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 4869462 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740810203_949903 we have uploaded 7 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.817145586013794 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340322893, 1340317758] Looping around the photos to save general results len do output : 364 /1340326871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340326999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340327261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340322893', None, None, None, None, None, '2626027') ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340317758', None, None, None, None, None, '2626027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1094 time used for this insertion : 0.09513330459594727 save_final save missing photos in datou_result : time spend for datou_step_exec : 106.77453088760376 time spend to save output : 0.10517549514770508 total time spend for step 5 : 106.87970638275146 step6:thcl Sat Mar 1 07:23:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.020340919494628906 time to convert the images to numpy array : 0.09974861145019531 time to import caffe and check if the image exist : 0.02653813362121582 time to convert the images to numpy array : 0.09726333618164062 time to import caffe and check if the image exist : 0.03048110008239746 time to convert the images to numpy array : 0.10887026786804199 time to import caffe and check if the image exist : 0.02159571647644043 time to convert the images to numpy array : 0.12076854705810547 time to import caffe and check if the image exist : 0.03278231620788574 time to convert the images to numpy array : 0.12101387977600098 time to import caffe and check if the image exist : 0.03671622276306152 time to convert the images to numpy array : 0.11902713775634766 time to import caffe and check if the image exist : 0.035941123962402344 time to convert the images to numpy array : 0.12101483345031738 time to import caffe and check if the image exist : 0.03177642822265625 time to convert the images to numpy array : 0.12613797187805176 time to import caffe and check if the image exist : 0.048574209213256836 time to convert the images to numpy array : 0.1091763973236084 time to import caffe and check if the image exist : 0.03743124008178711 time to convert the images to numpy array : 0.12078738212585449 total time to convert the images to numpy array : 0.5130891799926758 list photo_ids error: [] list photo_ids correct : [1340327227, 1340327228, 1340327229, 1340327230, 1340327231, 1340327233, 1340327234, 1340327235, 1340327236, 1340327237, 1340327238, 1340327239, 1340327240, 1340327241, 1340327242, 1340327243, 1340327244, 1340327245, 1340327246, 1340327247, 1340327248, 1340327249, 1340327250, 1340327251, 1340327255, 1340327256, 1340327257, 1340327258, 1340327259, 1340327260, 1340327261, 1340327061, 1340327062, 1340327063, 1340327064, 1340327065, 1340327066, 1340327067, 1340327068, 1340327069, 1340327070, 1340327071, 1340327072, 1340327073, 1340327074, 1340327075, 1340327076, 1340327077, 1340327078, 1340327079, 1340327080, 1340327081, 1340327082, 1340327083, 1340327084, 1340327085, 1340327086, 1340327087, 1340327088, 1340327090, 1340327091, 1340327092, 1340327093, 1340327094, 1340327095, 1340327096, 1340327097, 1340327098, 1340327137, 1340327138, 1340327139, 1340327140, 1340327141, 1340327142, 1340327143, 1340327144, 1340327145, 1340327146, 1340327147, 1340327148, 1340327149, 1340327150, 1340327151, 1340327152, 1340327157, 1340327162, 1340327163, 1340327164, 1340327165, 1340327166, 1340327167, 1340327168, 1340327169, 1340327170, 1340327171, 1340327172, 1340327173, 1340327174, 1340327175, 1340327176, 1340327177, 1340327178, 1340327179, 1340327180, 1340327181, 1340327182, 1340327183, 1340327184, 1340327185, 1340327186, 1340327187, 1340327188, 1340327189, 1340327190, 1340327191, 1340327192, 1340327193, 1340327194, 1340327195, 1340327196, 1340327197, 1340327198, 1340327199, 1340327200, 1340327201, 1340327202, 1340327203, 1340327204, 1340327205, 1340327206, 1340327207, 1340327208, 1340327209, 1340327210, 1340327211, 1340327212, 1340327213, 1340327214, 1340327215, 1340327217, 1340327225, 1340327226, 1340326910, 1340326911, 1340326912, 1340326913, 1340326914, 1340326915, 1340326916, 1340326917, 1340326918, 1340326919, 1340326920, 1340326921, 1340326922, 1340326923, 1340326924, 1340326925, 1340326926, 1340326927, 1340326928, 1340326929, 1340326930, 1340326931, 1340326932, 1340326933, 1340326935, 1340326936, 1340326937, 1340326938, 1340326939, 1340326940, 1340326941, 1340326942, 1340326943, 1340326944, 1340326945, 1340326946, 1340326947, 1340326985, 1340326986, 1340326987, 1340326988, 1340326989, 1340326990, 1340326991, 1340326992, 1340326993, 1340326994, 1340326995, 1340326996, 1340326997, 1340326998, 1340326999, 1340327000, 1340327001, 1340327003, 1340327004, 1340327005, 1340327006, 1340327007, 1340327008, 1340327009, 1340327010, 1340327011, 1340327012, 1340327013, 1340327014, 1340327015, 1340327016, 1340327017, 1340327018, 1340327019, 1340327020, 1340327021, 1340327022, 1340326948, 1340326949, 1340326950, 1340326951, 1340326952, 1340326953, 1340326954, 1340326955, 1340326956, 1340326957, 1340326958, 1340326959, 1340326960, 1340326961, 1340326962, 1340326963, 1340326964, 1340326965, 1340326966, 1340326967, 1340326968, 1340326969, 1340326970, 1340326971, 1340326972, 1340326973, 1340326974, 1340326975, 1340326976, 1340326977, 1340326978, 1340326979, 1340326980, 1340326981, 1340326982, 1340326983, 1340326984, 1340326871, 1340326873, 1340326874, 1340326875, 1340326876, 1340326877, 1340326878, 1340326879, 1340326880, 1340326881, 1340326882, 1340326883, 1340326884, 1340326885, 1340326886, 1340326887, 1340326888, 1340326889, 1340326890, 1340326891, 1340326892, 1340326893, 1340326894, 1340326895, 1340326896, 1340326897, 1340326898, 1340326899, 1340326900, 1340326901, 1340326902, 1340326904, 1340326905, 1340326906, 1340326907, 1340326908, 1340326909, 1340327023, 1340327024, 1340327025, 1340327026, 1340327027, 1340327028, 1340327029, 1340327030, 1340327031, 1340327033, 1340327034, 1340327035, 1340327036, 1340327037, 1340327038, 1340327039, 1340327040, 1340327041, 1340327042, 1340327043, 1340327044, 1340327045, 1340327046, 1340327047, 1340327048, 1340327049, 1340327050, 1340327051, 1340327052, 1340327053, 1340327054, 1340327055, 1340327056, 1340327057, 1340327058, 1340327059, 1340327060, 1340327099, 1340327100, 1340327101, 1340327102, 1340327103, 1340327104, 1340327105, 1340327106, 1340327107, 1340327108, 1340327109, 1340327110, 1340327111, 1340327112, 1340327113, 1340327115, 1340327116, 1340327117, 1340327118, 1340327119, 1340327120, 1340327121, 1340327122, 1340327123, 1340327124, 1340327125, 1340327126, 1340327127, 1340327128, 1340327129, 1340327130, 1340327131, 1340327132, 1340327133, 1340327134, 1340327135, 1340327136] number of photos to traite : 364 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5525 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5306 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.5930225849151611 time used to do the prediction : 1.3039846420288086 save descriptor for thcl : 3237 time to traite the descriptors : 2.0303843021392822 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340327227 To insert : 1340327228 To insert : 1340327229 To insert : 1340327230 To insert : 1340327231 To insert : 1340327233 To insert : 1340327234 To insert : 1340327235 To insert : 1340327236 To insert : 1340327237 To insert : 1340327238 To insert : 1340327239 To insert : 1340327240 To insert : 1340327241 To insert : 1340327242 To insert : 1340327243 To insert : 1340327244 To insert : 1340327245 To insert : 1340327246 To insert : 1340327247 To insert : 1340327248 To insert : 1340327249 To insert : 1340327250 To insert : 1340327251 To insert : 1340327255 To insert : 1340327256 To insert : 1340327257 To insert : 1340327258 To insert : 1340327259 To insert : 1340327260 To insert : 1340327261 To insert : 1340327061 To insert : 1340327062 To insert : 1340327063 To insert : 1340327064 To insert : 1340327065 To insert : 1340327066 To insert : 1340327067 To insert : 1340327068 To insert : 1340327069 To insert : 1340327070 To insert : 1340327071 To insert : 1340327072 To insert : 1340327073 To insert : 1340327074 To insert : 1340327075 To insert : 1340327076 To insert : 1340327077 To insert : 1340327078 To insert : 1340327079 To insert : 1340327080 To insert : 1340327081 To insert : 1340327082 To insert : 1340327083 To insert : 1340327084 To insert : 1340327085 To insert : 1340327086 To insert : 1340327087 To insert : 1340327088 To insert : 1340327090 To insert : 1340327091 To insert : 1340327092 To insert : 1340327093 To insert : 1340327094 To insert : 1340327095 To insert : 1340327096 To insert : 1340327097 To insert : 1340327098 To insert : 1340327137 To insert : 1340327138 To insert : 1340327139 To insert : 1340327140 To insert : 1340327141 To insert : 1340327142 To insert : 1340327143 To insert : 1340327144 To insert : 1340327145 To insert : 1340327146 To insert : 1340327147 To insert : 1340327148 To insert : 1340327149 To insert : 1340327150 To insert : 1340327151 To insert : 1340327152 To insert : 1340327157 To insert : 1340327162 To insert : 1340327163 To insert : 1340327164 To insert : 1340327165 To insert : 1340327166 To insert : 1340327167 To insert : 1340327168 To insert : 1340327169 To insert : 1340327170 To insert : 1340327171 To insert : 1340327172 To insert : 1340327173 To insert : 1340327174 To insert : 1340327175 To insert : 1340327176 To insert : 1340327177 To insert : 1340327178 To insert : 1340327179 To insert : 1340327180 To insert : 1340327181 To insert : 1340327182 To insert : 1340327183 To insert : 1340327184 To insert : 1340327185 To insert : 1340327186 To insert : 1340327187 To insert : 1340327188 To insert : 1340327189 To insert : 1340327190 To insert : 1340327191 To insert : 1340327192 To insert : 1340327193 To insert : 1340327194 To insert : 1340327195 To insert : 1340327196 To insert : 1340327197 To insert : 1340327198 To insert : 1340327199 To insert : 1340327200 To insert : 1340327201 To insert : 1340327202 To insert : 1340327203 To insert : 1340327204 To insert : 1340327205 To insert : 1340327206 To insert : 1340327207 To insert : 1340327208 To insert : 1340327209 To insert : 1340327210 To insert : 1340327211 To insert : 1340327212 To insert : 1340327213 To insert : 1340327214 To insert : 1340327215 To insert : 1340327217 To insert : 1340327225 To insert : 1340327226 To insert : 1340326910 To insert : 1340326911 To insert : 1340326912 To insert : 1340326913 To insert : 1340326914 To insert : 1340326915 To insert : 1340326916 To insert : 1340326917 To insert : 1340326918 To insert : 1340326919 To insert : 1340326920 To insert : 1340326921 To insert : 1340326922 To insert : 1340326923 To insert : 1340326924 To insert : 1340326925 To insert : 1340326926 To insert : 1340326927 To insert : 1340326928 To insert : 1340326929 To insert : 1340326930 To insert : 1340326931 To insert : 1340326932 To insert : 1340326933 To insert : 1340326935 To insert : 1340326936 To insert : 1340326937 To insert : 1340326938 To insert : 1340326939 To insert : 1340326940 To insert : 1340326941 To insert : 1340326942 To insert : 1340326943 To insert : 1340326944 To insert : 1340326945 To insert : 1340326946 To insert : 1340326947 To insert : 1340326985 To insert : 1340326986 To insert : 1340326987 To insert : 1340326988 To insert : 1340326989 To insert : 1340326990 To insert : 1340326991 To insert : 1340326992 To insert : 1340326993 To insert : 1340326994 To insert : 1340326995 To insert : 1340326996 To insert : 1340326997 To insert : 1340326998 To insert : 1340326999 To insert : 1340327000 To insert : 1340327001 To insert : 1340327003 To insert : 1340327004 To insert : 1340327005 To insert : 1340327006 To insert : 1340327007 To insert : 1340327008 To insert : 1340327009 To insert : 1340327010 To insert : 1340327011 To insert : 1340327012 To insert : 1340327013 To insert : 1340327014 To insert : 1340327015 To insert : 1340327016 To insert : 1340327017 To insert : 1340327018 To insert : 1340327019 To insert : 1340327020 To insert : 1340327021 To insert : 1340327022 To insert : 1340326948 To insert : 1340326949 To insert : 1340326950 To insert : 1340326951 To insert : 1340326952 To insert : 1340326953 To insert : 1340326954 To insert : 1340326955 To insert : 1340326956 To insert : 1340326957 To insert : 1340326958 To insert : 1340326959 To insert : 1340326960 To insert : 1340326961 To insert : 1340326962 To insert : 1340326963 To insert : 1340326964 To insert : 1340326965 To insert : 1340326966 To insert : 1340326967 To insert : 1340326968 To insert : 1340326969 To insert : 1340326970 To insert : 1340326971 To insert : 1340326972 To insert : 1340326973 To insert : 1340326974 To insert : 1340326975 To insert : 1340326976 To insert : 1340326977 To insert : 1340326978 To insert : 1340326979 To insert : 1340326980 To insert : 1340326981 To insert : 1340326982 To insert : 1340326983 To insert : 1340326984 To insert : 1340326871 To insert : 1340326873 To insert : 1340326874 To insert : 1340326875 To insert : 1340326876 To insert : 1340326877 To insert : 1340326878 To insert : 1340326879 To insert : 1340326880 To insert : 1340326881 To insert : 1340326882 To insert : 1340326883 To insert : 1340326884 To insert : 1340326885 To insert : 1340326886 To insert : 1340326887 To insert : 1340326888 To insert : 1340326889 To insert : 1340326890 To insert : 1340326891 To insert : 1340326892 To insert : 1340326893 To insert : 1340326894 To insert : 1340326895 To insert : 1340326896 To insert : 1340326897 To insert : 1340326898 To insert : 1340326899 To insert : 1340326900 To insert : 1340326901 To insert : 1340326902 To insert : 1340326904 To insert : 1340326905 To insert : 1340326906 To insert : 1340326907 To insert : 1340326908 To insert : 1340326909 To insert : 1340327023 To insert : 1340327024 To insert : 1340327025 To insert : 1340327026 To insert : 1340327027 To insert : 1340327028 To insert : 1340327029 To insert : 1340327030 To insert : 1340327031 To insert : 1340327033 To insert : 1340327034 To insert : 1340327035 To insert : 1340327036 To insert : 1340327037 To insert : 1340327038 To insert : 1340327039 To insert : 1340327040 To insert : 1340327041 To insert : 1340327042 To insert : 1340327043 To insert : 1340327044 To insert : 1340327045 To insert : 1340327046 To insert : 1340327047 To insert : 1340327048 To insert : 1340327049 To insert : 1340327050 To insert : 1340327051 To insert : 1340327052 To insert : 1340327053 To insert : 1340327054 To insert : 1340327055 To insert : 1340327056 To insert : 1340327057 To insert : 1340327058 To insert : 1340327059 To insert : 1340327060 To insert : 1340327099 To insert : 1340327100 To insert : 1340327101 To insert : 1340327102 To insert : 1340327103 To insert : 1340327104 To insert : 1340327105 To insert : 1340327106 To insert : 1340327107 To insert : 1340327108 To insert : 1340327109 To insert : 1340327110 To insert : 1340327111 To insert : 1340327112 To insert : 1340327113 To insert : 1340327115 To insert : 1340327116 To insert : 1340327117 To insert : 1340327118 To insert : 1340327119 To insert : 1340327120 To insert : 1340327121 To insert : 1340327122 To insert : 1340327123 To insert : 1340327124 To insert : 1340327125 To insert : 1340327126 To insert : 1340327127 To insert : 1340327128 To insert : 1340327129 To insert : 1340327130 To insert : 1340327131 To insert : 1340327132 To insert : 1340327133 To insert : 1340327134 To insert : 1340327135 To insert : 1340327136 time to insert the descriptors : 79.93895840644836 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 541 time used for this insertion : 0.06471872329711914 save missing photos in datou_result : time spend for datou_step_exec : 89.481281042099 time spend to save output : 0.12460756301879883 total time spend for step 6 : 89.6058886051178 step7:ventilate_hashtags_in_portfolio Sat Mar 1 07:24:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20947069 get user id for portfolio 20947069 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20947069 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','mal_croppe','Film_plastique','PEHD','papier','pet_fonce','Tetrapak','Papier','refus','carton','metal','flou','pet_clair','Carton','PET_fonce','pehd','PET_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20947069 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','mal_croppe','Film_plastique','PEHD','papier','pet_fonce','Tetrapak','Papier','refus','carton','metal','flou','pet_clair','Carton','PET_fonce','pehd','PET_clair')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20947069 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','mal_croppe','Film_plastique','PEHD','papier','pet_fonce','Tetrapak','Papier','refus','carton','metal','flou','pet_clair','Carton','PET_fonce','pehd','PET_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20947069 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','mal_croppe','Film_plastique','PEHD','papier','pet_fonce','Tetrapak','Papier','refus','carton','metal','flou','pet_clair','Carton','PET_fonce','pehd','PET_clair')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20947299,20947300,20947301,20947302,20947315,20947307,20947314,20947306,20947308,20947313,20947310,20947311,20947316?tags=environnement,autre,mal_croppe,film_plastique,pehd,papier,pet_fonce,tetrapak,refus,carton,metal,flou,pet_clair&datou_id_consolidate=4235&port_consolidate=20947069 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340322893, 1340317758] Looping around the photos to save general results len do output : 1 /20947069. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340322893', None, None, None, None, None, '2626027') ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340317758', None, None, None, None, None, '2626027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01317739486694336 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.67509388923645 time spend to save output : 0.013462543487548828 total time spend for step 7 : 2.688556432723999 step8:final Sat Mar 1 07:24:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340322893: ('0.8225759514511507',), 1340317758: ('0.8225759514511507',)} new output for save of step final : {1340322893: ('0.8225759514511507',), 1340317758: ('0.8225759514511507',)} [1340322893, 1340317758] Looping around the photos to save general results len do output : 2 /1340322893.Didn't retrieve data . /1340317758.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340322893', None, None, None, None, None, '2626027') ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340317758', None, None, None, None, None, '2626027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01612234115600586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12882590293884277 time spend to save output : 0.016642093658447266 total time spend for step 8 : 0.14546799659729004 step9:velours_tree Sat Mar 1 07:24:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20947299,20947300,20947301,20947302,20947315,20947307,20947314,20947306,20947308,20947313,20947310,20947311,20947316 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947299 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947300 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947301 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947302 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947315 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947307 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947314 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947306 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947308 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947313 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947310 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947311 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947316 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 364 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [0 3 3 1 2 0 5 2 1 3 0 1 5 1 0 0 5 0 0 1 5 5 1 1 2 0 2 3 0 3 2 3 5 1 5 0 3 4 4 3 0 5 5 2 0 0 2 0 4 0 1 2 0 5 0 3 5 3 2 2 4 3 5 5 3 5 3 2 1 0 3 1 3 0 5 2 4 0 5 3 0 5 5 1 3 3 0 0 0 0 1 0 1 5 2 1 0 1 5 3 1 0 3 0 5 0 2 1 2 0 2 0 2 0 4 4 5 0 4 3 0 4 4 4 4 0 0 3 4 2 0 2 2 0 2 0 0 0 5 3 4 5 3 0 2 1 0 1 0 1 5 2 1 0 5 1 1 0 2 2 2 0 3 5 0 0 4 3 3 1 5 1 1 5 2 0 0 0 0 1 0 5 0 0 3 5 3 3 3 4 2 0 5 5 3 0 0 5 2 1 1 2 0 0 5 0 0 0 0 1 3 3 0 3 0 0 0 2 2 0 3 5 3 1 0 0 3 0 5 5 0 0 2 4 5 2 0 4 1 5 0 2 4 0 4 4 4 0 3 4 4 4 0 0 2 0 0 2 0 3 5 5 2 0 0 2 4 2 0 0 0 0 5 3 3 4 2 0 4 1 4 5 3 2 0 0 4 0 2 0 2 4 2 4 1 0 3 0 4 0 4 2 4 5 4 1 4 2 4 5 0 4 0 0 4 2 3 2 2 2 4 2 1 4 3 3 2 4 2 0 3 5 0 4 1 4 1 0 5 4 1 3 1 5 3 5 1 1 0 5 1 2 0 4 3 4 4 4 2 3 1 4 3 2] Elapsed time: 0.1033334732055664 graph_id used : 80816 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20947299,20947300,20947301,20947302,20947315,20947307,20947314,20947306,20947308,20947313,20947310,20947311,20947316?tags=environnement,autre,mal_croppe,film_plastique,pehd,papier,pet_fonce,tetrapak,refus,carton,metal,flou,pet_clair&datou_id_consolidate=4235&port_consolidate=20947069&tree_id=80816 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340322893, 1340317758] Looping around the photos to save general results len do output : 1 /20947069Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340322893', None, None, None, None, None, '2626027') ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340317758', None, None, None, None, None, '2626027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01605081558227539 save_final save missing photos in datou_result : time spend for datou_step_exec : 23.695070266723633 time spend to save output : 0.01643061637878418 total time spend for step 9 : 23.711500883102417 step10:send_mail_cod Sat Mar 1 07:25:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20947069_01-03-2025_07_25_21.pdf 20947282 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209472821740810321 20947283 imagette209472831740810321 20947284 imagette209472841740810321 20947297 imagette209472971740810321 20947289 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209472891740810321 20947296 imagette209472961740810322 20947288 imagette209472881740810322 20947290 imagette209472901740810322 20947295 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209472951740810322 20947292 change filename to text .change filename to text .change filename to text .imagette209472921740810324 20947293 imagette209472931740810324 20947298 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209472981740810324 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20947069 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20947299,20947300,20947301,20947302,20947315,20947307,20947314,20947306,20947308,20947313,20947310,20947311,20947316?tags=environnement,autre,mal_croppe,film_plastique,pehd,papier,pet_fonce,tetrapak,refus,carton,metal,flou,pet_clair&datou_id_consolidate=4235&port_consolidate=20947069&tree_id=80816 your option no_mail is active, we will not send the real mail to your client args[1340322893] : ((1340322893, -7.959428363210358, 492609224), (1340322893, 0.2657332995362311, 2107752395), '0.8225759514511507') We are sending mail with results at cod@fotonower.com args[1340317758] : ((1340317758, -7.864988979799694, 492609224), (1340317758, 0.2877261663575225, 2107752395), '0.8225759514511507') We are sending mail with results at cod@fotonower.com refus_total : 0.8225759514511507 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20947069 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20947069_01-03-2025_07_25_21.pdf results_Qualipapia_P20947069_01-03-2025_07_25_21.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20947069_01-03-2025_07_25_21.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20947069','results_Qualipapia_P20947069_01-03-2025_07_25_21.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20947069_01-03-2025_07_25_21.pdf','pdf','','0.16','0.8225759514511507') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340322893, 1340317758] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340322893', None, None, None, None, None, '2626027') ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340317758', None, None, None, None, None, '2626027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.017673969268798828 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.306842565536499 time spend to save output : 0.017993927001953125 total time spend for step 10 : 8.324836492538452 step11:split_time_score Sat Mar 1 07:25:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01032025 20947069 Nombre de photos uploadées : 2 / 23040 (0%) 01032025 20947069 Nombre de photos taguées (types de déchets): 0 / 2 (0%) 01032025 20947069 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00022935867309570312 elapsed_time : insert_dashboard_record_day_entry 0.22623777389526367 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.8088971253050049 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20944757_01-03-2025_03_07_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20944757 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20944757 AND mptpi.`type`=4230 To do Qualite : 0.8141556001545349 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20944759_01-03-2025_03_01_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20944759 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20944759 AND mptpi.`type`=4230 To do Qualite : 0.8272970248023018 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20945562_01-03-2025_03_59_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20945562 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20945562 AND mptpi.`type`=4230 To do Qualite : 0.8270490640250248 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20946650_01-03-2025_06_05_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20946650 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20946650 AND mptpi.`type`=4230 To do Qualite : 0.8225759514511507 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20947069_01-03-2025_07_25_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20947069 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20947069 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01032025': {'nb_upload': 2, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340322893, 1340317758] Looping around the photos to save general results len do output : 1 /20947069Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340322893', None, None, None, None, None, '2626027') ('4234', None, None, None, None, None, None, None, '2626027') ('4234', '20947069', '1340317758', None, None, None, None, None, '2626027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.18227601051330566 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.962219953536987 time spend to save output : 0.18250465393066406 total time spend for step 11 : 6.144724607467651 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 53.62user 35.24system 5:10.77elapsed 28%CPU (0avgtext+0avgdata 7163724maxresident)k 2657072inputs+22368outputs (9212major+4940520minor)pagefaults 0swaps