python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2798694 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2576341'] with mtr_portfolio_ids : ['20445087'] and first list_photo_ids : [] new path : /proc/2798694/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.47202205657958984 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Feb 11 14:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-11 14:20:32.850738: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-11 14:20:32.879295: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-11 14:20:32.881002: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9668000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-11 14:20:32.881069: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-11 14:20:32.884081: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-11 14:20:33.146962: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x291f8910 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-11 14:20:33.147017: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-11 14:20:33.148041: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-11 14:20:33.148853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-11 14:20:33.153875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-11 14:20:33.157562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-11 14:20:33.159145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-11 14:20:33.166526: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-11 14:20:33.186969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-11 14:20:33.225043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-11 14:20:33.226579: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-11 14:20:33.226650: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-11 14:20:33.227473: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-11 14:20:33.227491: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-11 14:20:33.227500: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-11 14:20:33.229151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-11 14:20:33.687146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-11 14:20:33.687242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-11 14:20:33.687266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-11 14:20:33.687287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-11 14:20:33.687307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-11 14:20:33.687327: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-11 14:20:33.687346: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-11 14:20:33.687366: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-11 14:20:33.689038: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-11 14:20:33.690550: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-11 14:20:33.690614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-11 14:20:33.690644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-11 14:20:33.690671: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-11 14:20:33.690701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-11 14:20:33.690732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-11 14:20:33.690755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-11 14:20:33.690773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-11 14:20:33.692260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-11 14:20:33.692294: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-11 14:20:33.692303: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-11 14:20:33.692311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-11 14:20:33.693651: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-11 14:20:40.966271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-11 14:20:41.178415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.15313 max: 149.08437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.250640869140625e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0007493495941162109 length of segment : 20 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 829 time to create 1 rle with old method : 0.00613093376159668 length of segment : 43 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 740 time to create 1 rle with old method : 0.0014452934265136719 length of segment : 29 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 44 time to create 1 rle with old method : 0.00011348724365234375 length of segment : 18 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00018310546875 length of segment : 26 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1 time to create 1 rle with old method : 2.956390380859375e-05 length of segment : 1 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00025391578674316406 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.77422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006992816925048828 length of segment : 34 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007772445678710938 length of segment : 44 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 938 time to create 1 rle with old method : 0.0013818740844726562 length of segment : 29 time for calcul the mask position with numpy : 0.00014019012451171875 nb_pixel_total : 2817 time to create 1 rle with old method : 0.0039026737213134766 length of segment : 81 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0012774467468261719 length of segment : 29 time for calcul the mask position with numpy : 0.0001308917999267578 nb_pixel_total : 3979 time to create 1 rle with old method : 0.004850864410400391 length of segment : 83 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0010693073272705078 length of segment : 61 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1498 time to create 1 rle with old method : 0.0019245147705078125 length of segment : 31 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 2680 time to create 1 rle with old method : 0.0034270286560058594 length of segment : 57 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 920 time to create 1 rle with old method : 0.0012362003326416016 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.17266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 2219 time to create 1 rle with old method : 0.0026798248291015625 length of segment : 59 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007243156433105469 length of segment : 21 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1388 time to create 1 rle with old method : 0.002007722854614258 length of segment : 32 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003497600555419922 length of segment : 12 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002987384796142578 length of segment : 8 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.82891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00018596649169921875 length of segment : 15 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0008876323699951172 length of segment : 54 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003006458282470703 length of segment : 22 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 2572 time to create 1 rle with old method : 0.0037114620208740234 length of segment : 137 time for calcul the mask position with numpy : 0.00032973289489746094 nb_pixel_total : 13326 time to create 1 rle with old method : 0.018010377883911133 length of segment : 149 time for calcul the mask position with numpy : 0.00015091896057128906 nb_pixel_total : 3747 time to create 1 rle with old method : 0.005234956741333008 length of segment : 63 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 131.27812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0008127689361572266 length of segment : 22 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1433 time to create 1 rle with old method : 0.0017654895782470703 length of segment : 136 time for calcul the mask position with numpy : 0.00020647048950195312 nb_pixel_total : 2439 time to create 1 rle with old method : 0.003258943557739258 length of segment : 134 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 190.00000 molded_images shape: (1, 640, 640, 3) min: -88.84141 max: 62.15313 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.09844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1691 time to create 1 rle with old method : 0.002125978469848633 length of segment : 31 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0007922649383544922 length of segment : 16 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0006029605865478516 length of segment : 17 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 2731 time to create 1 rle with old method : 0.004045009613037109 length of segment : 52 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00033545494079589844 length of segment : 20 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006444454193115234 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.0005161762237548828 length of segment : 19 time for calcul the mask position with numpy : 0.0001533031463623047 nb_pixel_total : 5517 time to create 1 rle with old method : 0.00732111930847168 length of segment : 135 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 701 time to create 1 rle with old method : 0.0009226799011230469 length of segment : 40 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 802 time to create 1 rle with old method : 0.0010085105895996094 length of segment : 30 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00016307830810546875 length of segment : 12 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 2731 time to create 1 rle with old method : 0.0033125877380371094 length of segment : 50 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 729 time to create 1 rle with old method : 0.0009968280792236328 length of segment : 36 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 741 time to create 1 rle with old method : 0.0009849071502685547 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.07109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 0.00010228157043457031 nb_pixel_total : 414 time to create 1 rle with old method : 0.0011477470397949219 length of segment : 33 time for calcul the mask position with numpy : 0.00012636184692382812 nb_pixel_total : 798 time to create 1 rle with old method : 0.0015454292297363281 length of segment : 47 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.001065969467163086 length of segment : 63 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 1963 time to create 1 rle with old method : 0.002603292465209961 length of segment : 81 time for calcul the mask position with numpy : 0.0001780986785888672 nb_pixel_total : 4392 time to create 1 rle with old method : 0.005652427673339844 length of segment : 118 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.0010457038879394531 length of segment : 54 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0005450248718261719 length of segment : 21 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0012392997741699219 length of segment : 78 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0007193088531494141 length of segment : 19 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00018930435180664062 length of segment : 14 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1058 time to create 1 rle with old method : 0.00150299072265625 length of segment : 31 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005261898040771484 length of segment : 56 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 1180 time to create 1 rle with old method : 0.001659393310546875 length of segment : 37 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 6416 time to create 1 rle with old method : 0.007905721664428711 length of segment : 88 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 679 time to create 1 rle with old method : 0.0008833408355712891 length of segment : 30 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1759 time to create 1 rle with old method : 0.0022771358489990234 length of segment : 70 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 631 time to create 1 rle with old method : 0.0009479522705078125 length of segment : 18 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1744 time to create 1 rle with old method : 0.0022144317626953125 length of segment : 76 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.18828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 2516 time to create 1 rle with old method : 0.0030074119567871094 length of segment : 152 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1209 time to create 1 rle with old method : 0.0014340877532958984 length of segment : 100 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0015478134155273438 length of segment : 31 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0013344287872314453 length of segment : 40 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 894 time to create 1 rle with old method : 0.0012288093566894531 length of segment : 33 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 825 time to create 1 rle with old method : 0.0009784698486328125 length of segment : 43 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 826 time to create 1 rle with old method : 0.001125335693359375 length of segment : 48 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.0009992122650146484 length of segment : 31 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.00045752525329589844 length of segment : 42 time for calcul the mask position with numpy : 0.00022792816162109375 nb_pixel_total : 4070 time to create 1 rle with old method : 0.004968404769897461 length of segment : 193 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0016698837280273438 length of segment : 77 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.00036025047302246094 length of segment : 27 time for calcul the mask position with numpy : 0.0002262592315673828 nb_pixel_total : 4311 time to create 1 rle with old method : 0.005214214324951172 length of segment : 201 Processing 1 images image shape: (280, 400, 3) min: 3.00000 max: 180.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 47.89531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010097026824951172 nb_pixel_total : 106277 time to create 1 rle with old method : 0.11855411529541016 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.81875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007727146148681641 length of segment : 46 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0007741451263427734 length of segment : 59 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 3474 time to create 1 rle with old method : 0.004701137542724609 length of segment : 63 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0006115436553955078 length of segment : 27 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.0010840892791748047 length of segment : 34 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003097057342529297 length of segment : 21 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0008790493011474609 length of segment : 30 time for calcul the mask position with numpy : 0.0001556873321533203 nb_pixel_total : 4457 time to create 1 rle with old method : 0.005602121353149414 length of segment : 140 time for calcul the mask position with numpy : 0.000152587890625 nb_pixel_total : 32 time to create 1 rle with old method : 8.988380432128906e-05 length of segment : 9 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007822513580322266 length of segment : 33 time for calcul the mask position with numpy : 0.000102996826171875 nb_pixel_total : 668 time to create 1 rle with old method : 0.0010936260223388672 length of segment : 36 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1442 time to create 1 rle with old method : 0.0019161701202392578 length of segment : 37 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006418228149414062 length of segment : 26 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.05312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0013768672943115234 length of segment : 39 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003657341003417969 length of segment : 17 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0007250308990478516 length of segment : 20 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001518726348876953 length of segment : 11 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00034356117248535156 length of segment : 12 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003743171691894531 length of segment : 21 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1017 time to create 1 rle with old method : 0.001316070556640625 length of segment : 44 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00030517578125 length of segment : 15 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0002589225769042969 length of segment : 11 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005931854248046875 length of segment : 26 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.00039887428283691406 length of segment : 20 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0006268024444580078 length of segment : 28 time for calcul the mask position with numpy : 0.00011920928955078125 nb_pixel_total : 412 time to create 1 rle with old method : 0.0010106563568115234 length of segment : 49 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0008759498596191406 length of segment : 24 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0006048679351806641 length of segment : 24 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 30 time to create 1 rle with old method : 9.441375732421875e-05 length of segment : 28 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00043511390686035156 length of segment : 27 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0016872882843017578 length of segment : 53 time for calcul the mask position with numpy : 0.0006549358367919922 nb_pixel_total : 27966 time to create 1 rle with old method : 0.04913139343261719 length of segment : 422 time for calcul the mask position with numpy : 0.0005564689636230469 nb_pixel_total : 5325 time to create 1 rle with old method : 0.008700370788574219 length of segment : 273 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 1777 time to create 1 rle with old method : 0.002390623092651367 length of segment : 140 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0004382133483886719 nb_pixel_total : 36244 time to create 1 rle with old method : 0.041043758392333984 length of segment : 242 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 108 time to create 1 rle with old method : 0.00018739700317382812 length of segment : 27 time for calcul the mask position with numpy : 0.0004885196685791016 nb_pixel_total : 31947 time to create 1 rle with old method : 0.03803133964538574 length of segment : 211 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.66484 max: 149.95547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.0015027523040771484 length of segment : 35 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0008463859558105469 length of segment : 20 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 18 time to create 1 rle with old method : 5.793571472167969e-05 length of segment : 7 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00014448165893554688 length of segment : 28 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.0013241767883300781 length of segment : 30 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 23 time to create 1 rle with old method : 0.00014328956604003906 length of segment : 5 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 3 time to create 1 rle with old method : 3.170967102050781e-05 length of segment : 2 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 1 time to create 1 rle with old method : 2.09808349609375e-05 length of segment : 1 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1638 time to create 1 rle with old method : 0.0024580955505371094 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.20391 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 1125 time to create 1 rle with old method : 0.005030393600463867 length of segment : 32 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 968 time to create 1 rle with old method : 0.002489805221557617 length of segment : 28 time for calcul the mask position with numpy : 0.00012636184692382812 nb_pixel_total : 2981 time to create 1 rle with old method : 0.004408597946166992 length of segment : 62 time for calcul the mask position with numpy : 0.0001316070556640625 nb_pixel_total : 1769 time to create 1 rle with old method : 0.0033690929412841797 length of segment : 38 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0007662773132324219 length of segment : 35 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1127 time to create 1 rle with old method : 0.0017688274383544922 length of segment : 32 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 926 time to create 1 rle with old method : 0.0015456676483154297 length of segment : 29 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0005743503570556641 length of segment : 14 time for calcul the mask position with numpy : 0.00015211105346679688 nb_pixel_total : 3993 time to create 1 rle with old method : 0.007809638977050781 length of segment : 60 time for calcul the mask position with numpy : 0.00011086463928222656 nb_pixel_total : 2489 time to create 1 rle with old method : 0.004449129104614258 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.93047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 513 time to create 1 rle with old method : 0.0007085800170898438 length of segment : 20 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 1897 time to create 1 rle with old method : 0.002513885498046875 length of segment : 54 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.00043582916259765625 length of segment : 8 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.28203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00018405914306640625 nb_pixel_total : 3627 time to create 1 rle with old method : 0.006966829299926758 length of segment : 140 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.000179290771484375 length of segment : 15 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 699 time to create 1 rle with old method : 0.0011165142059326172 length of segment : 80 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004639625549316406 length of segment : 20 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002205371856689453 length of segment : 13 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.00022649765014648438 length of segment : 17 time for calcul the mask position with numpy : 0.00023221969604492188 nb_pixel_total : 9900 time to create 1 rle with old method : 0.012498855590820312 length of segment : 187 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 128.64297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0012476444244384766 length of segment : 22 time for calcul the mask position with numpy : 0.0003025531768798828 nb_pixel_total : 1489 time to create 1 rle with old method : 0.0046956539154052734 length of segment : 148 time for calcul the mask position with numpy : 0.00020170211791992188 nb_pixel_total : 1907 time to create 1 rle with old method : 0.0047702789306640625 length of segment : 138 time for calcul the mask position with numpy : 0.00018095970153808594 nb_pixel_total : 2316 time to create 1 rle with old method : 0.002866029739379883 length of segment : 117 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -91.59531 max: 59.91484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.55938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1766 time to create 1 rle with old method : 0.002760648727416992 length of segment : 33 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0008294582366943359 length of segment : 17 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004324913024902344 length of segment : 19 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 2758 time to create 1 rle with old method : 0.004150867462158203 length of segment : 53 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 909 time to create 1 rle with old method : 0.0015954971313476562 length of segment : 33 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0005207061767578125 length of segment : 23 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0005080699920654297 length of segment : 17 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0012819766998291016 length of segment : 40 time for calcul the mask position with numpy : 0.0002620220184326172 nb_pixel_total : 9465 time to create 1 rle with old method : 0.013582944869995117 length of segment : 150 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 2719 time to create 1 rle with old method : 0.00337982177734375 length of segment : 49 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0006840229034423828 length of segment : 18 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0011286735534667969 length of segment : 39 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.0010440349578857422 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.56328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006971359252929688 length of segment : 34 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 973 time to create 1 rle with old method : 0.00142669677734375 length of segment : 48 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 653 time to create 1 rle with old method : 0.0009698867797851562 length of segment : 50 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0005006790161132812 length of segment : 48 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 4114 time to create 1 rle with old method : 0.005751371383666992 length of segment : 122 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00022649765014648438 length of segment : 13 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0017616748809814453 length of segment : 36 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006875991821289062 length of segment : 41 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 662 time to create 1 rle with old method : 0.0009784698486328125 length of segment : 86 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 665 time to create 1 rle with old method : 0.0008935928344726562 length of segment : 30 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1572 time to create 1 rle with old method : 0.002033710479736328 length of segment : 68 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00035953521728515625 length of segment : 18 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003871917724609375 length of segment : 20 time for calcul the mask position with numpy : 9.822845458984375e-05 nb_pixel_total : 3873 time to create 1 rle with old method : 0.0064849853515625 length of segment : 127 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.36797 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1127 time to create 1 rle with old method : 0.0013794898986816406 length of segment : 95 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 2309 time to create 1 rle with old method : 0.0027878284454345703 length of segment : 154 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 944 time to create 1 rle with old method : 0.0014388561248779297 length of segment : 36 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0019888877868652344 length of segment : 32 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1140 time to create 1 rle with old method : 0.0014977455139160156 length of segment : 37 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.0012197494506835938 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.0014233589172363281 length of segment : 51 time for calcul the mask position with numpy : 0.00018644332885742188 nb_pixel_total : 3741 time to create 1 rle with old method : 0.004630088806152344 length of segment : 181 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00028777122497558594 length of segment : 29 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003516674041748047 length of segment : 26 time for calcul the mask position with numpy : 0.0001895427703857422 nb_pixel_total : 4780 time to create 1 rle with old method : 0.005648136138916016 length of segment : 209 time for calcul the mask position with numpy : 0.000240325927734375 nb_pixel_total : 4829 time to create 1 rle with old method : 0.005954742431640625 length of segment : 206 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 51.87969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009529590606689453 nb_pixel_total : 106415 time to create 1 rle with old method : 0.12766695022583008 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.70156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00034809112548828125 length of segment : 25 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004248619079589844 length of segment : 38 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0008873939514160156 length of segment : 40 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 3501 time to create 1 rle with old method : 0.004256010055541992 length of segment : 62 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006532669067382812 length of segment : 27 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 2256 time to create 1 rle with old method : 0.0028617382049560547 length of segment : 83 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 3344 time to create 1 rle with old method : 0.004065036773681641 length of segment : 61 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00029206275939941406 length of segment : 16 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.000720977783203125 length of segment : 30 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002353191375732422 length of segment : 21 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 916 time to create 1 rle with old method : 0.0012669563293457031 length of segment : 55 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002262592315673828 length of segment : 15 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005786418914794922 length of segment : 24 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.65469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004017353057861328 length of segment : 18 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00018215179443359375 length of segment : 12 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 44 time to create 1 rle with old method : 9.179115295410156e-05 length of segment : 8 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003190040588378906 length of segment : 12 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001671314239501953 length of segment : 12 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0006015300750732422 length of segment : 20 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0007228851318359375 length of segment : 45 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003809928894042969 length of segment : 20 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00018215179443359375 length of segment : 19 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005059242248535156 length of segment : 26 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001392364501953125 length of segment : 8 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.00042319297790527344 length of segment : 23 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.001483917236328125 length of segment : 31 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005338191986083984 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0006005764007568359 length of segment : 25 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0003452301025390625 length of segment : 22 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003001689910888672 length of segment : 22 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00014638900756835938 length of segment : 26 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002677440643310547 length of segment : 22 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1 time to create 1 rle with old method : 1.9073486328125e-05 length of segment : 1 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005228519439697266 length of segment : 23 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.00034499168395996094 length of segment : 27 time for calcul the mask position with numpy : 0.0002651214599609375 nb_pixel_total : 8517 time to create 1 rle with old method : 0.009897947311401367 length of segment : 264 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00039458274841308594 length of segment : 65 time for calcul the mask position with numpy : 0.0005958080291748047 nb_pixel_total : 35365 time to create 1 rle with old method : 0.05398201942443848 length of segment : 247 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 20 time to create 1 rle with old method : 5.650520324707031e-05 length of segment : 4 time for calcul the mask position with numpy : 0.0004096031188964844 nb_pixel_total : 27682 time to create 1 rle with old method : 0.030106306076049805 length of segment : 228 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.98906 max: 149.08437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 838 time to create 1 rle with old method : 0.0010728836059570312 length of segment : 33 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 45 time to create 1 rle with old method : 8.821487426757812e-05 length of segment : 15 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.0001690387725830078 length of segment : 29 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 710 time to create 1 rle with old method : 0.0009899139404296875 length of segment : 30 time for calcul the mask position with numpy : 0.0003724098205566406 nb_pixel_total : 22241 time to create 1 rle with old method : 0.024506568908691406 length of segment : 157 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00015354156494140625 length of segment : 29 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 5 time to create 1 rle with old method : 3.3855438232421875e-05 length of segment : 2 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 6 time to create 1 rle with old method : 4.124641418457031e-05 length of segment : 2 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1747 time to create 1 rle with old method : 0.002241849899291992 length of segment : 48 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.07891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 2309 time to create 1 rle with old method : 0.002959012985229492 length of segment : 34 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0013155937194824219 length of segment : 30 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 799 time to create 1 rle with old method : 0.001016378402709961 length of segment : 57 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0012440681457519531 length of segment : 28 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 2379 time to create 1 rle with old method : 0.0029058456420898438 length of segment : 53 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 374 time to create 1 rle with old method : 0.000896453857421875 length of segment : 41 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0005087852478027344 length of segment : 29 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 2662 time to create 1 rle with old method : 0.004842519760131836 length of segment : 54 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 2333 time to create 1 rle with old method : 0.0029249191284179688 length of segment : 50 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.00042366981506347656 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.41094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.940696716308594e-05 nb_pixel_total : 2752 time to create 1 rle with old method : 0.004487514495849609 length of segment : 52 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003769397735595703 length of segment : 8 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1553 time to create 1 rle with old method : 0.002023935317993164 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.86016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.0001556873321533203 length of segment : 18 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00019407272338867188 length of segment : 12 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0004191398620605469 length of segment : 26 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 2496 time to create 1 rle with old method : 0.0029294490814208984 length of segment : 130 time for calcul the mask position with numpy : 0.00015735626220703125 nb_pixel_total : 8483 time to create 1 rle with old method : 0.009891748428344727 length of segment : 127 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002994537353515625 length of segment : 23 time for calcul the mask position with numpy : 0.0001728534698486328 nb_pixel_total : 9147 time to create 1 rle with old method : 0.01098775863647461 length of segment : 144 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 5239 time to create 1 rle with old method : 0.00961923599243164 length of segment : 58 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 4401 time to create 1 rle with old method : 0.005229473114013672 length of segment : 57 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.64297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0008306503295898438 length of segment : 23 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1241 time to create 1 rle with old method : 0.0015506744384765625 length of segment : 131 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 189.00000 molded_images shape: (1, 640, 640, 3) min: -87.82969 max: 56.96563 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0002853870391845703 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.95000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1717 time to create 1 rle with old method : 0.0021271705627441406 length of segment : 33 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 2752 time to create 1 rle with old method : 0.0034677982330322266 length of segment : 52 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005125999450683594 length of segment : 20 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0005478858947753906 length of segment : 16 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 5170 time to create 1 rle with old method : 0.0064542293548583984 length of segment : 75 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0009546279907226562 length of segment : 41 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0004963874816894531 length of segment : 21 time for calcul the mask position with numpy : 0.0001456737518310547 nb_pixel_total : 7500 time to create 1 rle with old method : 0.008641481399536133 length of segment : 132 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 843 time to create 1 rle with old method : 0.0010344982147216797 length of segment : 32 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003974437713623047 length of segment : 20 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0010497570037841797 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.46563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006542205810546875 length of segment : 33 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 5131 time to create 1 rle with old method : 0.006275177001953125 length of segment : 106 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0009996891021728516 length of segment : 55 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00018310546875 length of segment : 14 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005009174346923828 length of segment : 50 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1444 time to create 1 rle with old method : 0.0017952919006347656 length of segment : 60 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 650 time to create 1 rle with old method : 0.0007953643798828125 length of segment : 91 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0006618499755859375 length of segment : 26 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002620220184326172 length of segment : 19 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005850791931152344 length of segment : 22 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00040531158447265625 length of segment : 21 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 689 time to create 1 rle with old method : 0.0008654594421386719 length of segment : 31 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 688 time to create 1 rle with old method : 0.0008845329284667969 length of segment : 29 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 746 time to create 1 rle with old method : 0.0009212493896484375 length of segment : 39 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0009005069732666016 length of segment : 39 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.90703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0014700889587402344 length of segment : 88 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 2446 time to create 1 rle with old method : 0.0032205581665039062 length of segment : 161 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0016984939575195312 length of segment : 30 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1215 time to create 1 rle with old method : 0.001583099365234375 length of segment : 41 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 932 time to create 1 rle with old method : 0.001270294189453125 length of segment : 34 time for calcul the mask position with numpy : 0.0002980232238769531 nb_pixel_total : 9761 time to create 1 rle with old method : 0.0109710693359375 length of segment : 232 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 788 time to create 1 rle with old method : 0.0009810924530029297 length of segment : 36 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2 time to create 1 rle with old method : 1.9073486328125e-05 length of segment : 2 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.0009477138519287109 length of segment : 48 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 4009 time to create 1 rle with old method : 0.0050449371337890625 length of segment : 197 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 4813 time to create 1 rle with old method : 0.005583524703979492 length of segment : 228 Processing 1 images image shape: (280, 400, 3) min: 2.00000 max: 176.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 43.22734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009453296661376953 nb_pixel_total : 106275 time to create 1 rle with old method : 0.11486554145812988 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.77187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0006487369537353516 length of segment : 32 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006403923034667969 length of segment : 28 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 3258 time to create 1 rle with old method : 0.003947734832763672 length of segment : 56 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004909038543701172 length of segment : 43 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 759 time to create 1 rle with old method : 0.0010366439819335938 length of segment : 34 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005311965942382812 length of segment : 25 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003304481506347656 length of segment : 24 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00024890899658203125 length of segment : 16 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003445148468017578 length of segment : 24 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005617141723632812 length of segment : 27 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.0001385211944580078 length of segment : 16 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 782 time to create 1 rle with old method : 0.0010781288146972656 length of segment : 38 time for calcul the mask position with numpy : 0.0005316734313964844 nb_pixel_total : 37295 time to create 1 rle with old method : 0.040065765380859375 length of segment : 257 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.72891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.00040602684020996094 length of segment : 36 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1088 time to create 1 rle with old method : 0.001405954360961914 length of segment : 35 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003020763397216797 length of segment : 16 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.0003857612609863281 length of segment : 22 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0002651214599609375 length of segment : 11 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00018334388732910156 length of segment : 10 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005738735198974609 length of segment : 25 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004444122314453125 length of segment : 24 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0003151893615722656 length of segment : 13 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00018715858459472656 length of segment : 12 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00030994415283203125 length of segment : 25 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.0003516674041748047 length of segment : 15 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004324913024902344 length of segment : 27 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.00021529197692871094 length of segment : 25 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 2 time to create 1 rle with old method : 1.9550323486328125e-05 length of segment : 2 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 48 time to create 1 rle with old method : 9.441375732421875e-05 length of segment : 16 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003097057342529297 length of segment : 28 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005602836608886719 length of segment : 26 time for calcul the mask position with numpy : 2.7179718017578125e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001423358917236328 length of segment : 18 time for calcul the mask position with numpy : 0.00018072128295898438 nb_pixel_total : 3157 time to create 1 rle with old method : 0.0040132999420166016 length of segment : 208 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 30499 time to create 1 rle with old method : 0.03305792808532715 length of segment : 225 time for calcul the mask position with numpy : 0.0004184246063232422 nb_pixel_total : 33945 time to create 1 rle with old method : 0.03722262382507324 length of segment : 256 length of segment : 0 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.000278472900390625 length of segment : 48 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.45391 max: 149.08437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.0010914802551269531 length of segment : 43 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.00047516822814941406 length of segment : 20 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.0001666545867919922 length of segment : 31 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 35 time to create 1 rle with old method : 7.176399230957031e-05 length of segment : 11 time for calcul the mask position with numpy : 0.0002605915069580078 nb_pixel_total : 9800 time to create 1 rle with old method : 0.011704683303833008 length of segment : 160 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 4 time to create 1 rle with old method : 3.62396240234375e-05 length of segment : 1 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.20391 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005068778991699219 length of segment : 37 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 855 time to create 1 rle with old method : 0.0010886192321777344 length of segment : 54 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 934 time to create 1 rle with old method : 0.0012519359588623047 length of segment : 26 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 2296 time to create 1 rle with old method : 0.0030069351196289062 length of segment : 34 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 963 time to create 1 rle with old method : 0.001247406005859375 length of segment : 28 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 2888 time to create 1 rle with old method : 0.0036253929138183594 length of segment : 55 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002899169921875 length of segment : 37 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 2853 time to create 1 rle with old method : 0.0034933090209960938 length of segment : 58 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005602836608886719 length of segment : 36 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 1733 time to create 1 rle with old method : 0.002271413803100586 length of segment : 62 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 2450 time to create 1 rle with old method : 0.0029799938201904297 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.23516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0016379356384277344 length of segment : 46 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.0004417896270751953 length of segment : 9 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 2508 time to create 1 rle with old method : 0.0037107467651367188 length of segment : 69 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.74688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00017714500427246094 length of segment : 20 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 3232 time to create 1 rle with old method : 0.003790616989135742 length of segment : 142 time for calcul the mask position with numpy : 0.00014638900756835938 nb_pixel_total : 8172 time to create 1 rle with old method : 0.00960540771484375 length of segment : 137 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 4639 time to create 1 rle with old method : 0.007615566253662109 length of segment : 75 time for calcul the mask position with numpy : 0.000194549560546875 nb_pixel_total : 8516 time to create 1 rle with old method : 0.013892889022827148 length of segment : 129 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 3857 time to create 1 rle with old method : 0.0047566890716552734 length of segment : 57 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 128.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 588 time to create 1 rle with old method : 0.0010027885437011719 length of segment : 22 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1374 time to create 1 rle with old method : 0.0016837120056152344 length of segment : 134 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006592273712158203 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 189.00000 molded_images shape: (1, 640, 640, 3) min: -91.59531 max: 63.32891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.74297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1655 time to create 1 rle with old method : 0.0029349327087402344 length of segment : 33 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0007052421569824219 length of segment : 19 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0005731582641601562 length of segment : 21 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 2688 time to create 1 rle with old method : 0.004649639129638672 length of segment : 52 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0007092952728271484 length of segment : 15 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 751 time to create 1 rle with old method : 0.0014033317565917969 length of segment : 42 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 904 time to create 1 rle with old method : 0.0011548995971679688 length of segment : 33 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.00046706199645996094 length of segment : 22 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005176067352294922 length of segment : 17 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 900 time to create 1 rle with old method : 0.0011093616485595703 length of segment : 32 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005340576171875 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.28594 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0008883476257324219 length of segment : 33 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00019288063049316406 length of segment : 13 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1834 time to create 1 rle with old method : 0.0022149085998535156 length of segment : 74 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002753734588623047 length of segment : 19 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 714 time to create 1 rle with old method : 0.0008649826049804688 length of segment : 86 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1076 time to create 1 rle with old method : 0.001531362533569336 length of segment : 62 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1076 time to create 1 rle with old method : 0.0014185905456542969 length of segment : 67 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.00046181678771972656 length of segment : 49 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 4642 time to create 1 rle with old method : 0.005539894104003906 length of segment : 99 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.00037288665771484375 length of segment : 17 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 649 time to create 1 rle with old method : 0.0008294582366943359 length of segment : 31 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1123 time to create 1 rle with old method : 0.0014595985412597656 length of segment : 44 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 4358 time to create 1 rle with old method : 0.005460262298583984 length of segment : 104 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002918243408203125 length of segment : 19 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1077 time to create 1 rle with old method : 0.0013136863708496094 length of segment : 42 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 5290 time to create 1 rle with old method : 0.006493568420410156 length of segment : 127 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.0011162757873535156 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.78594 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 9.846687316894531e-05 nb_pixel_total : 2614 time to create 1 rle with old method : 0.0030269622802734375 length of segment : 161 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1353 time to create 1 rle with old method : 0.00174713134765625 length of segment : 30 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 992 time to create 1 rle with old method : 0.001405954360961914 length of segment : 37 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1181 time to create 1 rle with old method : 0.0014748573303222656 length of segment : 41 time for calcul the mask position with numpy : 0.00033354759216308594 nb_pixel_total : 9896 time to create 1 rle with old method : 0.011284351348876953 length of segment : 238 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 829 time to create 1 rle with old method : 0.0010342597961425781 length of segment : 40 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 994 time to create 1 rle with old method : 0.0012476444244384766 length of segment : 88 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 833 time to create 1 rle with old method : 0.0009951591491699219 length of segment : 63 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.09609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 867 time to create 1 rle with old method : 0.0010619163513183594 length of segment : 50 time for calcul the mask position with numpy : 0.00017571449279785156 nb_pixel_total : 4283 time to create 1 rle with old method : 0.0052874088287353516 length of segment : 210 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 176.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 43.80938 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009009838104248047 nb_pixel_total : 106496 time to create 1 rle with old method : 0.11473965644836426 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 248.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.55312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005519390106201172 length of segment : 28 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006363391876220703 length of segment : 26 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.0011091232299804688 length of segment : 40 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004885196685791016 length of segment : 80 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005414485931396484 length of segment : 24 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003902912139892578 length of segment : 25 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 3120 time to create 1 rle with old method : 0.0038459300994873047 length of segment : 58 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 3380 time to create 1 rle with old method : 0.004095792770385742 length of segment : 61 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006413459777832031 length of segment : 27 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00025343894958496094 length of segment : 15 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002720355987548828 length of segment : 23 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004839897155761719 length of segment : 34 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 4547 time to create 1 rle with old method : 0.00533604621887207 length of segment : 107 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006377696990966797 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.80703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005464553833007812 length of segment : 21 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003342628479003906 length of segment : 13 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 31 time to create 1 rle with old method : 7.176399230957031e-05 length of segment : 6 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003769397735595703 length of segment : 18 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004830360412597656 length of segment : 25 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00023102760314941406 length of segment : 14 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.000339508056640625 length of segment : 36 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00018930435180664062 length of segment : 11 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.00067138671875 length of segment : 45 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001862049102783203 length of segment : 11 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.0005223751068115234 length of segment : 22 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005369186401367188 length of segment : 24 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.000415802001953125 length of segment : 22 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002777576446533203 length of segment : 26 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00037097930908203125 length of segment : 28 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00029778480529785156 length of segment : 21 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005297660827636719 length of segment : 24 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003535747528076172 length of segment : 37 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 34632 time to create 1 rle with old method : 0.0373380184173584 length of segment : 247 time for calcul the mask position with numpy : 0.0004267692565917969 nb_pixel_total : 29749 time to create 1 rle with old method : 0.033416032791137695 length of segment : 207 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00016546249389648438 length of segment : 27 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 20 time to create 1 rle with old method : 5.340576171875e-05 length of segment : 4 Detection mask done ! Trying to reset tf kernel 2799187 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1708 tf kernel not reseted sub process len(results) : 440 len(list_Values) 440 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 440 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6997 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 440 chid ids of type : 4228 Number RLEs to save : 23915 save missing photos in datou_result : time spend for datou_step_exec : 30.85454487800598 time spend to save output : 1.709653377532959 total time spend for step 1 : 32.56419825553894 step2:brightness Tue Feb 11 14:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739280029_2798694_1336822911_28beafc84ec5ec1321371beee9eef19e.jpg treat image : temp/1739280029_2798694_1336822775_e2403efb17d50e25b0d3d22ead0b0dc1.jpg treat image : temp/1739280029_2798694_1336822766_083b5900d783ccda6e4bb0ca7f04b244.jpg treat image : temp/1739280029_2798694_1336822763_264e83e8975fbe48777d3fbaf0d1149e.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.011592626571655273 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.010901927947998047 save missing photos in datou_result : time spend for datou_step_exec : 0.9573051929473877 time spend to save output : 0.026755571365356445 total time spend for step 2 : 0.9840607643127441 step3:blur_detection Tue Feb 11 14:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739280029_2798694_1336822911_28beafc84ec5ec1321371beee9eef19e.jpg resize: (1080, 1920) 1336822911 -7.689726256573166 treat image : temp/1739280029_2798694_1336822775_e2403efb17d50e25b0d3d22ead0b0dc1.jpg resize: (1080, 1920) 1336822775 -7.683526708164189 treat image : temp/1739280029_2798694_1336822766_083b5900d783ccda6e4bb0ca7f04b244.jpg resize: (1080, 1920) 1336822766 -7.679888580890014 treat image : temp/1739280029_2798694_1336822763_264e83e8975fbe48777d3fbaf0d1149e.jpg resize: (1080, 1920) 1336822763 -7.672825756100037 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.011934518814086914 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.011890649795532227 save missing photos in datou_result : time spend for datou_step_exec : 3.937725305557251 time spend to save output : 0.028801441192626953 total time spend for step 3 : 3.966526746749878 step4:rle_unique_nms_with_priority Tue Feb 11 14:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 440 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 113 nb_hashtags : 6 time to prepare the origin masks : 1.0557618141174316 time for calcul the mask position with numpy : 0.02240467071533203 nb_pixel_total : 1797006 time to create 1 rle with new method : 0.05828380584716797 time for calcul the mask position with numpy : 0.008564233779907227 nb_pixel_total : 1433 time to create 1 rle with old method : 0.0016109943389892578 time for calcul the mask position with numpy : 0.008430242538452148 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003371238708496094 time for calcul the mask position with numpy : 0.008424997329711914 nb_pixel_total : 483 time to create 1 rle with old method : 0.0005669593811035156 time for calcul the mask position with numpy : 0.008379459381103516 nb_pixel_total : 44 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.00835871696472168 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001266002655029297 time for calcul the mask position with numpy : 0.008336067199707031 nb_pixel_total : 30 time to create 1 rle with old method : 6.270408630371094e-05 time for calcul the mask position with numpy : 0.008363485336303711 nb_pixel_total : 786 time to create 1 rle with old method : 0.0009372234344482422 time for calcul the mask position with numpy : 0.008383989334106445 nb_pixel_total : 829 time to create 1 rle with old method : 0.0009760856628417969 time for calcul the mask position with numpy : 0.008354902267456055 nb_pixel_total : 938 time to create 1 rle with old method : 0.0010826587677001953 time for calcul the mask position with numpy : 0.00836181640625 nb_pixel_total : 78 time to create 1 rle with old method : 9.417533874511719e-05 time for calcul the mask position with numpy : 0.00838160514831543 nb_pixel_total : 38 time to create 1 rle with old method : 8.130073547363281e-05 time for calcul the mask position with numpy : 0.008367538452148438 nb_pixel_total : 35 time to create 1 rle with old method : 7.390975952148438e-05 time for calcul the mask position with numpy : 0.008943557739257812 nb_pixel_total : 1243 time to create 1 rle with old method : 0.0015168190002441406 time for calcul the mask position with numpy : 0.008342981338500977 nb_pixel_total : 2816 time to create 1 rle with old method : 0.003222942352294922 time for calcul the mask position with numpy : 0.00841212272644043 nb_pixel_total : 1 time to create 1 rle with old method : 1.1444091796875e-05 time for calcul the mask position with numpy : 0.008365392684936523 nb_pixel_total : 590 time to create 1 rle with old method : 0.0006935596466064453 time for calcul the mask position with numpy : 0.008359193801879883 nb_pixel_total : 195 time to create 1 rle with old method : 0.00022840499877929688 time for calcul the mask position with numpy : 0.008345842361450195 nb_pixel_total : 1498 time to create 1 rle with old method : 0.0017435550689697266 time for calcul the mask position with numpy : 0.008337736129760742 nb_pixel_total : 537 time to create 1 rle with old method : 0.0006153583526611328 time for calcul the mask position with numpy : 0.00835418701171875 nb_pixel_total : 2219 time to create 1 rle with old method : 0.002569913864135742 time for calcul the mask position with numpy : 0.008353233337402344 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006353855133056641 time for calcul the mask position with numpy : 0.008365392684936523 nb_pixel_total : 10 time to create 1 rle with old method : 4.124641418457031e-05 time for calcul the mask position with numpy : 0.008358955383300781 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002486705780029297 time for calcul the mask position with numpy : 0.008319616317749023 nb_pixel_total : 2439 time to create 1 rle with old method : 0.002897977828979492 time for calcul the mask position with numpy : 0.00838017463684082 nb_pixel_total : 1388 time to create 1 rle with old method : 0.0016930103302001953 time for calcul the mask position with numpy : 0.008318424224853516 nb_pixel_total : 2572 time to create 1 rle with old method : 0.0033965110778808594 time for calcul the mask position with numpy : 0.008768558502197266 nb_pixel_total : 13326 time to create 1 rle with old method : 0.014609813690185547 time for calcul the mask position with numpy : 0.008383750915527344 nb_pixel_total : 80 time to create 1 rle with old method : 0.00010013580322265625 time for calcul the mask position with numpy : 0.008411169052124023 nb_pixel_total : 1799 time to create 1 rle with old method : 0.002023458480834961 time for calcul the mask position with numpy : 0.00843954086303711 nb_pixel_total : 593 time to create 1 rle with old method : 0.0007562637329101562 time for calcul the mask position with numpy : 0.008485555648803711 nb_pixel_total : 679 time to create 1 rle with old method : 0.0007729530334472656 time for calcul the mask position with numpy : 0.008350849151611328 nb_pixel_total : 825 time to create 1 rle with old method : 0.0009343624114990234 time for calcul the mask position with numpy : 0.008352041244506836 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0013659000396728516 time for calcul the mask position with numpy : 0.008374691009521484 nb_pixel_total : 334 time to create 1 rle with old method : 0.00039577484130859375 time for calcul the mask position with numpy : 0.008344411849975586 nb_pixel_total : 220 time to create 1 rle with old method : 0.0002739429473876953 time for calcul the mask position with numpy : 0.008343935012817383 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004143714904785156 time for calcul the mask position with numpy : 0.008354663848876953 nb_pixel_total : 234 time to create 1 rle with old method : 0.0002810955047607422 time for calcul the mask position with numpy : 0.008355855941772461 nb_pixel_total : 802 time to create 1 rle with old method : 0.0009131431579589844 time for calcul the mask position with numpy : 0.008348226547241211 nb_pixel_total : 545 time to create 1 rle with old method : 0.0006239414215087891 time for calcul the mask position with numpy : 0.008363485336303711 nb_pixel_total : 742 time to create 1 rle with old method : 0.0008835792541503906 time for calcul the mask position with numpy : 0.008352994918823242 nb_pixel_total : 778 time to create 1 rle with old method : 0.0008931159973144531 time for calcul the mask position with numpy : 0.008374452590942383 nb_pixel_total : 108 time to create 1 rle with old method : 0.0001895427703857422 time for calcul the mask position with numpy : 0.008389949798583984 nb_pixel_total : 31 time to create 1 rle with old method : 4.9591064453125e-05 time for calcul the mask position with numpy : 0.008336067199707031 nb_pixel_total : 399 time to create 1 rle with old method : 0.00048422813415527344 time for calcul the mask position with numpy : 0.008354425430297852 nb_pixel_total : 1058 time to create 1 rle with old method : 0.001264333724975586 time for calcul the mask position with numpy : 0.008295297622680664 nb_pixel_total : 2516 time to create 1 rle with old method : 0.0027952194213867188 time for calcul the mask position with numpy : 0.008358240127563477 nb_pixel_total : 310 time to create 1 rle with old method : 0.00040912628173828125 time for calcul the mask position with numpy : 0.008367776870727539 nb_pixel_total : 27 time to create 1 rle with old method : 5.14984130859375e-05 time for calcul the mask position with numpy : 0.008275985717773438 nb_pixel_total : 4070 time to create 1 rle with old method : 0.004612922668457031 time for calcul the mask position with numpy : 0.008363962173461914 nb_pixel_total : 701 time to create 1 rle with old method : 0.0008234977722167969 time for calcul the mask position with numpy : 0.008339405059814453 nb_pixel_total : 798 time to create 1 rle with old method : 0.0009245872497558594 time for calcul the mask position with numpy : 0.008350372314453125 nb_pixel_total : 49 time to create 1 rle with old method : 8.368492126464844e-05 time for calcul the mask position with numpy : 0.008367538452148438 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004353523254394531 time for calcul the mask position with numpy : 0.008348226547241211 nb_pixel_total : 331 time to create 1 rle with old method : 0.0003685951232910156 time for calcul the mask position with numpy : 0.008319854736328125 nb_pixel_total : 1963 time to create 1 rle with old method : 0.002140522003173828 time for calcul the mask position with numpy : 0.008309602737426758 nb_pixel_total : 1209 time to create 1 rle with old method : 0.0014128684997558594 time for calcul the mask position with numpy : 0.008323907852172852 nb_pixel_total : 2119 time to create 1 rle with old method : 0.002400636672973633 time for calcul the mask position with numpy : 0.008367538452148438 nb_pixel_total : 74 time to create 1 rle with old method : 0.00010943412780761719 time for calcul the mask position with numpy : 0.008368730545043945 nb_pixel_total : 4392 time to create 1 rle with old method : 0.005067110061645508 time for calcul the mask position with numpy : 0.00832819938659668 nb_pixel_total : 1759 time to create 1 rle with old method : 0.002028226852416992 time for calcul the mask position with numpy : 0.008336782455444336 nb_pixel_total : 43 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.0083465576171875 nb_pixel_total : 2731 time to create 1 rle with old method : 0.0031282901763916016 time for calcul the mask position with numpy : 0.008323431015014648 nb_pixel_total : 3375 time to create 1 rle with old method : 0.0038661956787109375 time for calcul the mask position with numpy : 0.008332490921020508 nb_pixel_total : 826 time to create 1 rle with old method : 0.0009293556213378906 time for calcul the mask position with numpy : 0.00834035873413086 nb_pixel_total : 894 time to create 1 rle with old method : 0.0010569095611572266 time for calcul the mask position with numpy : 0.008335351943969727 nb_pixel_total : 1180 time to create 1 rle with old method : 0.0013020038604736328 time for calcul the mask position with numpy : 0.008332967758178711 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0014758110046386719 time for calcul the mask position with numpy : 0.008353710174560547 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0013513565063476562 time for calcul the mask position with numpy : 0.008354425430297852 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.008363723754882812 nb_pixel_total : 414 time to create 1 rle with old method : 0.0004899501800537109 time for calcul the mask position with numpy : 0.008370399475097656 nb_pixel_total : 718 time to create 1 rle with old method : 0.0008275508880615234 time for calcul the mask position with numpy : 0.008442401885986328 nb_pixel_total : 284 time to create 1 rle with old method : 0.00033020973205566406 time for calcul the mask position with numpy : 0.008368730545043945 nb_pixel_total : 1691 time to create 1 rle with old method : 0.0018389225006103516 time for calcul the mask position with numpy : 0.008379220962524414 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005204677581787109 time for calcul the mask position with numpy : 0.008363723754882812 nb_pixel_total : 237 time to create 1 rle with old method : 0.000263214111328125 time for calcul the mask position with numpy : 0.008356332778930664 nb_pixel_total : 668 time to create 1 rle with old method : 0.0007748603820800781 time for calcul the mask position with numpy : 0.009037256240844727 nb_pixel_total : 106277 time to create 1 rle with old method : 0.11362099647521973 time for calcul the mask position with numpy : 0.008392572402954102 nb_pixel_total : 3474 time to create 1 rle with old method : 0.003925800323486328 time for calcul the mask position with numpy : 0.008350610733032227 nb_pixel_total : 565 time to create 1 rle with old method : 0.0006680488586425781 time for calcul the mask position with numpy : 0.00829768180847168 nb_pixel_total : 27658 time to create 1 rle with old method : 0.031011343002319336 time for calcul the mask position with numpy : 0.008255958557128906 nb_pixel_total : 5325 time to create 1 rle with old method : 0.006072521209716797 time for calcul the mask position with numpy : 0.008368253707885742 nb_pixel_total : 108 time to create 1 rle with old method : 0.00013375282287597656 time for calcul the mask position with numpy : 0.008361339569091797 nb_pixel_total : 23 time to create 1 rle with old method : 7.677078247070312e-05 time for calcul the mask position with numpy : 0.008378267288208008 nb_pixel_total : 36244 time to create 1 rle with old method : 0.03836417198181152 time for calcul the mask position with numpy : 0.008482694625854492 nb_pixel_total : 2899 time to create 1 rle with old method : 0.003250598907470703 time for calcul the mask position with numpy : 0.008549690246582031 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007214546203613281 time for calcul the mask position with numpy : 0.008499622344970703 nb_pixel_total : 245 time to create 1 rle with old method : 0.0004401206970214844 time for calcul the mask position with numpy : 0.008493423461914062 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001285076141357422 time for calcul the mask position with numpy : 0.008555889129638672 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.008478164672851562 nb_pixel_total : 1431 time to create 1 rle with old method : 0.0018229484558105469 time for calcul the mask position with numpy : 0.008523225784301758 nb_pixel_total : 730 time to create 1 rle with old method : 0.0008490085601806641 time for calcul the mask position with numpy : 0.00856471061706543 nb_pixel_total : 263 time to create 1 rle with old method : 0.00032210350036621094 time for calcul the mask position with numpy : 0.008764982223510742 nb_pixel_total : 556 time to create 1 rle with old method : 0.0006685256958007812 time for calcul the mask position with numpy : 0.008573770523071289 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005896091461181641 time for calcul the mask position with numpy : 0.008562564849853516 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002551078796386719 time for calcul the mask position with numpy : 0.008580923080444336 nb_pixel_total : 37 time to create 1 rle with old method : 7.796287536621094e-05 time for calcul the mask position with numpy : 0.008456945419311523 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004994869232177734 time for calcul the mask position with numpy : 0.008644819259643555 nb_pixel_total : 137 time to create 1 rle with old method : 0.00018930435180664062 time for calcul the mask position with numpy : 0.008373737335205078 nb_pixel_total : 1442 time to create 1 rle with old method : 0.001688241958618164 time for calcul the mask position with numpy : 0.00837564468383789 nb_pixel_total : 412 time to create 1 rle with old method : 0.0004947185516357422 time for calcul the mask position with numpy : 0.008474349975585938 nb_pixel_total : 32 time to create 1 rle with old method : 4.982948303222656e-05 time for calcul the mask position with numpy : 0.008457422256469727 nb_pixel_total : 300 time to create 1 rle with old method : 0.0003483295440673828 time for calcul the mask position with numpy : 0.008481264114379883 nb_pixel_total : 2 time to create 1 rle with old method : 1.4781951904296875e-05 time for calcul the mask position with numpy : 0.00868844985961914 nb_pixel_total : 410 time to create 1 rle with old method : 0.0004863739013671875 time for calcul the mask position with numpy : 0.008569955825805664 nb_pixel_total : 1017 time to create 1 rle with old method : 0.001173257827758789 time for calcul the mask position with numpy : 0.008426904678344727 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005245208740234375 time for calcul the mask position with numpy : 0.008542537689208984 nb_pixel_total : 28 time to create 1 rle with old method : 5.626678466796875e-05 time for calcul the mask position with numpy : 0.008413076400756836 nb_pixel_total : 316 time to create 1 rle with old method : 0.00036907196044921875 time for calcul the mask position with numpy : 0.008476495742797852 nb_pixel_total : 349 time to create 1 rle with old method : 0.00042057037353515625 time for calcul the mask position with numpy : 0.008382558822631836 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003237724304199219 time for calcul the mask position with numpy : 0.008403301239013672 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0013761520385742188 time for calcul the mask position with numpy : 0.008477210998535156 nb_pixel_total : 189 time to create 1 rle with old method : 0.00022149085998535156 time for calcul the mask position with numpy : 0.008369684219360352 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002231597900390625 create new chi : 1.345210075378418 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0058896541595458984 batch 1 Loaded 114 chid ids of type : 4230 Number RLEs to save : 12469 TO DO : save crop sub photo not yet done ! save time : 0.7096526622772217 nb_obj : 113 nb_hashtags : 8 time to prepare the origin masks : 2.1472325325012207 time for calcul the mask position with numpy : 0.0270693302154541 nb_pixel_total : 1833035 time to create 1 rle with new method : 0.06726527214050293 time for calcul the mask position with numpy : 0.006921529769897461 nb_pixel_total : 1489 time to create 1 rle with old method : 0.0017919540405273438 time for calcul the mask position with numpy : 0.006962776184082031 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005421638488769531 time for calcul the mask position with numpy : 0.006893157958984375 nb_pixel_total : 87 time to create 1 rle with old method : 0.00015544891357421875 time for calcul the mask position with numpy : 0.006756305694580078 nb_pixel_total : 18 time to create 1 rle with old method : 5.793571472167969e-05 time for calcul the mask position with numpy : 0.006961345672607422 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005307197570800781 time for calcul the mask position with numpy : 0.010408163070678711 nb_pixel_total : 22 time to create 1 rle with old method : 0.00012993812561035156 time for calcul the mask position with numpy : 0.01079702377319336 nb_pixel_total : 1125 time to create 1 rle with old method : 0.002123594284057617 time for calcul the mask position with numpy : 0.0070188045501708984 nb_pixel_total : 869 time to create 1 rle with old method : 0.0010042190551757812 time for calcul the mask position with numpy : 0.007311344146728516 nb_pixel_total : 71 time to create 1 rle with old method : 0.00011324882507324219 time for calcul the mask position with numpy : 0.006852626800537109 nb_pixel_total : 1638 time to create 1 rle with old method : 0.0018520355224609375 time for calcul the mask position with numpy : 0.006734132766723633 nb_pixel_total : 968 time to create 1 rle with old method : 0.0011138916015625 time for calcul the mask position with numpy : 0.006634712219238281 nb_pixel_total : 25 time to create 1 rle with old method : 8.320808410644531e-05 time for calcul the mask position with numpy : 0.006587982177734375 nb_pixel_total : 1069 time to create 1 rle with old method : 0.0013098716735839844 time for calcul the mask position with numpy : 0.0070035457611083984 nb_pixel_total : 106 time to create 1 rle with old method : 0.0001430511474609375 time for calcul the mask position with numpy : 0.0069582462310791016 nb_pixel_total : 3 time to create 1 rle with old method : 2.9802322387695312e-05 time for calcul the mask position with numpy : 0.0069615840911865234 nb_pixel_total : 2980 time to create 1 rle with old method : 0.003371000289916992 time for calcul the mask position with numpy : 0.007013797760009766 nb_pixel_total : 1 time to create 1 rle with old method : 2.47955322265625e-05 time for calcul the mask position with numpy : 0.008512496948242188 nb_pixel_total : 23 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.011306524276733398 nb_pixel_total : 699 time to create 1 rle with old method : 0.0008640289306640625 time for calcul the mask position with numpy : 0.011517763137817383 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002079010009765625 time for calcul the mask position with numpy : 0.010806798934936523 nb_pixel_total : 1769 time to create 1 rle with old method : 0.0020837783813476562 time for calcul the mask position with numpy : 0.010869026184082031 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002486705780029297 time for calcul the mask position with numpy : 0.014360666275024414 nb_pixel_total : 1897 time to create 1 rle with old method : 0.002214193344116211 time for calcul the mask position with numpy : 0.010762453079223633 nb_pixel_total : 513 time to create 1 rle with old method : 0.0006289482116699219 time for calcul the mask position with numpy : 0.010837793350219727 nb_pixel_total : 142 time to create 1 rle with old method : 0.00019025802612304688 time for calcul the mask position with numpy : 0.01078343391418457 nb_pixel_total : 239 time to create 1 rle with old method : 0.00031375885009765625 time for calcul the mask position with numpy : 0.012109756469726562 nb_pixel_total : 128 time to create 1 rle with old method : 0.00018024444580078125 time for calcul the mask position with numpy : 0.01079869270324707 nb_pixel_total : 1907 time to create 1 rle with old method : 0.002248525619506836 time for calcul the mask position with numpy : 0.01035165786743164 nb_pixel_total : 625 time to create 1 rle with old method : 0.0007984638214111328 time for calcul the mask position with numpy : 0.01076054573059082 nb_pixel_total : 3627 time to create 1 rle with old method : 0.004196643829345703 time for calcul the mask position with numpy : 0.010197162628173828 nb_pixel_total : 9900 time to create 1 rle with old method : 0.011186599731445312 time for calcul the mask position with numpy : 0.010126829147338867 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.010141611099243164 nb_pixel_total : 550 time to create 1 rle with old method : 0.0006668567657470703 time for calcul the mask position with numpy : 0.010140657424926758 nb_pixel_total : 665 time to create 1 rle with old method : 0.0008387565612792969 time for calcul the mask position with numpy : 0.010132789611816406 nb_pixel_total : 763 time to create 1 rle with old method : 0.0008921623229980469 time for calcul the mask position with numpy : 0.010319948196411133 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002593994140625 time for calcul the mask position with numpy : 0.010020256042480469 nb_pixel_total : 1140 time to create 1 rle with old method : 0.001338958740234375 time for calcul the mask position with numpy : 0.010085344314575195 nb_pixel_total : 235 time to create 1 rle with old method : 0.00030732154846191406 time for calcul the mask position with numpy : 0.01015782356262207 nb_pixel_total : 909 time to create 1 rle with old method : 0.00107574462890625 time for calcul the mask position with numpy : 0.00997781753540039 nb_pixel_total : 2 time to create 1 rle with old method : 2.4557113647460938e-05 time for calcul the mask position with numpy : 0.009955883026123047 nb_pixel_total : 662 time to create 1 rle with old method : 0.0007729530334472656 time for calcul the mask position with numpy : 0.009995460510253906 nb_pixel_total : 653 time to create 1 rle with old method : 0.0007929801940917969 time for calcul the mask position with numpy : 0.009948968887329102 nb_pixel_total : 113 time to create 1 rle with old method : 0.00016236305236816406 time for calcul the mask position with numpy : 0.00989222526550293 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004508495330810547 time for calcul the mask position with numpy : 0.009933710098266602 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0013685226440429688 time for calcul the mask position with numpy : 0.00995779037475586 nb_pixel_total : 2309 time to create 1 rle with old method : 0.0026884078979492188 time for calcul the mask position with numpy : 0.009965896606445312 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0014073848724365234 time for calcul the mask position with numpy : 0.006173133850097656 nb_pixel_total : 3741 time to create 1 rle with old method : 0.004242658615112305 time for calcul the mask position with numpy : 0.006055116653442383 nb_pixel_total : 712 time to create 1 rle with old method : 0.0008366107940673828 time for calcul the mask position with numpy : 0.006005525588989258 nb_pixel_total : 973 time to create 1 rle with old method : 0.0011103153228759766 time for calcul the mask position with numpy : 0.005976200103759766 nb_pixel_total : 2 time to create 1 rle with old method : 3.7670135498046875e-05 time for calcul the mask position with numpy : 0.0060117244720458984 nb_pixel_total : 335 time to create 1 rle with old method : 0.00040531158447265625 time for calcul the mask position with numpy : 0.006298065185546875 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004050731658935547 time for calcul the mask position with numpy : 0.006083488464355469 nb_pixel_total : 149 time to create 1 rle with old method : 0.0002739429473876953 time for calcul the mask position with numpy : 0.006330966949462891 nb_pixel_total : 1127 time to create 1 rle with old method : 0.0012974739074707031 time for calcul the mask position with numpy : 0.006291389465332031 nb_pixel_total : 4114 time to create 1 rle with old method : 0.004528045654296875 time for calcul the mask position with numpy : 0.006056308746337891 nb_pixel_total : 853 time to create 1 rle with old method : 0.001062631607055664 time for calcul the mask position with numpy : 0.0060520172119140625 nb_pixel_total : 1572 time to create 1 rle with old method : 0.0018000602722167969 time for calcul the mask position with numpy : 0.006046295166015625 nb_pixel_total : 49 time to create 1 rle with old method : 0.00014328956604003906 time for calcul the mask position with numpy : 0.006119489669799805 nb_pixel_total : 2758 time to create 1 rle with old method : 0.003164529800415039 time for calcul the mask position with numpy : 0.0063092708587646484 nb_pixel_total : 6933 time to create 1 rle with old method : 0.007958173751831055 time for calcul the mask position with numpy : 0.006171226501464844 nb_pixel_total : 875 time to create 1 rle with old method : 0.0014846324920654297 time for calcul the mask position with numpy : 0.006508588790893555 nb_pixel_total : 944 time to create 1 rle with old method : 0.0015459060668945312 time for calcul the mask position with numpy : 0.006461381912231445 nb_pixel_total : 200 time to create 1 rle with old method : 0.00033926963806152344 time for calcul the mask position with numpy : 0.006466388702392578 nb_pixel_total : 462 time to create 1 rle with old method : 0.0007534027099609375 time for calcul the mask position with numpy : 0.00643467903137207 nb_pixel_total : 1301 time to create 1 rle with old method : 0.002117633819580078 time for calcul the mask position with numpy : 0.0064585208892822266 nb_pixel_total : 275 time to create 1 rle with old method : 0.00046539306640625 time for calcul the mask position with numpy : 0.0064928531646728516 nb_pixel_total : 460 time to create 1 rle with old method : 0.0007977485656738281 time for calcul the mask position with numpy : 0.006479024887084961 nb_pixel_total : 321 time to create 1 rle with old method : 0.0005693435668945312 time for calcul the mask position with numpy : 0.006507158279418945 nb_pixel_total : 245 time to create 1 rle with old method : 0.0004189014434814453 time for calcul the mask position with numpy : 0.0064868927001953125 nb_pixel_total : 1766 time to create 1 rle with old method : 0.0028154850006103516 time for calcul the mask position with numpy : 0.006520509719848633 nb_pixel_total : 292 time to create 1 rle with old method : 0.0005056858062744141 time for calcul the mask position with numpy : 0.00723719596862793 nb_pixel_total : 106415 time to create 1 rle with old method : 0.11349701881408691 time for calcul the mask position with numpy : 0.0067403316497802734 nb_pixel_total : 3501 time to create 1 rle with old method : 0.003984689712524414 time for calcul the mask position with numpy : 0.006547451019287109 nb_pixel_total : 916 time to create 1 rle with old method : 0.001117706298828125 time for calcul the mask position with numpy : 0.006810426712036133 nb_pixel_total : 8466 time to create 1 rle with old method : 0.009642839431762695 time for calcul the mask position with numpy : 0.006407737731933594 nb_pixel_total : 39 time to create 1 rle with old method : 0.00010657310485839844 time for calcul the mask position with numpy : 0.0063517093658447266 nb_pixel_total : 217 time to create 1 rle with old method : 0.00029969215393066406 time for calcul the mask position with numpy : 0.00628209114074707 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003647804260253906 time for calcul the mask position with numpy : 0.006555080413818359 nb_pixel_total : 35365 time to create 1 rle with old method : 0.038462162017822266 time for calcul the mask position with numpy : 0.006642818450927734 nb_pixel_total : 505 time to create 1 rle with old method : 0.0005974769592285156 time for calcul the mask position with numpy : 0.006739139556884766 nb_pixel_total : 280 time to create 1 rle with old method : 0.00033974647521972656 time for calcul the mask position with numpy : 0.006140232086181641 nb_pixel_total : 98 time to create 1 rle with old method : 0.00013017654418945312 time for calcul the mask position with numpy : 0.0063555240631103516 nb_pixel_total : 384 time to create 1 rle with old method : 0.00045871734619140625 time for calcul the mask position with numpy : 0.00632929801940918 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003006458282470703 time for calcul the mask position with numpy : 0.005975246429443359 nb_pixel_total : 490 time to create 1 rle with old method : 0.0007452964782714844 time for calcul the mask position with numpy : 0.006082296371459961 nb_pixel_total : 636 time to create 1 rle with old method : 0.0007257461547851562 time for calcul the mask position with numpy : 0.006073951721191406 nb_pixel_total : 2256 time to create 1 rle with old method : 0.002542734146118164 time for calcul the mask position with numpy : 0.006155729293823242 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003361701965332031 time for calcul the mask position with numpy : 0.005939483642578125 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002181529998779297 time for calcul the mask position with numpy : 0.006398677825927734 nb_pixel_total : 62 time to create 1 rle with old method : 9.703636169433594e-05 time for calcul the mask position with numpy : 0.006145000457763672 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002455711364746094 time for calcul the mask position with numpy : 0.00616145133972168 nb_pixel_total : 62 time to create 1 rle with old method : 9.298324584960938e-05 time for calcul the mask position with numpy : 0.006064891815185547 nb_pixel_total : 421 time to create 1 rle with old method : 0.0006434917449951172 time for calcul the mask position with numpy : 0.006122589111328125 nb_pixel_total : 256 time to create 1 rle with old method : 0.00031113624572753906 time for calcul the mask position with numpy : 0.0063250064849853516 nb_pixel_total : 106 time to create 1 rle with old method : 0.00014781951904296875 time for calcul the mask position with numpy : 0.006353139877319336 nb_pixel_total : 159 time to create 1 rle with old method : 0.00020194053649902344 time for calcul the mask position with numpy : 0.0064165592193603516 nb_pixel_total : 617 time to create 1 rle with old method : 0.0007281303405761719 time for calcul the mask position with numpy : 0.006265401840209961 nb_pixel_total : 190 time to create 1 rle with old method : 0.00023221969604492188 time for calcul the mask position with numpy : 0.006292819976806641 nb_pixel_total : 72 time to create 1 rle with old method : 0.00010228157043457031 time for calcul the mask position with numpy : 0.007076263427734375 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005819797515869141 time for calcul the mask position with numpy : 0.0074727535247802734 nb_pixel_total : 20 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.0069293975830078125 nb_pixel_total : 121 time to create 1 rle with old method : 0.00016236305236816406 time for calcul the mask position with numpy : 0.006520748138427734 nb_pixel_total : 1 time to create 1 rle with old method : 1.8596649169921875e-05 time for calcul the mask position with numpy : 0.006443023681640625 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005590915679931641 time for calcul the mask position with numpy : 0.006994724273681641 nb_pixel_total : 1 time to create 1 rle with old method : 1.8835067749023438e-05 time for calcul the mask position with numpy : 0.008026123046875 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004532337188720703 time for calcul the mask position with numpy : 0.006360530853271484 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003139972686767578 time for calcul the mask position with numpy : 0.0063173770904541016 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005278587341308594 time for calcul the mask position with numpy : 0.0062677860260009766 nb_pixel_total : 44 time to create 1 rle with old method : 7.224082946777344e-05 time for calcul the mask position with numpy : 0.006052732467651367 nb_pixel_total : 409 time to create 1 rle with old method : 0.0004611015319824219 time for calcul the mask position with numpy : 0.0084686279296875 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002512931823730469 time for calcul the mask position with numpy : 0.008412361145019531 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002434253692626953 create new chi : 1.2407252788543701 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0015463829040527344 batch 1 Loaded 114 chid ids of type : 4230 Number RLEs to save : 11234 TO DO : save crop sub photo not yet done ! save time : 0.6534953117370605 nb_obj : 107 nb_hashtags : 8 time to prepare the origin masks : 1.5323827266693115 time for calcul the mask position with numpy : 0.024726390838623047 nb_pixel_total : 1772523 time to create 1 rle with new method : 0.04021430015563965 time for calcul the mask position with numpy : 0.007203578948974609 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004565715789794922 time for calcul the mask position with numpy : 0.00713038444519043 nb_pixel_total : 1241 time to create 1 rle with old method : 0.0014197826385498047 time for calcul the mask position with numpy : 0.0068912506103515625 nb_pixel_total : 45 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.0067059993743896484 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004620552062988281 time for calcul the mask position with numpy : 0.006812572479248047 nb_pixel_total : 8 time to create 1 rle with old method : 4.601478576660156e-05 time for calcul the mask position with numpy : 0.0074939727783203125 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0011928081512451172 time for calcul the mask position with numpy : 0.00682520866394043 nb_pixel_total : 838 time to create 1 rle with old method : 0.0010311603546142578 time for calcul the mask position with numpy : 0.010411262512207031 nb_pixel_total : 115 time to create 1 rle with old method : 0.0001704692840576172 time for calcul the mask position with numpy : 0.006906270980834961 nb_pixel_total : 1747 time to create 1 rle with old method : 0.002134561538696289 time for calcul the mask position with numpy : 0.00666356086730957 nb_pixel_total : 35 time to create 1 rle with old method : 7.128715515136719e-05 time for calcul the mask position with numpy : 0.006646394729614258 nb_pixel_total : 36 time to create 1 rle with old method : 9.512901306152344e-05 time for calcul the mask position with numpy : 0.0066149234771728516 nb_pixel_total : 2379 time to create 1 rle with old method : 0.0027937889099121094 time for calcul the mask position with numpy : 0.006689786911010742 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005972385406494141 time for calcul the mask position with numpy : 0.006491899490356445 nb_pixel_total : 1 time to create 1 rle with old method : 2.4080276489257812e-05 time for calcul the mask position with numpy : 0.006608247756958008 nb_pixel_total : 5 time to create 1 rle with old method : 3.2901763916015625e-05 time for calcul the mask position with numpy : 0.006544351577758789 nb_pixel_total : 19 time to create 1 rle with old method : 0.00013375282287597656 time for calcul the mask position with numpy : 0.00672459602355957 nb_pixel_total : 294 time to create 1 rle with old method : 0.000377655029296875 time for calcul the mask position with numpy : 0.006604909896850586 nb_pixel_total : 22241 time to create 1 rle with old method : 0.02454233169555664 time for calcul the mask position with numpy : 0.006376504898071289 nb_pixel_total : 799 time to create 1 rle with old method : 0.0010025501251220703 time for calcul the mask position with numpy : 0.006419181823730469 nb_pixel_total : 224 time to create 1 rle with old method : 0.00026416778564453125 time for calcul the mask position with numpy : 0.006374835968017578 nb_pixel_total : 2309 time to create 1 rle with old method : 0.0026166439056396484 time for calcul the mask position with numpy : 0.006726741790771484 nb_pixel_total : 2752 time to create 1 rle with old method : 0.0030596256256103516 time for calcul the mask position with numpy : 0.00657963752746582 nb_pixel_total : 1510 time to create 1 rle with old method : 0.001764535903930664 time for calcul the mask position with numpy : 0.0065577030181884766 nb_pixel_total : 92 time to create 1 rle with old method : 0.00015497207641601562 time for calcul the mask position with numpy : 0.0065305233001708984 nb_pixel_total : 116 time to create 1 rle with old method : 0.00015854835510253906 time for calcul the mask position with numpy : 0.006791591644287109 nb_pixel_total : 2496 time to create 1 rle with old method : 0.0029647350311279297 time for calcul the mask position with numpy : 0.006697416305541992 nb_pixel_total : 1614 time to create 1 rle with old method : 0.0020983219146728516 time for calcul the mask position with numpy : 0.006872415542602539 nb_pixel_total : 8483 time to create 1 rle with old method : 0.01073145866394043 time for calcul the mask position with numpy : 0.007326364517211914 nb_pixel_total : 100 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.006842613220214844 nb_pixel_total : 5047 time to create 1 rle with old method : 0.0071375370025634766 time for calcul the mask position with numpy : 0.006800651550292969 nb_pixel_total : 16 time to create 1 rle with old method : 4.38690185546875e-05 time for calcul the mask position with numpy : 0.006588935852050781 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007555484771728516 time for calcul the mask position with numpy : 0.006211757659912109 nb_pixel_total : 689 time to create 1 rle with old method : 0.0008075237274169922 time for calcul the mask position with numpy : 0.006300210952758789 nb_pixel_total : 788 time to create 1 rle with old method : 0.0008742809295654297 time for calcul the mask position with numpy : 0.0064427852630615234 nb_pixel_total : 9761 time to create 1 rle with old method : 0.011179685592651367 time for calcul the mask position with numpy : 0.006832599639892578 nb_pixel_total : 688 time to create 1 rle with old method : 0.0007932186126708984 time for calcul the mask position with numpy : 0.010169506072998047 nb_pixel_total : 1215 time to create 1 rle with old method : 0.0016198158264160156 time for calcul the mask position with numpy : 0.011393308639526367 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004608631134033203 time for calcul the mask position with numpy : 0.011643648147583008 nb_pixel_total : 8 time to create 1 rle with old method : 5.53131103515625e-05 time for calcul the mask position with numpy : 0.012952566146850586 nb_pixel_total : 746 time to create 1 rle with old method : 0.001155853271484375 time for calcul the mask position with numpy : 0.013092756271362305 nb_pixel_total : 237 time to create 1 rle with old method : 0.00047206878662109375 time for calcul the mask position with numpy : 0.013495206832885742 nb_pixel_total : 843 time to create 1 rle with old method : 0.0012280941009521484 time for calcul the mask position with numpy : 0.013581991195678711 nb_pixel_total : 34 time to create 1 rle with old method : 7.724761962890625e-05 time for calcul the mask position with numpy : 0.013179540634155273 nb_pixel_total : 650 time to create 1 rle with old method : 0.0009584426879882812 time for calcul the mask position with numpy : 0.00754857063293457 nb_pixel_total : 93 time to create 1 rle with old method : 0.0002257823944091797 time for calcul the mask position with numpy : 0.008233070373535156 nb_pixel_total : 2 time to create 1 rle with old method : 4.1961669921875e-05 time for calcul the mask position with numpy : 0.008239030838012695 nb_pixel_total : 124 time to create 1 rle with old method : 0.00026869773864746094 time for calcul the mask position with numpy : 0.00893402099609375 nb_pixel_total : 350 time to create 1 rle with old method : 0.0007536411285400391 time for calcul the mask position with numpy : 0.008492469787597656 nb_pixel_total : 4833 time to create 1 rle with old method : 0.009006738662719727 time for calcul the mask position with numpy : 0.007843017578125 nb_pixel_total : 1033 time to create 1 rle with old method : 0.002027750015258789 time for calcul the mask position with numpy : 0.00861358642578125 nb_pixel_total : 2446 time to create 1 rle with old method : 0.0045108795166015625 time for calcul the mask position with numpy : 0.007767438888549805 nb_pixel_total : 4009 time to create 1 rle with old method : 0.007586956024169922 time for calcul the mask position with numpy : 0.007205486297607422 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005660057067871094 time for calcul the mask position with numpy : 0.00708460807800293 nb_pixel_total : 735 time to create 1 rle with old method : 0.0010149478912353516 time for calcul the mask position with numpy : 0.007382631301879883 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005574226379394531 time for calcul the mask position with numpy : 0.007340908050537109 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0015683174133300781 time for calcul the mask position with numpy : 0.006852388381958008 nb_pixel_total : 5131 time to create 1 rle with old method : 0.006312131881713867 time for calcul the mask position with numpy : 0.006826639175415039 nb_pixel_total : 1444 time to create 1 rle with old method : 0.0017583370208740234 time for calcul the mask position with numpy : 0.008729696273803711 nb_pixel_total : 2752 time to create 1 rle with old method : 0.0032367706298828125 time for calcul the mask position with numpy : 0.00692296028137207 nb_pixel_total : 4822 time to create 1 rle with old method : 0.005864620208740234 time for calcul the mask position with numpy : 0.006997585296630859 nb_pixel_total : 780 time to create 1 rle with old method : 0.0009255409240722656 time for calcul the mask position with numpy : 0.007334709167480469 nb_pixel_total : 932 time to create 1 rle with old method : 0.0012149810791015625 time for calcul the mask position with numpy : 0.007786273956298828 nb_pixel_total : 178 time to create 1 rle with old method : 0.00029206275939941406 time for calcul the mask position with numpy : 0.007838964462280273 nb_pixel_total : 397 time to create 1 rle with old method : 0.0004928112030029297 time for calcul the mask position with numpy : 0.0072154998779296875 nb_pixel_total : 341 time to create 1 rle with old method : 0.0004730224609375 time for calcul the mask position with numpy : 0.0068929195404052734 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0017828941345214844 time for calcul the mask position with numpy : 0.0076656341552734375 nb_pixel_total : 437 time to create 1 rle with old method : 0.0009567737579345703 time for calcul the mask position with numpy : 0.00843048095703125 nb_pixel_total : 747 time to create 1 rle with old method : 0.0014710426330566406 time for calcul the mask position with numpy : 0.008239507675170898 nb_pixel_total : 1717 time to create 1 rle with old method : 0.003565549850463867 time for calcul the mask position with numpy : 0.010033369064331055 nb_pixel_total : 214 time to create 1 rle with old method : 0.0005524158477783203 time for calcul the mask position with numpy : 0.010629415512084961 nb_pixel_total : 106275 time to create 1 rle with old method : 0.13718295097351074 time for calcul the mask position with numpy : 0.007584810256958008 nb_pixel_total : 509 time to create 1 rle with old method : 0.0007088184356689453 time for calcul the mask position with numpy : 0.006975889205932617 nb_pixel_total : 3258 time to create 1 rle with old method : 0.004351377487182617 time for calcul the mask position with numpy : 0.0068585872650146484 nb_pixel_total : 32324 time to create 1 rle with old method : 0.04194474220275879 time for calcul the mask position with numpy : 0.015050649642944336 nb_pixel_total : 3157 time to create 1 rle with old method : 0.005247354507446289 time for calcul the mask position with numpy : 0.011713027954101562 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002570152282714844 time for calcul the mask position with numpy : 0.013005256652832031 nb_pixel_total : 311 time to create 1 rle with old method : 0.00046539306640625 time for calcul the mask position with numpy : 0.013241291046142578 nb_pixel_total : 342 time to create 1 rle with old method : 0.0005500316619873047 time for calcul the mask position with numpy : 0.013211727142333984 nb_pixel_total : 30499 time to create 1 rle with old method : 0.03919553756713867 time for calcul the mask position with numpy : 0.009794473648071289 nb_pixel_total : 6239 time to create 1 rle with old method : 0.008823871612548828 time for calcul the mask position with numpy : 0.007788419723510742 nb_pixel_total : 759 time to create 1 rle with old method : 0.0010595321655273438 time for calcul the mask position with numpy : 0.007883548736572266 nb_pixel_total : 201 time to create 1 rle with old method : 0.00031566619873046875 time for calcul the mask position with numpy : 0.007647275924682617 nb_pixel_total : 411 time to create 1 rle with old method : 0.000644683837890625 time for calcul the mask position with numpy : 0.007565021514892578 nb_pixel_total : 112 time to create 1 rle with old method : 0.00018095970153808594 time for calcul the mask position with numpy : 0.007843255996704102 nb_pixel_total : 494 time to create 1 rle with old method : 0.0007083415985107422 time for calcul the mask position with numpy : 0.008104562759399414 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003116130828857422 time for calcul the mask position with numpy : 0.00790858268737793 nb_pixel_total : 340 time to create 1 rle with old method : 0.0005166530609130859 time for calcul the mask position with numpy : 0.007718086242675781 nb_pixel_total : 48 time to create 1 rle with old method : 9.512901306152344e-05 time for calcul the mask position with numpy : 0.007394552230834961 nb_pixel_total : 178 time to create 1 rle with old method : 0.00036454200744628906 time for calcul the mask position with numpy : 0.00813603401184082 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005559921264648438 time for calcul the mask position with numpy : 0.007980108261108398 nb_pixel_total : 16 time to create 1 rle with old method : 6.628036499023438e-05 time for calcul the mask position with numpy : 0.007871150970458984 nb_pixel_total : 248 time to create 1 rle with old method : 0.00031828880310058594 time for calcul the mask position with numpy : 0.007266044616699219 nb_pixel_total : 114 time to create 1 rle with old method : 0.00022530555725097656 time for calcul the mask position with numpy : 0.0074427127838134766 nb_pixel_total : 89 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.007669925689697266 nb_pixel_total : 247 time to create 1 rle with old method : 0.00040268898010253906 time for calcul the mask position with numpy : 0.008427858352661133 nb_pixel_total : 411 time to create 1 rle with old method : 0.0006029605865478516 time for calcul the mask position with numpy : 0.008332490921020508 nb_pixel_total : 102 time to create 1 rle with old method : 0.00014352798461914062 time for calcul the mask position with numpy : 0.00813150405883789 nb_pixel_total : 782 time to create 1 rle with old method : 0.0010211467742919922 time for calcul the mask position with numpy : 0.007991313934326172 nb_pixel_total : 2 time to create 1 rle with old method : 3.457069396972656e-05 time for calcul the mask position with numpy : 0.007812023162841797 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005998611450195312 time for calcul the mask position with numpy : 0.0076334476470947266 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005137920379638672 time for calcul the mask position with numpy : 0.007276296615600586 nb_pixel_total : 285 time to create 1 rle with old method : 0.00044083595275878906 time for calcul the mask position with numpy : 0.007276058197021484 nb_pixel_total : 161 time to create 1 rle with old method : 0.000202178955078125 time for calcul the mask position with numpy : 0.007546901702880859 nb_pixel_total : 95 time to create 1 rle with old method : 0.00020575523376464844 time for calcul the mask position with numpy : 0.007771492004394531 nb_pixel_total : 1088 time to create 1 rle with old method : 0.0014836788177490234 time for calcul the mask position with numpy : 0.007345676422119141 nb_pixel_total : 26 time to create 1 rle with old method : 6.747245788574219e-05 time for calcul the mask position with numpy : 0.007977724075317383 nb_pixel_total : 181 time to create 1 rle with old method : 0.00023555755615234375 create new chi : 1.3300361633300781 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0020647048950195312 batch 1 Loaded 108 chid ids of type : 4230 Number RLEs to save : 11280 TO DO : save crop sub photo not yet done ! save time : 0.7088708877563477 nb_obj : 103 nb_hashtags : 7 time to prepare the origin masks : 1.5226829051971436 time for calcul the mask position with numpy : 0.029198169708251953 nb_pixel_total : 1828064 time to create 1 rle with new method : 0.05314373970031738 time for calcul the mask position with numpy : 0.0062100887298583984 nb_pixel_total : 1374 time to create 1 rle with old method : 0.0016760826110839844 time for calcul the mask position with numpy : 0.006127834320068359 nb_pixel_total : 318 time to create 1 rle with old method : 0.0003972053527832031 time for calcul the mask position with numpy : 0.010135173797607422 nb_pixel_total : 35 time to create 1 rle with old method : 6.771087646484375e-05 time for calcul the mask position with numpy : 0.0060198307037353516 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005338191986083984 time for calcul the mask position with numpy : 0.006075859069824219 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004508495330810547 time for calcul the mask position with numpy : 0.01019906997680664 nb_pixel_total : 834 time to create 1 rle with old method : 0.001455545425415039 time for calcul the mask position with numpy : 0.011896133422851562 nb_pixel_total : 934 time to create 1 rle with old method : 0.0015630722045898438 time for calcul the mask position with numpy : 0.01326608657836914 nb_pixel_total : 67 time to create 1 rle with old method : 0.0001685619354248047 time for calcul the mask position with numpy : 0.01265263557434082 nb_pixel_total : 73 time to create 1 rle with old method : 0.00015878677368164062 time for calcul the mask position with numpy : 0.011933565139770508 nb_pixel_total : 2888 time to create 1 rle with old method : 0.00471043586730957 time for calcul the mask position with numpy : 0.0066127777099609375 nb_pixel_total : 120 time to create 1 rle with old method : 0.00029349327087402344 time for calcul the mask position with numpy : 0.006598472595214844 nb_pixel_total : 4 time to create 1 rle with old method : 2.7418136596679688e-05 time for calcul the mask position with numpy : 0.006377220153808594 nb_pixel_total : 1 time to create 1 rle with old method : 2.1457672119140625e-05 time for calcul the mask position with numpy : 0.008417129516601562 nb_pixel_total : 143 time to create 1 rle with old method : 0.00021338462829589844 time for calcul the mask position with numpy : 0.009349346160888672 nb_pixel_total : 9800 time to create 1 rle with old method : 0.010966300964355469 time for calcul the mask position with numpy : 0.011585712432861328 nb_pixel_total : 855 time to create 1 rle with old method : 0.0010118484497070312 time for calcul the mask position with numpy : 0.01076960563659668 nb_pixel_total : 2296 time to create 1 rle with old method : 0.002963542938232422 time for calcul the mask position with numpy : 0.012451410293579102 nb_pixel_total : 2508 time to create 1 rle with old method : 0.003515005111694336 time for calcul the mask position with numpy : 0.012759685516357422 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007622241973876953 time for calcul the mask position with numpy : 0.012637853622436523 nb_pixel_total : 1252 time to create 1 rle with old method : 0.00165557861328125 time for calcul the mask position with numpy : 0.01659679412841797 nb_pixel_total : 246 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.012727737426757812 nb_pixel_total : 3232 time to create 1 rle with old method : 0.004371166229248047 time for calcul the mask position with numpy : 0.01244211196899414 nb_pixel_total : 8172 time to create 1 rle with old method : 0.010627031326293945 time for calcul the mask position with numpy : 0.012674808502197266 nb_pixel_total : 1332 time to create 1 rle with old method : 0.0020072460174560547 time for calcul the mask position with numpy : 0.012967348098754883 nb_pixel_total : 118 time to create 1 rle with old method : 0.00017523765563964844 time for calcul the mask position with numpy : 0.01332855224609375 nb_pixel_total : 4639 time to create 1 rle with old method : 0.006185770034790039 time for calcul the mask position with numpy : 0.012315988540649414 nb_pixel_total : 347 time to create 1 rle with old method : 0.0006611347198486328 time for calcul the mask position with numpy : 0.013593435287475586 nb_pixel_total : 588 time to create 1 rle with old method : 0.0011165142059326172 time for calcul the mask position with numpy : 0.012285947799682617 nb_pixel_total : 649 time to create 1 rle with old method : 0.0007522106170654297 time for calcul the mask position with numpy : 0.010263442993164062 nb_pixel_total : 829 time to create 1 rle with old method : 0.0011014938354492188 time for calcul the mask position with numpy : 0.011292219161987305 nb_pixel_total : 9896 time to create 1 rle with old method : 0.01711726188659668 time for calcul the mask position with numpy : 0.0101318359375 nb_pixel_total : 1181 time to create 1 rle with old method : 0.0013759136199951172 time for calcul the mask position with numpy : 0.012029170989990234 nb_pixel_total : 360 time to create 1 rle with old method : 0.00047135353088378906 time for calcul the mask position with numpy : 0.01114654541015625 nb_pixel_total : 21 time to create 1 rle with old method : 7.700920104980469e-05 time for calcul the mask position with numpy : 0.010704755783081055 nb_pixel_total : 904 time to create 1 rle with old method : 0.0010776519775390625 time for calcul the mask position with numpy : 0.009717226028442383 nb_pixel_total : 714 time to create 1 rle with old method : 0.0008566379547119141 time for calcul the mask position with numpy : 0.01008296012878418 nb_pixel_total : 1123 time to create 1 rle with old method : 0.001316070556640625 time for calcul the mask position with numpy : 0.010557413101196289 nb_pixel_total : 26 time to create 1 rle with old method : 8.177757263183594e-05 time for calcul the mask position with numpy : 0.010012626647949219 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001575946807861328 time for calcul the mask position with numpy : 0.010495424270629883 nb_pixel_total : 65 time to create 1 rle with old method : 0.00015425682067871094 time for calcul the mask position with numpy : 0.010886907577514648 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004162788391113281 time for calcul the mask position with numpy : 0.010727643966674805 nb_pixel_total : 4283 time to create 1 rle with old method : 0.005031108856201172 time for calcul the mask position with numpy : 0.010533571243286133 nb_pixel_total : 2614 time to create 1 rle with old method : 0.003030061721801758 time for calcul the mask position with numpy : 0.011140584945678711 nb_pixel_total : 1076 time to create 1 rle with old method : 0.0015854835510253906 time for calcul the mask position with numpy : 0.010721683502197266 nb_pixel_total : 751 time to create 1 rle with old method : 0.0008523464202880859 time for calcul the mask position with numpy : 0.013508081436157227 nb_pixel_total : 361 time to create 1 rle with old method : 0.00044226646423339844 time for calcul the mask position with numpy : 0.009999990463256836 nb_pixel_total : 14 time to create 1 rle with old method : 5.173683166503906e-05 time for calcul the mask position with numpy : 0.009966850280761719 nb_pixel_total : 994 time to create 1 rle with old method : 0.0011758804321289062 time for calcul the mask position with numpy : 0.010066986083984375 nb_pixel_total : 25 time to create 1 rle with old method : 5.8650970458984375e-05 time for calcul the mask position with numpy : 0.010140657424926758 nb_pixel_total : 1076 time to create 1 rle with old method : 0.0012981891632080078 time for calcul the mask position with numpy : 0.01024007797241211 nb_pixel_total : 1834 time to create 1 rle with old method : 0.0021200180053710938 time for calcul the mask position with numpy : 0.010470151901245117 nb_pixel_total : 4228 time to create 1 rle with old method : 0.004897356033325195 time for calcul the mask position with numpy : 0.010559797286987305 nb_pixel_total : 628 time to create 1 rle with old method : 0.0008680820465087891 time for calcul the mask position with numpy : 0.011239767074584961 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005643367767333984 time for calcul the mask position with numpy : 0.011498451232910156 nb_pixel_total : 2688 time to create 1 rle with old method : 0.0032930374145507812 time for calcul the mask position with numpy : 0.010433673858642578 nb_pixel_total : 867 time to create 1 rle with old method : 0.001004934310913086 time for calcul the mask position with numpy : 0.010895729064941406 nb_pixel_total : 992 time to create 1 rle with old method : 0.0011723041534423828 time for calcul the mask position with numpy : 0.010826587677001953 nb_pixel_total : 190 time to create 1 rle with old method : 0.00023698806762695312 time for calcul the mask position with numpy : 0.010228872299194336 nb_pixel_total : 12 time to create 1 rle with old method : 4.1484832763671875e-05 time for calcul the mask position with numpy : 0.010001659393310547 nb_pixel_total : 1353 time to create 1 rle with old method : 0.0016167163848876953 time for calcul the mask position with numpy : 0.010215997695922852 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003619194030761719 time for calcul the mask position with numpy : 0.010272502899169922 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005261898040771484 time for calcul the mask position with numpy : 0.010945558547973633 nb_pixel_total : 305 time to create 1 rle with old method : 0.0004792213439941406 time for calcul the mask position with numpy : 0.01073765754699707 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003139972686767578 time for calcul the mask position with numpy : 0.010275840759277344 nb_pixel_total : 1655 time to create 1 rle with old method : 0.0019297599792480469 time for calcul the mask position with numpy : 0.013866901397705078 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003619194030761719 time for calcul the mask position with numpy : 0.011941671371459961 nb_pixel_total : 106496 time to create 1 rle with old method : 0.11346054077148438 time for calcul the mask position with numpy : 0.01019740104675293 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005538463592529297 time for calcul the mask position with numpy : 0.010071039199829102 nb_pixel_total : 294 time to create 1 rle with old method : 0.00040411949157714844 time for calcul the mask position with numpy : 0.010057449340820312 nb_pixel_total : 3120 time to create 1 rle with old method : 0.0035936832427978516 time for calcul the mask position with numpy : 0.010085344314575195 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003185272216796875 time for calcul the mask position with numpy : 0.010043859481811523 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001392364501953125 time for calcul the mask position with numpy : 0.01007390022277832 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0016868114471435547 time for calcul the mask position with numpy : 0.011782169342041016 nb_pixel_total : 34632 time to create 1 rle with old method : 0.04303407669067383 time for calcul the mask position with numpy : 0.012957334518432617 nb_pixel_total : 251 time to create 1 rle with old method : 0.00042557716369628906 time for calcul the mask position with numpy : 0.010988235473632812 nb_pixel_total : 421 time to create 1 rle with old method : 0.00063323974609375 time for calcul the mask position with numpy : 0.011527299880981445 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004184246063232422 time for calcul the mask position with numpy : 0.0064699649810791016 nb_pixel_total : 110 time to create 1 rle with old method : 0.00015425682067871094 time for calcul the mask position with numpy : 0.006646156311035156 nb_pixel_total : 4519 time to create 1 rle with old method : 0.0052263736724853516 time for calcul the mask position with numpy : 0.006635189056396484 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005662441253662109 time for calcul the mask position with numpy : 0.007233381271362305 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004215240478515625 time for calcul the mask position with numpy : 0.006849765777587891 nb_pixel_total : 15 time to create 1 rle with old method : 6.008148193359375e-05 time for calcul the mask position with numpy : 0.006722688674926758 nb_pixel_total : 391 time to create 1 rle with old method : 0.00047016143798828125 time for calcul the mask position with numpy : 0.006566762924194336 nb_pixel_total : 177 time to create 1 rle with old method : 0.00022149085998535156 time for calcul the mask position with numpy : 0.006875038146972656 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004630088806152344 time for calcul the mask position with numpy : 0.006288290023803711 nb_pixel_total : 282 time to create 1 rle with old method : 0.00034618377685546875 time for calcul the mask position with numpy : 0.006644487380981445 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001366138458251953 time for calcul the mask position with numpy : 0.00638580322265625 nb_pixel_total : 194 time to create 1 rle with old method : 0.00024628639221191406 time for calcul the mask position with numpy : 0.0065691471099853516 nb_pixel_total : 385 time to create 1 rle with old method : 0.00046443939208984375 time for calcul the mask position with numpy : 0.006440877914428711 nb_pixel_total : 20 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.006618976593017578 nb_pixel_total : 854 time to create 1 rle with old method : 0.00099945068359375 time for calcul the mask position with numpy : 0.006503582000732422 nb_pixel_total : 131 time to create 1 rle with old method : 0.00018286705017089844 time for calcul the mask position with numpy : 0.006321907043457031 nb_pixel_total : 491 time to create 1 rle with old method : 0.0006158351898193359 time for calcul the mask position with numpy : 0.0072383880615234375 nb_pixel_total : 390 time to create 1 rle with old method : 0.00045990943908691406 time for calcul the mask position with numpy : 0.006577491760253906 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.006766796112060547 nb_pixel_total : 257 time to create 1 rle with old method : 0.00032806396484375 time for calcul the mask position with numpy : 0.0067327022552490234 nb_pixel_total : 17 time to create 1 rle with old method : 7.200241088867188e-05 time for calcul the mask position with numpy : 0.007075786590576172 nb_pixel_total : 293 time to create 1 rle with old method : 0.0003707408905029297 time for calcul the mask position with numpy : 0.007001638412475586 nb_pixel_total : 1 time to create 1 rle with old method : 2.2172927856445312e-05 time for calcul the mask position with numpy : 0.006353616714477539 nb_pixel_total : 31 time to create 1 rle with old method : 6.031990051269531e-05 time for calcul the mask position with numpy : 0.0061969757080078125 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002307891845703125 time for calcul the mask position with numpy : 0.0061457157135009766 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002627372741699219 time for calcul the mask position with numpy : 0.006243705749511719 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002636909484863281 create new chi : 1.3802647590637207 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.002725362777709961 batch 1 Loaded 104 chid ids of type : 4230 Number RLEs to save : 10631 TO DO : save crop sub photo not yet done ! save time : 0.6244540214538574 map_output_result : {1336822911: (0.0, 'Should be the crop_list due to order', 0.0), 1336822775: (0.0, 'Should be the crop_list due to order', 0.0), 1336822766: (0.0, 'Should be the crop_list due to order', 0.0), 1336822763: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1336822911, 1336822775, 1336822766, 1336822763] Looping around the photos to save general results len do output : 4 /1336822911.Didn't retrieve data . /1336822775.Didn't retrieve data . /1336822766.Didn't retrieve data . /1336822763.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822911', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822775', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822766', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822763', None, None, None, None, None, '2576341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012830972671508789 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.59509015083313 time spend to save output : 0.01346898078918457 total time spend for step 4 : 14.608559131622314 step5:crop_condition Tue Feb 11 14:21:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 440 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 143 About to insert : list_path_to_insert length 143 new photo from crops ! About to upload 143 photos upload in portfolio : 4869462 init cache_photo without model_param we have 143 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739280084_2798694 we have uploaded 143 photos in the portfolio 4869462 time of upload the photos Elapsed time : 35.22071552276611 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 59 About to insert : list_path_to_insert length 59 new photo from crops ! About to upload 59 photos upload in portfolio : 4869462 init cache_photo without model_param we have 59 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739280121_2798694 we have uploaded 59 photos in the portfolio 4869462 time of upload the photos Elapsed time : 13.962532997131348 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739280135_2798694 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7321517467498779 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 4869462 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739280136_2798694 we have uploaded 12 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.021688222885132 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 59 About to insert : list_path_to_insert length 59 new photo from crops ! About to upload 59 photos upload in portfolio : 4869462 init cache_photo without model_param we have 59 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739280143_2798694 we have uploaded 59 photos in the portfolio 4869462 time of upload the photos Elapsed time : 13.242905378341675 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739280157_2798694 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5461549758911133 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739280157_2798694 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.4854848384857178 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1336822911, 1336822775, 1336822766, 1336822763] Looping around the photos to save general results len do output : 277 /1336832057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336832434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822911', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822775', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822766', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822763', None, None, None, None, None, '2576341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 835 time used for this insertion : 0.044869184494018555 save_final save missing photos in datou_result : time spend for datou_step_exec : 76.21420693397522 time spend to save output : 0.051988840103149414 total time spend for step 5 : 76.26619577407837 step6:thcl Tue Feb 11 14:22:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.021520614624023438 time to convert the images to numpy array : 0.0623323917388916 time to import caffe and check if the image exist : 0.02437758445739746 time to convert the images to numpy array : 0.07238340377807617 time to import caffe and check if the image exist : 0.01358795166015625 time to convert the images to numpy array : 0.0885777473449707 time to import caffe and check if the image exist : 0.02350759506225586 time to convert the images to numpy array : 0.08056235313415527 time to import caffe and check if the image exist : 0.014278411865234375 time to convert the images to numpy array : 0.09083437919616699 time to import caffe and check if the image exist : 0.019732952117919922 time to convert the images to numpy array : 0.08969402313232422 time to import caffe and check if the image exist : 0.026572227478027344 time to convert the images to numpy array : 0.08558773994445801 time to import caffe and check if the image exist : 0.031017541885375977 time to convert the images to numpy array : 0.08213186264038086 time to import caffe and check if the image exist : 0.036237478256225586 time to convert the images to numpy array : 0.07745480537414551 time to import caffe and check if the image exist : 0.028648853302001953 time to convert the images to numpy array : 0.08534359931945801 total time to convert the images to numpy array : 0.38309788703918457 list photo_ids error: [] list photo_ids correct : [1336832120, 1336832123, 1336832127, 1336832130, 1336832134, 1336832137, 1336832142, 1336832146, 1336832148, 1336832149, 1336832150, 1336832151, 1336832152, 1336832153, 1336832154, 1336832155, 1336832156, 1336832157, 1336832158, 1336832159, 1336832160, 1336832161, 1336832162, 1336832163, 1336832164, 1336832165, 1336832166, 1336832167, 1336832407, 1336832408, 1336832409, 1336832410, 1336832411, 1336832412, 1336832413, 1336832415, 1336832416, 1336832417, 1336832418, 1336832420, 1336832421, 1336832422, 1336832423, 1336832424, 1336832425, 1336832426, 1336832427, 1336832428, 1336832429, 1336832431, 1336832432, 1336832433, 1336832434, 1336832304, 1336832305, 1336832306, 1336832307, 1336832308, 1336832309, 1336832311, 1336832312, 1336832333, 1336832334, 1336832335, 1336832336, 1336832337, 1336832338, 1336832339, 1336832340, 1336832341, 1336832342, 1336832343, 1336832344, 1336832371, 1336832372, 1336832373, 1336832374, 1336832375, 1336832376, 1336832377, 1336832378, 1336832197, 1336832198, 1336832199, 1336832200, 1336832201, 1336832202, 1336832203, 1336832204, 1336832205, 1336832206, 1336832207, 1336832208, 1336832209, 1336832210, 1336832211, 1336832212, 1336832213, 1336832214, 1336832215, 1336832216, 1336832217, 1336832218, 1336832219, 1336832220, 1336832221, 1336832222, 1336832223, 1336832224, 1336832273, 1336832274, 1336832275, 1336832276, 1336832277, 1336832278, 1336832279, 1336832280, 1336832281, 1336832283, 1336832286, 1336832287, 1336832288, 1336832289, 1336832290, 1336832291, 1336832292, 1336832293, 1336832294, 1336832295, 1336832296, 1336832297, 1336832298, 1336832299, 1336832300, 1336832301, 1336832302, 1336832303, 1336832086, 1336832087, 1336832088, 1336832089, 1336832090, 1336832091, 1336832092, 1336832093, 1336832094, 1336832095, 1336832096, 1336832097, 1336832098, 1336832099, 1336832100, 1336832101, 1336832102, 1336832103, 1336832104, 1336832105, 1336832106, 1336832107, 1336832108, 1336832109, 1336832110, 1336832111, 1336832113, 1336832117, 1336832057, 1336832058, 1336832059, 1336832061, 1336832062, 1336832063, 1336832064, 1336832065, 1336832066, 1336832067, 1336832068, 1336832069, 1336832070, 1336832071, 1336832072, 1336832073, 1336832074, 1336832075, 1336832076, 1336832077, 1336832078, 1336832079, 1336832080, 1336832081, 1336832082, 1336832083, 1336832084, 1336832085, 1336832168, 1336832170, 1336832171, 1336832172, 1336832173, 1336832174, 1336832175, 1336832176, 1336832177, 1336832178, 1336832179, 1336832180, 1336832181, 1336832182, 1336832183, 1336832184, 1336832185, 1336832186, 1336832187, 1336832188, 1336832189, 1336832190, 1336832191, 1336832192, 1336832193, 1336832194, 1336832195, 1336832196, 1336832225, 1336832226, 1336832227, 1336832247, 1336832248, 1336832249, 1336832250, 1336832251, 1336832252, 1336832253, 1336832254, 1336832255, 1336832256, 1336832257, 1336832258, 1336832259, 1336832260, 1336832261, 1336832263, 1336832264, 1336832265, 1336832266, 1336832267, 1336832268, 1336832269, 1336832270, 1336832271, 1336832272, 1336832379, 1336832380, 1336832381, 1336832382, 1336832383, 1336832384, 1336832385, 1336832386, 1336832387, 1336832388, 1336832389, 1336832390, 1336832391, 1336832392, 1336832393, 1336832394, 1336832395, 1336832396, 1336832397, 1336832398, 1336832399, 1336832400, 1336832401, 1336832402, 1336832403, 1336832404, 1336832405, 1336832406] number of photos to traite : 277 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10555 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.337134599685669 time used to do the prediction : 0.9904298782348633 save descriptor for thcl : 3237 time to traite the descriptors : 1.6809134483337402 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1336832120 To insert : 1336832123 To insert : 1336832127 To insert : 1336832130 To insert : 1336832134 To insert : 1336832137 To insert : 1336832142 To insert : 1336832146 To insert : 1336832148 To insert : 1336832149 To insert : 1336832150 To insert : 1336832151 To insert : 1336832152 To insert : 1336832153 To insert : 1336832154 To insert : 1336832155 To insert : 1336832156 To insert : 1336832157 To insert : 1336832158 To insert : 1336832159 To insert : 1336832160 To insert : 1336832161 To insert : 1336832162 To insert : 1336832163 To insert : 1336832164 To insert : 1336832165 To insert : 1336832166 To insert : 1336832167 To insert : 1336832407 To insert : 1336832408 To insert : 1336832409 To insert : 1336832410 To insert : 1336832411 To insert : 1336832412 To insert : 1336832413 To insert : 1336832415 To insert : 1336832416 To insert : 1336832417 To insert : 1336832418 To insert : 1336832420 To insert : 1336832421 To insert : 1336832422 To insert : 1336832423 To insert : 1336832424 To insert : 1336832425 To insert : 1336832426 To insert : 1336832427 To insert : 1336832428 To insert : 1336832429 To insert : 1336832431 To insert : 1336832432 To insert : 1336832433 To insert : 1336832434 To insert : 1336832304 To insert : 1336832305 To insert : 1336832306 To insert : 1336832307 To insert : 1336832308 To insert : 1336832309 To insert : 1336832311 To insert : 1336832312 To insert : 1336832333 To insert : 1336832334 To insert : 1336832335 To insert : 1336832336 To insert : 1336832337 To insert : 1336832338 To insert : 1336832339 To insert : 1336832340 To insert : 1336832341 To insert : 1336832342 To insert : 1336832343 To insert : 1336832344 To insert : 1336832371 To insert : 1336832372 To insert : 1336832373 To insert : 1336832374 To insert : 1336832375 To insert : 1336832376 To insert : 1336832377 To insert : 1336832378 To insert : 1336832197 To insert : 1336832198 To insert : 1336832199 To insert : 1336832200 To insert : 1336832201 To insert : 1336832202 To insert : 1336832203 To insert : 1336832204 To insert : 1336832205 To insert : 1336832206 To insert : 1336832207 To insert : 1336832208 To insert : 1336832209 To insert : 1336832210 To insert : 1336832211 To insert : 1336832212 To insert : 1336832213 To insert : 1336832214 To insert : 1336832215 To insert : 1336832216 To insert : 1336832217 To insert : 1336832218 To insert : 1336832219 To insert : 1336832220 To insert : 1336832221 To insert : 1336832222 To insert : 1336832223 To insert : 1336832224 To insert : 1336832273 To insert : 1336832274 To insert : 1336832275 To insert : 1336832276 To insert : 1336832277 To insert : 1336832278 To insert : 1336832279 To insert : 1336832280 To insert : 1336832281 To insert : 1336832283 To insert : 1336832286 To insert : 1336832287 To insert : 1336832288 To insert : 1336832289 To insert : 1336832290 To insert : 1336832291 To insert : 1336832292 To insert : 1336832293 To insert : 1336832294 To insert : 1336832295 To insert : 1336832296 To insert : 1336832297 To insert : 1336832298 To insert : 1336832299 To insert : 1336832300 To insert : 1336832301 To insert : 1336832302 To insert : 1336832303 To insert : 1336832086 To insert : 1336832087 To insert : 1336832088 To insert : 1336832089 To insert : 1336832090 To insert : 1336832091 To insert : 1336832092 To insert : 1336832093 To insert : 1336832094 To insert : 1336832095 To insert : 1336832096 To insert : 1336832097 To insert : 1336832098 To insert : 1336832099 To insert : 1336832100 To insert : 1336832101 To insert : 1336832102 To insert : 1336832103 To insert : 1336832104 To insert : 1336832105 To insert : 1336832106 To insert : 1336832107 To insert : 1336832108 To insert : 1336832109 To insert : 1336832110 To insert : 1336832111 To insert : 1336832113 To insert : 1336832117 To insert : 1336832057 To insert : 1336832058 To insert : 1336832059 To insert : 1336832061 To insert : 1336832062 To insert : 1336832063 To insert : 1336832064 To insert : 1336832065 To insert : 1336832066 To insert : 1336832067 To insert : 1336832068 To insert : 1336832069 To insert : 1336832070 To insert : 1336832071 To insert : 1336832072 To insert : 1336832073 To insert : 1336832074 To insert : 1336832075 To insert : 1336832076 To insert : 1336832077 To insert : 1336832078 To insert : 1336832079 To insert : 1336832080 To insert : 1336832081 To insert : 1336832082 To insert : 1336832083 To insert : 1336832084 To insert : 1336832085 To insert : 1336832168 To insert : 1336832170 To insert : 1336832171 To insert : 1336832172 To insert : 1336832173 To insert : 1336832174 To insert : 1336832175 To insert : 1336832176 To insert : 1336832177 To insert : 1336832178 To insert : 1336832179 To insert : 1336832180 To insert : 1336832181 To insert : 1336832182 To insert : 1336832183 To insert : 1336832184 To insert : 1336832185 To insert : 1336832186 To insert : 1336832187 To insert : 1336832188 To insert : 1336832189 To insert : 1336832190 To insert : 1336832191 To insert : 1336832192 To insert : 1336832193 To insert : 1336832194 To insert : 1336832195 To insert : 1336832196 To insert : 1336832225 To insert : 1336832226 To insert : 1336832227 To insert : 1336832247 To insert : 1336832248 To insert : 1336832249 To insert : 1336832250 To insert : 1336832251 To insert : 1336832252 To insert : 1336832253 To insert : 1336832254 To insert : 1336832255 To insert : 1336832256 To insert : 1336832257 To insert : 1336832258 To insert : 1336832259 To insert : 1336832260 To insert : 1336832261 To insert : 1336832263 To insert : 1336832264 To insert : 1336832265 To insert : 1336832266 To insert : 1336832267 To insert : 1336832268 To insert : 1336832269 To insert : 1336832270 To insert : 1336832271 To insert : 1336832272 To insert : 1336832379 To insert : 1336832380 To insert : 1336832381 To insert : 1336832382 To insert : 1336832383 To insert : 1336832384 To insert : 1336832385 To insert : 1336832386 To insert : 1336832387 To insert : 1336832388 To insert : 1336832389 To insert : 1336832390 To insert : 1336832391 To insert : 1336832392 To insert : 1336832393 To insert : 1336832394 To insert : 1336832395 To insert : 1336832396 To insert : 1336832397 To insert : 1336832398 To insert : 1336832399 To insert : 1336832400 To insert : 1336832401 To insert : 1336832402 To insert : 1336832403 To insert : 1336832404 To insert : 1336832405 To insert : 1336832406 time to insert the descriptors : 52.911293268203735 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 423 time used for this insertion : 0.02989792823791504 save missing photos in datou_result : time spend for datou_step_exec : 61.315473556518555 time spend to save output : 0.08513760566711426 total time spend for step 6 : 61.40061116218567 step7:ventilate_hashtags_in_portfolio Tue Feb 11 14:23:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20445087 get user id for portfolio 20445087 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20445087 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','Film_plastique','Carton','metal','PET_fonce','autre','refus','mal_croppe','flou','environnement','pet_fonce','PEHD','Tetrapak','Papier','carton','PET_clair','pehd')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20445087 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','Film_plastique','Carton','metal','PET_fonce','autre','refus','mal_croppe','flou','environnement','pet_fonce','PEHD','Tetrapak','Papier','carton','PET_clair','pehd')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20445087 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','Film_plastique','Carton','metal','PET_fonce','autre','refus','mal_croppe','flou','environnement','pet_fonce','PEHD','Tetrapak','Papier','carton','PET_clair','pehd')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20445087 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','Film_plastique','Carton','metal','PET_fonce','autre','refus','mal_croppe','flou','environnement','pet_fonce','PEHD','Tetrapak','Papier','carton','PET_clair','pehd')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20445641,20445639,20445627,20445640,20445629,20445636,20445631,20445632,20445633,20445634,20445635,20445642,20445638?tags=pet_clair,papier,film_plastique,carton,metal,pet_fonce,autre,refus,mal_croppe,flou,environnement,pehd,tetrapak&datou_id_consolidate=4235&port_consolidate=20445087 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1336822911, 1336822775, 1336822766, 1336822763] Looping around the photos to save general results len do output : 1 /20445087. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822911', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822775', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822766', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822763', None, None, None, None, None, '2576341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012602567672729492 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.4004311561584473 time spend to save output : 0.012906789779663086 total time spend for step 7 : 2.4133379459381104 step8:final Tue Feb 11 14:23:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1336822911: ('0.20295017305943217',), 1336822775: ('0.20295017305943217',), 1336822766: ('0.20295017305943217',), 1336822763: ('0.20295017305943217',)} new output for save of step final : {1336822911: ('0.20295017305943217',), 1336822775: ('0.20295017305943217',), 1336822766: ('0.20295017305943217',), 1336822763: ('0.20295017305943217',)} [1336822911, 1336822775, 1336822766, 1336822763] Looping around the photos to save general results len do output : 4 /1336822911.Didn't retrieve data . /1336822775.Didn't retrieve data . /1336822766.Didn't retrieve data . /1336822763.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822911', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822775', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822766', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822763', None, None, None, None, None, '2576341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.011582136154174805 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11710906028747559 time spend to save output : 0.011826515197753906 total time spend for step 8 : 0.1289355754852295 step9:velours_tree Tue Feb 11 14:23:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20445641,20445639,20445627,20445640,20445629,20445636,20445631,20445632,20445633,20445634,20445635,20445642,20445638 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445641 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445639 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445627 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445640 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445629 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445636 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445631 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445632 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445633 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445634 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445635 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445642 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445638 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 277 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [0 3 5 0 0 5 0 0 5 1 2 2 0 5 5 4 4 4 0 0 0 4 1 1 1 0 1 0 0 2 0 2 5 2 1 4 0 0 0 0 1 0 2 1 0 0 1 1 2 2 5 5 4 4 4 0 0 2 4 0 1 1 5 2 0 2 5 2 4 4 0 0 1 4 0 2 0 0 5 0 1 2 2 5 4 0 0 2 0 2 0 1 0 0 2 2 2 4 0 0 4 0 0 1 1 0 2 1 0 0 0 0 5 2 4 4 4 0 5 0 0 0 2 0 5 0 0 1 5 2 0 2 0 0 2 1 4 0 0 1 1 0 2 3 3 1 4 4 4 4 1 4 3 3 4 0 0 0 3 5 1 4 1 4 0 4 1 1 4 1 5 4 3 3 0 1 1 4 4 4 1 1 1 4 1 4 3 3 0 1 2 1 4 4 3 0 0 4 1 1 1 4 1 0 5 1 0 0 4 1 4 4 1 2 4 1 5 5 5 0 0 0 0 1 0 1 5 1 0 1 0 1 0 5 5 5 4 0 0 1 0 1 1 0 0 1 5 1 1 5 5 5 5 5 1 1 0 0 4 1 5 1 0 0 5 1 5 5 1 0 4 5 1 1 0 0 5] Elapsed time: 0.04610157012939453 graph_id used : 77908 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20445641,20445639,20445627,20445640,20445629,20445636,20445631,20445632,20445633,20445634,20445635,20445642,20445638?tags=pet_clair,papier,film_plastique,carton,metal,pet_fonce,autre,refus,mal_croppe,flou,environnement,pehd,tetrapak&datou_id_consolidate=4235&port_consolidate=20445087&tree_id=77908 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1336822911, 1336822775, 1336822766, 1336822763] Looping around the photos to save general results len do output : 1 /20445087Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822911', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822775', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822766', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822763', None, None, None, None, None, '2576341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.011972188949584961 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.44078016281128 time spend to save output : 0.012343168258666992 total time spend for step 9 : 16.453123331069946 step10:send_mail_cod Tue Feb 11 14:23:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20445087_11-02-2025_14_23_58.pdf 20445623 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204456231739280238 20445621 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204456211739280239 20445609 imagette204456091739280240 20445622 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204456221739280240 20445611 change filename to text .change filename to text .imagette204456111739280241 20445618 change filename to text .imagette204456181739280241 20445613 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204456131739280241 20445614 imagette204456141739280243 20445615 imagette204456151739280243 20445616 imagette204456161739280243 20445624 change filename to text .imagette204456241739280243 20445620 imagette204456201739280243 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20445087 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20445641,20445639,20445627,20445640,20445629,20445636,20445631,20445632,20445633,20445634,20445635,20445642,20445638?tags=pet_clair,papier,film_plastique,carton,metal,pet_fonce,autre,refus,mal_croppe,flou,environnement,pehd,tetrapak&datou_id_consolidate=4235&port_consolidate=20445087&tree_id=77908 your option no_mail is active, we will not send the real mail to your client args[1336822911] : ((1336822911, -7.689726256573166, 492609224), (1336822911, -0.4912452086245457, 501862349), '0.20295017305943217') apple ((1336822911, -7.689726256573166, 492609224), (1336822911, -0.4912452086245457, 501862349), '0.20295017305943217') We are sending mail with results at cod@fotonower.com args[1336822775] : ((1336822775, -7.683526708164189, 492609224), (1336822775, -0.4957211732464989, 501862349), '0.20295017305943217') apple ((1336822775, -7.683526708164189, 492609224), (1336822775, -0.4957211732464989, 501862349), '0.20295017305943217') We are sending mail with results at cod@fotonower.com args[1336822766] : ((1336822766, -7.679888580890014, 492609224), (1336822766, -0.5023033024068789, 501862349), '0.20295017305943217') apple ((1336822766, -7.679888580890014, 492609224), (1336822766, -0.5023033024068789, 501862349), '0.20295017305943217') We are sending mail with results at cod@fotonower.com args[1336822763] : ((1336822763, -7.672825756100037, 492609224), (1336822763, -0.5142848076917318, 501862349), '0.20295017305943217') apple ((1336822763, -7.672825756100037, 492609224), (1336822763, -0.5142848076917318, 501862349), '0.20295017305943217') We are sending mail with results at cod@fotonower.com refus_total : 0.20295017305943217 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20445087 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20445087_11-02-2025_14_23_58.pdf results_Qualipapia_P20445087_11-02-2025_14_23_58.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20445087_11-02-2025_14_23_58.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20445087','results_Qualipapia_P20445087_11-02-2025_14_23_58.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20445087_11-02-2025_14_23_58.pdf','pdf','','0.17','0.20295017305943217') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1336822911, 1336822775, 1336822766, 1336822763] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822911', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822775', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822766', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822763', None, None, None, None, None, '2576341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012060403823852539 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.529893159866333 time spend to save output : 0.012231111526489258 total time spend for step 10 : 5.542124271392822 step11:split_time_score Tue Feb 11 14:24:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 11022025 20445087 Nombre de photos uploadées : 4 / 23040 (0%) 11022025 20445087 Nombre de photos taguées (types de déchets): 4 / 4 (100%) 11022025 20445087 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.00030112266540527344 elapsed_time : insert_dashboard_record_day_entry 0.022414684295654297 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.19655717368005024 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20440527_11-02-2025_11_19_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20440527 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20440527 AND mptpi.`type`=4230 To do Qualite : 0.2739191087147952 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20442838_11-02-2025_12_18_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20442838 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20442838 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20444319 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20444320 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20444321 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20444322 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20444323 order by id desc limit 1 Qualite : 0.18499769895532558 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20444324_11-02-2025_13_48_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20444324 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20444324 AND mptpi.`type`=4230 To do Qualite : 0.20952740655524157 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20444325_11-02-2025_13_49_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20444325 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20444325 AND mptpi.`type`=4230 To do Qualite : 0.20295017305943217 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20445087_11-02-2025_14_23_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20445087 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20445087 AND mptpi.`type`=4230 To do Qualite : 0.21338363403320454 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20445088_11-02-2025_14_18_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20445088 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20445088 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'11022025': {'nb_upload': 4, 'nb_taggue_class': 4, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1336822911, 1336822775, 1336822766, 1336822763] Looping around the photos to save general results len do output : 1 /20445087Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822911', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822775', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822766', None, None, None, None, None, '2576341') ('4234', None, None, None, None, None, None, None, '2576341') ('4234', '20445087', '1336822763', None, None, None, None, None, '2576341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012257814407348633 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.205188274383545 time spend to save output : 0.012438535690307617 total time spend for step 11 : 4.2176268100738525 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 54.23user 31.42system 3:43.11elapsed 38%CPU (0avgtext+0avgdata 2479988maxresident)k 953856inputs+19880outputs (2689major+3165281minor)pagefaults 0swaps