python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 253855 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2709794'] with mtr_portfolio_ids : ['21916090'] and first list_photo_ids : [] new path : /proc/253855/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.8300011157989502 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Apr 1 11:01:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10151 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-01 11:01:32.050735: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-01 11:01:32.075109: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-01 11:01:32.077336: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbaf8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-01 11:01:32.077386: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-01 11:01:32.081448: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-01 11:01:32.370880: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x36617530 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-01 11:01:32.370951: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-01 11:01:32.372085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-01 11:01:32.372370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 11:01:32.374555: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 11:01:32.376678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-01 11:01:32.377013: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-01 11:01:32.379744: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-01 11:01:32.381196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-01 11:01:32.386557: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 11:01:32.388354: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-01 11:01:32.388433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 11:01:32.389377: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-01 11:01:32.389394: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-01 11:01:32.389404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-01 11:01:32.391110: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9399 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-01 11:01:32.681211: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-01 11:01:32.681308: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 11:01:32.681332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 11:01:32.681353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-01 11:01:32.681374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-01 11:01:32.681394: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-01 11:01:32.681413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-01 11:01:32.681433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 11:01:32.682982: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-01 11:01:32.684250: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-01 11:01:32.684287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 11:01:32.684306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 11:01:32.684323: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-01 11:01:32.684352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-01 11:01:32.684370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-01 11:01:32.684386: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-01 11:01:32.684403: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 11:01:32.685941: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-01 11:01:32.685975: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-01 11:01:32.685986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-01 11:01:32.685995: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-01 11:01:32.687615: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9399 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-01 11:01:46.751513: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 11:01:46.947940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.91250 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 3 Detection mask done ! Trying to reset tf kernel 254352 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 864 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6153 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.004882335662841797 nb_pixel_total : 186777 time to create 1 rle with new method : 0.01062774658203125 length of segment : 606 time for calcul the mask position with numpy : 0.007185220718383789 nb_pixel_total : 222487 time to create 1 rle with new method : 0.017678022384643555 length of segment : 856 time for calcul the mask position with numpy : 0.0013267993927001953 nb_pixel_total : 72155 time to create 1 rle with old method : 0.08345222473144531 length of segment : 468 time for calcul the mask position with numpy : 0.0009012222290039062 nb_pixel_total : 45321 time to create 1 rle with old method : 0.05613994598388672 length of segment : 222 time for calcul the mask position with numpy : 0.00038170814514160156 nb_pixel_total : 14691 time to create 1 rle with old method : 0.01906299591064453 length of segment : 225 time for calcul the mask position with numpy : 0.0013918876647949219 nb_pixel_total : 76979 time to create 1 rle with old method : 0.10207462310791016 length of segment : 476 time for calcul the mask position with numpy : 0.0002689361572265625 nb_pixel_total : 13404 time to create 1 rle with old method : 0.015602588653564453 length of segment : 138 time for calcul the mask position with numpy : 0.0018007755279541016 nb_pixel_total : 72368 time to create 1 rle with old method : 0.10473346710205078 length of segment : 374 time for calcul the mask position with numpy : 0.0011487007141113281 nb_pixel_total : 39409 time to create 1 rle with old method : 0.05517840385437012 length of segment : 302 time for calcul the mask position with numpy : 0.0008575916290283203 nb_pixel_total : 20720 time to create 1 rle with old method : 0.02752852439880371 length of segment : 330 time for calcul the mask position with numpy : 0.0004982948303222656 nb_pixel_total : 19954 time to create 1 rle with old method : 0.02339315414428711 length of segment : 200 time for calcul the mask position with numpy : 0.0002689361572265625 nb_pixel_total : 8607 time to create 1 rle with old method : 0.010668277740478516 length of segment : 192 time for calcul the mask position with numpy : 0.0006244182586669922 nb_pixel_total : 37575 time to create 1 rle with old method : 0.04890179634094238 length of segment : 286 time for calcul the mask position with numpy : 0.0038993358612060547 nb_pixel_total : 148024 time to create 1 rle with old method : 0.2096555233001709 length of segment : 452 time for calcul the mask position with numpy : 0.01625204086303711 nb_pixel_total : 395524 time to create 1 rle with new method : 0.019986629486083984 length of segment : 586 time for calcul the mask position with numpy : 0.0014505386352539062 nb_pixel_total : 99082 time to create 1 rle with old method : 0.12603449821472168 length of segment : 373 time for calcul the mask position with numpy : 0.001071929931640625 nb_pixel_total : 43519 time to create 1 rle with old method : 0.05028557777404785 length of segment : 264 time for calcul the mask position with numpy : 0.004170656204223633 nb_pixel_total : 226973 time to create 1 rle with new method : 0.010138511657714844 length of segment : 963 time for calcul the mask position with numpy : 0.000698089599609375 nb_pixel_total : 10764 time to create 1 rle with old method : 0.012706756591796875 length of segment : 201 time for calcul the mask position with numpy : 0.0006589889526367188 nb_pixel_total : 2096 time to create 1 rle with old method : 0.0026314258575439453 length of segment : 118 time for calcul the mask position with numpy : 0.002010822296142578 nb_pixel_total : 59427 time to create 1 rle with old method : 0.07433390617370605 length of segment : 349 time for calcul the mask position with numpy : 0.0025453567504882812 nb_pixel_total : 109984 time to create 1 rle with old method : 0.12436032295227051 length of segment : 367 time for calcul the mask position with numpy : 0.0006949901580810547 nb_pixel_total : 23446 time to create 1 rle with old method : 0.027108430862426758 length of segment : 215 time for calcul the mask position with numpy : 0.0016264915466308594 nb_pixel_total : 19210 time to create 1 rle with old method : 0.022932767868041992 length of segment : 139 time for calcul the mask position with numpy : 0.001857757568359375 nb_pixel_total : 55899 time to create 1 rle with old method : 0.11053609848022461 length of segment : 307 time for calcul the mask position with numpy : 0.005980253219604492 nb_pixel_total : 173763 time to create 1 rle with new method : 0.011080265045166016 length of segment : 787 time for calcul the mask position with numpy : 0.005476951599121094 nb_pixel_total : 141814 time to create 1 rle with old method : 0.1955106258392334 length of segment : 449 time for calcul the mask position with numpy : 0.002393484115600586 nb_pixel_total : 92472 time to create 1 rle with old method : 0.11061763763427734 length of segment : 290 time for calcul the mask position with numpy : 0.004170656204223633 nb_pixel_total : 159231 time to create 1 rle with new method : 0.01119089126586914 length of segment : 518 time for calcul the mask position with numpy : 0.0022153854370117188 nb_pixel_total : 79638 time to create 1 rle with old method : 0.09128952026367188 length of segment : 295 time for calcul the mask position with numpy : 0.0006706714630126953 nb_pixel_total : 21957 time to create 1 rle with old method : 0.025345325469970703 length of segment : 136 time for calcul the mask position with numpy : 0.0004248619079589844 nb_pixel_total : 14770 time to create 1 rle with old method : 0.017232656478881836 length of segment : 202 time for calcul the mask position with numpy : 0.008928298950195312 nb_pixel_total : 333285 time to create 1 rle with new method : 0.02509021759033203 length of segment : 472 time for calcul the mask position with numpy : 0.0048983097076416016 nb_pixel_total : 316986 time to create 1 rle with new method : 0.016278505325317383 length of segment : 419 time for calcul the mask position with numpy : 0.0008559226989746094 nb_pixel_total : 32170 time to create 1 rle with old method : 0.03789377212524414 length of segment : 238 time for calcul the mask position with numpy : 0.00019359588623046875 nb_pixel_total : 8900 time to create 1 rle with old method : 0.01089620590209961 length of segment : 69 time for calcul the mask position with numpy : 0.0034112930297851562 nb_pixel_total : 157860 time to create 1 rle with new method : 0.0069806575775146484 length of segment : 415 time for calcul the mask position with numpy : 0.0065860748291015625 nb_pixel_total : 308804 time to create 1 rle with new method : 0.01586771011352539 length of segment : 535 time for calcul the mask position with numpy : 0.005763053894042969 nb_pixel_total : 153124 time to create 1 rle with new method : 0.012107610702514648 length of segment : 828 time for calcul the mask position with numpy : 0.05131816864013672 nb_pixel_total : 951501 time to create 1 rle with new method : 0.24103808403015137 length of segment : 1478 time for calcul the mask position with numpy : 0.002260446548461914 nb_pixel_total : 59352 time to create 1 rle with old method : 0.10793566703796387 length of segment : 297 time for calcul the mask position with numpy : 0.005112171173095703 nb_pixel_total : 63431 time to create 1 rle with old method : 0.0830838680267334 length of segment : 684 time for calcul the mask position with numpy : 0.0009372234344482422 nb_pixel_total : 21843 time to create 1 rle with old method : 0.02860736846923828 length of segment : 162 time for calcul the mask position with numpy : 0.0018086433410644531 nb_pixel_total : 68965 time to create 1 rle with old method : 0.08341431617736816 length of segment : 420 time for calcul the mask position with numpy : 0.0008387565612792969 nb_pixel_total : 33661 time to create 1 rle with old method : 0.04168820381164551 length of segment : 257 time for calcul the mask position with numpy : 0.0037050247192382812 nb_pixel_total : 112346 time to create 1 rle with old method : 0.1330113410949707 length of segment : 589 time for calcul the mask position with numpy : 0.0004024505615234375 nb_pixel_total : 21880 time to create 1 rle with old method : 0.02665877342224121 length of segment : 159 time for calcul the mask position with numpy : 0.0005698204040527344 nb_pixel_total : 15045 time to create 1 rle with old method : 0.018270492553710938 length of segment : 180 time for calcul the mask position with numpy : 0.0019822120666503906 nb_pixel_total : 60156 time to create 1 rle with old method : 0.07368779182434082 length of segment : 328 time for calcul the mask position with numpy : 0.0004401206970214844 nb_pixel_total : 14987 time to create 1 rle with old method : 0.01738762855529785 length of segment : 175 time for calcul the mask position with numpy : 0.0005838871002197266 nb_pixel_total : 18568 time to create 1 rle with old method : 0.025011777877807617 length of segment : 151 time for calcul the mask position with numpy : 0.0013532638549804688 nb_pixel_total : 50694 time to create 1 rle with old method : 0.07583951950073242 length of segment : 298 time for calcul the mask position with numpy : 0.005855560302734375 nb_pixel_total : 213761 time to create 1 rle with new method : 0.01282358169555664 length of segment : 341 time for calcul the mask position with numpy : 0.011980533599853516 nb_pixel_total : 429094 time to create 1 rle with new method : 0.45382213592529297 length of segment : 670 time for calcul the mask position with numpy : 0.0028214454650878906 nb_pixel_total : 98936 time to create 1 rle with old method : 0.1194918155670166 length of segment : 343 time for calcul the mask position with numpy : 0.004367351531982422 nb_pixel_total : 205802 time to create 1 rle with new method : 0.007066965103149414 length of segment : 504 time for calcul the mask position with numpy : 0.005480051040649414 nb_pixel_total : 256527 time to create 1 rle with new method : 0.009295463562011719 length of segment : 865 time for calcul the mask position with numpy : 0.004975557327270508 nb_pixel_total : 262050 time to create 1 rle with new method : 0.007905244827270508 length of segment : 427 time for calcul the mask position with numpy : 0.0010714530944824219 nb_pixel_total : 41689 time to create 1 rle with old method : 0.04778623580932617 length of segment : 312 time for calcul the mask position with numpy : 0.01093435287475586 nb_pixel_total : 465355 time to create 1 rle with new method : 0.025383710861206055 length of segment : 1003 time for calcul the mask position with numpy : 0.006150245666503906 nb_pixel_total : 299654 time to create 1 rle with new method : 0.014546394348144531 length of segment : 543 time for calcul the mask position with numpy : 0.0015099048614501953 nb_pixel_total : 57385 time to create 1 rle with old method : 0.08432126045227051 length of segment : 492 time for calcul the mask position with numpy : 0.0007457733154296875 nb_pixel_total : 34088 time to create 1 rle with old method : 0.0395658016204834 length of segment : 266 time for calcul the mask position with numpy : 0.0034160614013671875 nb_pixel_total : 253893 time to create 1 rle with new method : 0.008234500885009766 length of segment : 831 time for calcul the mask position with numpy : 0.012632131576538086 nb_pixel_total : 545972 time to create 1 rle with new method : 0.03578639030456543 length of segment : 851 time for calcul the mask position with numpy : 0.005961894989013672 nb_pixel_total : 164397 time to create 1 rle with new method : 0.014528512954711914 length of segment : 813 time for calcul the mask position with numpy : 0.0015761852264404297 nb_pixel_total : 50390 time to create 1 rle with old method : 0.05985116958618164 length of segment : 247 time for calcul the mask position with numpy : 0.003772735595703125 nb_pixel_total : 113033 time to create 1 rle with old method : 0.13100481033325195 length of segment : 478 time for calcul the mask position with numpy : 0.0027370452880859375 nb_pixel_total : 114841 time to create 1 rle with old method : 0.13999605178833008 length of segment : 395 time for calcul the mask position with numpy : 0.0010993480682373047 nb_pixel_total : 43035 time to create 1 rle with old method : 0.05326652526855469 length of segment : 156 time for calcul the mask position with numpy : 0.004179477691650391 nb_pixel_total : 180893 time to create 1 rle with new method : 0.008702993392944336 length of segment : 618 time for calcul the mask position with numpy : 0.0048520565032958984 nb_pixel_total : 186034 time to create 1 rle with new method : 0.00766754150390625 length of segment : 649 time for calcul the mask position with numpy : 0.0025370121002197266 nb_pixel_total : 91343 time to create 1 rle with old method : 0.10990118980407715 length of segment : 381 time for calcul the mask position with numpy : 0.0009195804595947266 nb_pixel_total : 40920 time to create 1 rle with old method : 0.047498226165771484 length of segment : 265 time for calcul the mask position with numpy : 0.026596546173095703 nb_pixel_total : 751909 time to create 1 rle with new method : 0.11251711845397949 length of segment : 2062 time for calcul the mask position with numpy : 0.0009050369262695312 nb_pixel_total : 34180 time to create 1 rle with old method : 0.042705535888671875 length of segment : 299 time for calcul the mask position with numpy : 0.0003044605255126953 nb_pixel_total : 12376 time to create 1 rle with old method : 0.015111684799194336 length of segment : 192 time for calcul the mask position with numpy : 0.0017523765563964844 nb_pixel_total : 61794 time to create 1 rle with old method : 0.07135415077209473 length of segment : 272 time for calcul the mask position with numpy : 0.0009949207305908203 nb_pixel_total : 20731 time to create 1 rle with old method : 0.02741718292236328 length of segment : 212 time for calcul the mask position with numpy : 0.002666950225830078 nb_pixel_total : 87138 time to create 1 rle with old method : 0.11341977119445801 length of segment : 222 time for calcul the mask position with numpy : 0.0015513896942138672 nb_pixel_total : 45794 time to create 1 rle with old method : 0.07173967361450195 length of segment : 338 time for calcul the mask position with numpy : 0.0013308525085449219 nb_pixel_total : 38251 time to create 1 rle with old method : 0.04495358467102051 length of segment : 319 time for calcul the mask position with numpy : 0.0014469623565673828 nb_pixel_total : 90252 time to create 1 rle with old method : 0.1082308292388916 length of segment : 366 time for calcul the mask position with numpy : 0.4258558750152588 nb_pixel_total : 3359703 time to create 1 rle with new method : 1.5255837440490723 length of segment : 3378 time for calcul the mask position with numpy : 0.3486018180847168 nb_pixel_total : 4364949 time to create 1 rle with new method : 0.8506040573120117 length of segment : 1823 time for calcul the mask position with numpy : 0.0004563331604003906 nb_pixel_total : 24206 time to create 1 rle with old method : 0.027582168579101562 length of segment : 230 time spent for convertir_results : 18.1542387008667 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 484 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 70.98395800590515 time spend to save output : 0.12796473503112793 total time spend for step 1 : 71.11192274093628 step2:mask_detect Tue Apr 1 11:02:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6374 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-01 11:02:43.899469: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-01 11:02:43.927190: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-01 11:02:43.928993: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbaf4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-01 11:02:43.929022: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-01 11:02:43.932993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-01 11:02:44.065407: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3727e810 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-01 11:02:44.065482: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-01 11:02:44.066862: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-01 11:02:44.068228: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 11:02:44.073780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 11:02:44.077138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-01 11:02:44.078724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-01 11:02:44.083103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-01 11:02:44.084602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-01 11:02:44.091813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 11:02:44.093227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-01 11:02:44.093333: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 11:02:44.093966: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-01 11:02:44.093982: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-01 11:02:44.093990: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-01 11:02:44.095092: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5849 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-01 11:02:44.250024: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-01 11:02:44.250111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 11:02:44.250134: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 11:02:44.250152: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-01 11:02:44.250180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-01 11:02:44.250197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-01 11:02:44.250213: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-01 11:02:44.250230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 11:02:44.251317: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-01 11:02:44.252302: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-01 11:02:44.252337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 11:02:44.252354: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 11:02:44.252371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-01 11:02:44.252386: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-01 11:02:44.252402: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-01 11:02:44.252421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-01 11:02:44.252436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 11:02:44.253523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-01 11:02:44.253554: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-01 11:02:44.253562: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-01 11:02:44.253570: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-01 11:02:44.254724: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5849 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-01 11:02:57.496539: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 11:02:57.658296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.91250 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 74 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 67 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 56 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 65 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 260244 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5083 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7033 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 2.168440103530884 nb_pixel_total : 345514 time to create 1 rle with new method : 0.21765780448913574 length of segment : 1013 time for calcul the mask position with numpy : 0.19884443283081055 nb_pixel_total : 311932 time to create 1 rle with new method : 0.01400446891784668 length of segment : 690 time for calcul the mask position with numpy : 1.403256893157959 nb_pixel_total : 337389 time to create 1 rle with new method : 0.02690291404724121 length of segment : 894 time for calcul the mask position with numpy : 0.0419764518737793 nb_pixel_total : 43289 time to create 1 rle with old method : 0.05452585220336914 length of segment : 224 time for calcul the mask position with numpy : 0.3792753219604492 nb_pixel_total : 437510 time to create 1 rle with new method : 0.02677297592163086 length of segment : 764 time for calcul the mask position with numpy : 0.12311673164367676 nb_pixel_total : 37851 time to create 1 rle with old method : 0.04645204544067383 length of segment : 302 time for calcul the mask position with numpy : 0.0054585933685302734 nb_pixel_total : 80272 time to create 1 rle with old method : 0.12798094749450684 length of segment : 481 time for calcul the mask position with numpy : 0.12246084213256836 nb_pixel_total : 227516 time to create 1 rle with new method : 0.013689994812011719 length of segment : 641 time for calcul the mask position with numpy : 0.38634300231933594 nb_pixel_total : 272001 time to create 1 rle with new method : 0.018585920333862305 length of segment : 876 time for calcul the mask position with numpy : 0.02552032470703125 nb_pixel_total : 67178 time to create 1 rle with old method : 0.07978034019470215 length of segment : 278 time for calcul the mask position with numpy : 0.0023708343505859375 nb_pixel_total : 32423 time to create 1 rle with old method : 0.048914432525634766 length of segment : 232 time for calcul the mask position with numpy : 0.11297893524169922 nb_pixel_total : 199691 time to create 1 rle with new method : 0.013698577880859375 length of segment : 545 time for calcul the mask position with numpy : 0.7201547622680664 nb_pixel_total : 394436 time to create 1 rle with new method : 0.02791619300842285 length of segment : 1185 time for calcul the mask position with numpy : 0.03327012062072754 nb_pixel_total : 77564 time to create 1 rle with old method : 0.10246896743774414 length of segment : 390 time for calcul the mask position with numpy : 0.0029973983764648438 nb_pixel_total : 56790 time to create 1 rle with old method : 0.0877084732055664 length of segment : 303 time for calcul the mask position with numpy : 0.0004208087921142578 nb_pixel_total : 14220 time to create 1 rle with old method : 0.01792001724243164 length of segment : 172 time for calcul the mask position with numpy : 0.0009741783142089844 nb_pixel_total : 24394 time to create 1 rle with old method : 0.030406475067138672 length of segment : 236 time for calcul the mask position with numpy : 0.053932905197143555 nb_pixel_total : 283254 time to create 1 rle with new method : 0.030323028564453125 length of segment : 956 time for calcul the mask position with numpy : 0.0022499561309814453 nb_pixel_total : 89039 time to create 1 rle with old method : 0.10101008415222168 length of segment : 407 time for calcul the mask position with numpy : 0.002399921417236328 nb_pixel_total : 47367 time to create 1 rle with old method : 0.053319454193115234 length of segment : 304 time for calcul the mask position with numpy : 0.004125118255615234 nb_pixel_total : 22848 time to create 1 rle with old method : 0.02910900115966797 length of segment : 271 time for calcul the mask position with numpy : 0.008209943771362305 nb_pixel_total : 134570 time to create 1 rle with old method : 0.15340852737426758 length of segment : 610 time for calcul the mask position with numpy : 0.004636287689208984 nb_pixel_total : 22612 time to create 1 rle with old method : 0.026081562042236328 length of segment : 205 time for calcul the mask position with numpy : 0.01933574676513672 nb_pixel_total : 160425 time to create 1 rle with new method : 0.015915393829345703 length of segment : 571 time for calcul the mask position with numpy : 0.0008294582366943359 nb_pixel_total : 32525 time to create 1 rle with old method : 0.03863930702209473 length of segment : 289 time for calcul the mask position with numpy : 0.0008573532104492188 nb_pixel_total : 37042 time to create 1 rle with old method : 0.04259777069091797 length of segment : 287 time for calcul the mask position with numpy : 0.004830598831176758 nb_pixel_total : 125989 time to create 1 rle with old method : 0.14590215682983398 length of segment : 539 time for calcul the mask position with numpy : 0.0030901432037353516 nb_pixel_total : 59052 time to create 1 rle with old method : 0.06870722770690918 length of segment : 654 time for calcul the mask position with numpy : 0.02495288848876953 nb_pixel_total : 236803 time to create 1 rle with new method : 0.015570402145385742 length of segment : 860 time for calcul the mask position with numpy : 0.020244598388671875 nb_pixel_total : 86882 time to create 1 rle with old method : 0.11579513549804688 length of segment : 371 time for calcul the mask position with numpy : 0.014562845230102539 nb_pixel_total : 118317 time to create 1 rle with old method : 0.13805508613586426 length of segment : 358 time for calcul the mask position with numpy : 0.020691394805908203 nb_pixel_total : 416082 time to create 1 rle with new method : 0.025424957275390625 length of segment : 1046 time for calcul the mask position with numpy : 0.07898402214050293 nb_pixel_total : 591011 time to create 1 rle with new method : 0.03336381912231445 length of segment : 770 time for calcul the mask position with numpy : 0.00093841552734375 nb_pixel_total : 43201 time to create 1 rle with old method : 0.04949688911437988 length of segment : 237 time for calcul the mask position with numpy : 0.0026748180389404297 nb_pixel_total : 138435 time to create 1 rle with old method : 0.16238760948181152 length of segment : 360 time for calcul the mask position with numpy : 0.02006053924560547 nb_pixel_total : 25470 time to create 1 rle with old method : 0.03352165222167969 length of segment : 548 time for calcul the mask position with numpy : 0.0007126331329345703 nb_pixel_total : 32963 time to create 1 rle with old method : 0.0378570556640625 length of segment : 364 time for calcul the mask position with numpy : 0.010404348373413086 nb_pixel_total : 121203 time to create 1 rle with old method : 0.13884782791137695 length of segment : 636 time for calcul the mask position with numpy : 0.011651992797851562 nb_pixel_total : 106689 time to create 1 rle with old method : 0.12429976463317871 length of segment : 514 time for calcul the mask position with numpy : 0.027190446853637695 nb_pixel_total : 187182 time to create 1 rle with new method : 0.01268911361694336 length of segment : 535 time for calcul the mask position with numpy : 0.01289820671081543 nb_pixel_total : 282064 time to create 1 rle with new method : 0.01902174949645996 length of segment : 900 time for calcul the mask position with numpy : 0.0011067390441894531 nb_pixel_total : 44322 time to create 1 rle with old method : 0.05009007453918457 length of segment : 258 time for calcul the mask position with numpy : 0.02060532569885254 nb_pixel_total : 144679 time to create 1 rle with old method : 0.18294572830200195 length of segment : 461 time for calcul the mask position with numpy : 0.038063764572143555 nb_pixel_total : 301571 time to create 1 rle with new method : 0.018685102462768555 length of segment : 891 time for calcul the mask position with numpy : 0.0029227733612060547 nb_pixel_total : 141788 time to create 1 rle with old method : 0.15917515754699707 length of segment : 375 time for calcul the mask position with numpy : 0.0026144981384277344 nb_pixel_total : 138287 time to create 1 rle with old method : 0.15575790405273438 length of segment : 446 time for calcul the mask position with numpy : 0.0008707046508789062 nb_pixel_total : 14086 time to create 1 rle with old method : 0.01639842987060547 length of segment : 194 time for calcul the mask position with numpy : 0.0035686492919921875 nb_pixel_total : 166099 time to create 1 rle with new method : 0.00875091552734375 length of segment : 467 time for calcul the mask position with numpy : 0.0012497901916503906 nb_pixel_total : 54200 time to create 1 rle with old method : 0.0606234073638916 length of segment : 371 time for calcul the mask position with numpy : 0.0011420249938964844 nb_pixel_total : 35978 time to create 1 rle with old method : 0.04258012771606445 length of segment : 402 time for calcul the mask position with numpy : 0.0005257129669189453 nb_pixel_total : 8775 time to create 1 rle with old method : 0.010472774505615234 length of segment : 185 time for calcul the mask position with numpy : 0.00418543815612793 nb_pixel_total : 131986 time to create 1 rle with old method : 0.14847970008850098 length of segment : 542 time for calcul the mask position with numpy : 0.001020669937133789 nb_pixel_total : 45105 time to create 1 rle with old method : 0.05096006393432617 length of segment : 257 time for calcul the mask position with numpy : 0.03820037841796875 nb_pixel_total : 1126438 time to create 1 rle with new method : 0.09065127372741699 length of segment : 1380 time for calcul the mask position with numpy : 0.004998445510864258 nb_pixel_total : 164540 time to create 1 rle with new method : 0.011209249496459961 length of segment : 588 time for calcul the mask position with numpy : 0.0036382675170898438 nb_pixel_total : 91250 time to create 1 rle with old method : 0.10709834098815918 length of segment : 337 time for calcul the mask position with numpy : 0.0021147727966308594 nb_pixel_total : 77627 time to create 1 rle with old method : 0.0874776840209961 length of segment : 626 time for calcul the mask position with numpy : 0.003216266632080078 nb_pixel_total : 134437 time to create 1 rle with old method : 0.15378689765930176 length of segment : 451 time for calcul the mask position with numpy : 0.003798961639404297 nb_pixel_total : 96221 time to create 1 rle with old method : 0.10898041725158691 length of segment : 504 time for calcul the mask position with numpy : 0.017136335372924805 nb_pixel_total : 606201 time to create 1 rle with new method : 0.04277539253234863 length of segment : 948 time for calcul the mask position with numpy : 0.002007722854614258 nb_pixel_total : 19776 time to create 1 rle with old method : 0.022126436233520508 length of segment : 309 time for calcul the mask position with numpy : 0.0012896060943603516 nb_pixel_total : 68008 time to create 1 rle with old method : 0.07603597640991211 length of segment : 347 time for calcul the mask position with numpy : 0.0030562877655029297 nb_pixel_total : 108787 time to create 1 rle with old method : 0.1223452091217041 length of segment : 533 time for calcul the mask position with numpy : 0.001779794692993164 nb_pixel_total : 42004 time to create 1 rle with old method : 0.04810500144958496 length of segment : 278 time for calcul the mask position with numpy : 0.00772547721862793 nb_pixel_total : 271541 time to create 1 rle with new method : 0.02134537696838379 length of segment : 887 time for calcul the mask position with numpy : 0.010424375534057617 nb_pixel_total : 548905 time to create 1 rle with new method : 0.02545452117919922 length of segment : 745 time for calcul the mask position with numpy : 0.018886804580688477 nb_pixel_total : 682393 time to create 1 rle with new method : 0.08485102653503418 length of segment : 1065 time for calcul the mask position with numpy : 0.023642301559448242 nb_pixel_total : 1141659 time to create 1 rle with new method : 0.12355422973632812 length of segment : 1367 time for calcul the mask position with numpy : 0.08408784866333008 nb_pixel_total : 294098 time to create 1 rle with new method : 0.011879682540893555 length of segment : 1055 time for calcul the mask position with numpy : 0.19623327255249023 nb_pixel_total : 217360 time to create 1 rle with new method : 0.014074563980102539 length of segment : 646 time for calcul the mask position with numpy : 0.018793344497680664 nb_pixel_total : 152380 time to create 1 rle with new method : 0.006650447845458984 length of segment : 412 time for calcul the mask position with numpy : 0.03701472282409668 nb_pixel_total : 255351 time to create 1 rle with new method : 0.01260685920715332 length of segment : 537 time for calcul the mask position with numpy : 0.13880395889282227 nb_pixel_total : 912269 time to create 1 rle with new method : 0.09486031532287598 length of segment : 767 time for calcul the mask position with numpy : 0.04363417625427246 nb_pixel_total : 562387 time to create 1 rle with new method : 0.05149221420288086 length of segment : 851 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 20356 time to create 1 rle with old method : 0.02327871322631836 length of segment : 127 time for calcul the mask position with numpy : 0.005593299865722656 nb_pixel_total : 115434 time to create 1 rle with old method : 0.1330721378326416 length of segment : 338 time for calcul the mask position with numpy : 0.025383710861206055 nb_pixel_total : 613856 time to create 1 rle with new method : 0.029917240142822266 length of segment : 1263 time for calcul the mask position with numpy : 0.00077056884765625 nb_pixel_total : 37378 time to create 1 rle with old method : 0.041968345642089844 length of segment : 208 time for calcul the mask position with numpy : 0.0005807876586914062 nb_pixel_total : 26040 time to create 1 rle with old method : 0.02960348129272461 length of segment : 263 time for calcul the mask position with numpy : 0.0371251106262207 nb_pixel_total : 402359 time to create 1 rle with new method : 0.016335725784301758 length of segment : 539 time for calcul the mask position with numpy : 0.0034842491149902344 nb_pixel_total : 119392 time to create 1 rle with old method : 0.1335313320159912 length of segment : 304 time for calcul the mask position with numpy : 0.0014653205871582031 nb_pixel_total : 69482 time to create 1 rle with old method : 0.0783379077911377 length of segment : 318 time for calcul the mask position with numpy : 0.0018084049224853516 nb_pixel_total : 37005 time to create 1 rle with old method : 0.04270362854003906 length of segment : 190 time for calcul the mask position with numpy : 0.0016245841979980469 nb_pixel_total : 56787 time to create 1 rle with old method : 0.06547236442565918 length of segment : 249 time for calcul the mask position with numpy : 0.004590749740600586 nb_pixel_total : 92121 time to create 1 rle with old method : 0.1225886344909668 length of segment : 375 time for calcul the mask position with numpy : 0.013390541076660156 nb_pixel_total : 60048 time to create 1 rle with old method : 0.07385373115539551 length of segment : 289 time for calcul the mask position with numpy : 0.6304459571838379 nb_pixel_total : 2327030 time to create 1 rle with new method : 0.2687504291534424 length of segment : 2079 time for calcul the mask position with numpy : 0.0035409927368164062 nb_pixel_total : 97047 time to create 1 rle with old method : 0.10857319831848145 length of segment : 530 time for calcul the mask position with numpy : 0.006296396255493164 nb_pixel_total : 158266 time to create 1 rle with new method : 0.011951923370361328 length of segment : 671 time for calcul the mask position with numpy : 0.0012767314910888672 nb_pixel_total : 49276 time to create 1 rle with old method : 0.05663442611694336 length of segment : 272 time for calcul the mask position with numpy : 0.0015559196472167969 nb_pixel_total : 46193 time to create 1 rle with old method : 0.05328011512756348 length of segment : 243 time for calcul the mask position with numpy : 0.0005078315734863281 nb_pixel_total : 9785 time to create 1 rle with old method : 0.011877059936523438 length of segment : 213 time for calcul the mask position with numpy : 0.02031254768371582 nb_pixel_total : 651351 time to create 1 rle with new method : 0.08287835121154785 length of segment : 1012 time for calcul the mask position with numpy : 0.0018498897552490234 nb_pixel_total : 34007 time to create 1 rle with old method : 0.038709402084350586 length of segment : 265 time for calcul the mask position with numpy : 0.0061070919036865234 nb_pixel_total : 72164 time to create 1 rle with old method : 0.08527469635009766 length of segment : 563 time for calcul the mask position with numpy : 0.002991914749145508 nb_pixel_total : 115012 time to create 1 rle with old method : 0.13022899627685547 length of segment : 576 time for calcul the mask position with numpy : 0.0008306503295898438 nb_pixel_total : 45556 time to create 1 rle with old method : 0.05106544494628906 length of segment : 262 time for calcul the mask position with numpy : 0.0010547637939453125 nb_pixel_total : 65967 time to create 1 rle with old method : 0.07464289665222168 length of segment : 278 time for calcul the mask position with numpy : 0.004533052444458008 nb_pixel_total : 217741 time to create 1 rle with new method : 0.014774322509765625 length of segment : 906 time for calcul the mask position with numpy : 0.1210472583770752 nb_pixel_total : 618903 time to create 1 rle with new method : 0.06595849990844727 length of segment : 1166 time for calcul the mask position with numpy : 0.0007069110870361328 nb_pixel_total : 41811 time to create 1 rle with old method : 0.04800724983215332 length of segment : 235 time for calcul the mask position with numpy : 0.0037369728088378906 nb_pixel_total : 128860 time to create 1 rle with old method : 0.14725685119628906 length of segment : 257 time for calcul the mask position with numpy : 0.005090475082397461 nb_pixel_total : 65960 time to create 1 rle with old method : 0.07546496391296387 length of segment : 460 time for calcul the mask position with numpy : 0.002064228057861328 nb_pixel_total : 56543 time to create 1 rle with old method : 0.06489706039428711 length of segment : 274 time for calcul the mask position with numpy : 0.13047313690185547 nb_pixel_total : 634012 time to create 1 rle with new method : 0.07623767852783203 length of segment : 985 time for calcul the mask position with numpy : 0.015732288360595703 nb_pixel_total : 203117 time to create 1 rle with new method : 0.01193094253540039 length of segment : 529 time for calcul the mask position with numpy : 0.002166748046875 nb_pixel_total : 102692 time to create 1 rle with old method : 0.11274290084838867 length of segment : 528 time for calcul the mask position with numpy : 0.004056692123413086 nb_pixel_total : 199235 time to create 1 rle with new method : 0.011932849884033203 length of segment : 550 time for calcul the mask position with numpy : 0.012510061264038086 nb_pixel_total : 642446 time to create 1 rle with new method : 0.07912826538085938 length of segment : 1063 time for calcul the mask position with numpy : 0.026561737060546875 nb_pixel_total : 158687 time to create 1 rle with new method : 0.009302139282226562 length of segment : 640 time for calcul the mask position with numpy : 0.0012030601501464844 nb_pixel_total : 42562 time to create 1 rle with old method : 0.048681020736694336 length of segment : 309 time for calcul the mask position with numpy : 0.008344650268554688 nb_pixel_total : 79544 time to create 1 rle with old method : 0.09288215637207031 length of segment : 510 time for calcul the mask position with numpy : 0.0017566680908203125 nb_pixel_total : 98025 time to create 1 rle with old method : 0.11028790473937988 length of segment : 372 time for calcul the mask position with numpy : 0.0024743080139160156 nb_pixel_total : 159458 time to create 1 rle with new method : 0.006486177444458008 length of segment : 631 time for calcul the mask position with numpy : 0.0012078285217285156 nb_pixel_total : 50312 time to create 1 rle with old method : 0.05658221244812012 length of segment : 342 time for calcul the mask position with numpy : 0.011026382446289062 nb_pixel_total : 474291 time to create 1 rle with new method : 0.06093955039978027 length of segment : 1205 time for calcul the mask position with numpy : 0.0021975040435791016 nb_pixel_total : 79179 time to create 1 rle with old method : 0.09130644798278809 length of segment : 326 time for calcul the mask position with numpy : 0.0007710456848144531 nb_pixel_total : 36499 time to create 1 rle with old method : 0.04198122024536133 length of segment : 212 time for calcul the mask position with numpy : 0.0017898082733154297 nb_pixel_total : 81407 time to create 1 rle with old method : 0.09278130531311035 length of segment : 341 time for calcul the mask position with numpy : 0.0025730133056640625 nb_pixel_total : 94381 time to create 1 rle with old method : 0.10936951637268066 length of segment : 377 time for calcul the mask position with numpy : 0.0013804435729980469 nb_pixel_total : 62105 time to create 1 rle with old method : 0.07080745697021484 length of segment : 370 time for calcul the mask position with numpy : 0.0025823116302490234 nb_pixel_total : 136218 time to create 1 rle with old method : 0.1535656452178955 length of segment : 268 time for calcul the mask position with numpy : 0.001674652099609375 nb_pixel_total : 83244 time to create 1 rle with old method : 0.0978085994720459 length of segment : 277 time for calcul the mask position with numpy : 0.0044443607330322266 nb_pixel_total : 192552 time to create 1 rle with new method : 0.012032508850097656 length of segment : 871 time for calcul the mask position with numpy : 0.0041544437408447266 nb_pixel_total : 182819 time to create 1 rle with new method : 0.010805368423461914 length of segment : 558 time for calcul the mask position with numpy : 0.004578113555908203 nb_pixel_total : 173741 time to create 1 rle with new method : 0.0144805908203125 length of segment : 546 time for calcul the mask position with numpy : 0.0011718273162841797 nb_pixel_total : 45866 time to create 1 rle with old method : 0.05225181579589844 length of segment : 352 time for calcul the mask position with numpy : 0.013873100280761719 nb_pixel_total : 609724 time to create 1 rle with new method : 0.028830528259277344 length of segment : 995 time for calcul the mask position with numpy : 0.0036191940307617188 nb_pixel_total : 166869 time to create 1 rle with new method : 0.011691808700561523 length of segment : 496 time for calcul the mask position with numpy : 0.005472898483276367 nb_pixel_total : 199008 time to create 1 rle with new method : 0.016736268997192383 length of segment : 510 time for calcul the mask position with numpy : 0.0017850399017333984 nb_pixel_total : 85199 time to create 1 rle with old method : 0.09895443916320801 length of segment : 233 time for calcul the mask position with numpy : 0.0017833709716796875 nb_pixel_total : 89240 time to create 1 rle with old method : 0.10233926773071289 length of segment : 255 time for calcul the mask position with numpy : 0.0011456012725830078 nb_pixel_total : 40168 time to create 1 rle with old method : 0.05299878120422363 length of segment : 227 time for calcul the mask position with numpy : 0.006598711013793945 nb_pixel_total : 260791 time to create 1 rle with new method : 0.021473407745361328 length of segment : 661 time for calcul the mask position with numpy : 0.0013859272003173828 nb_pixel_total : 58367 time to create 1 rle with old method : 0.06586480140686035 length of segment : 378 time for calcul the mask position with numpy : 0.0012423992156982422 nb_pixel_total : 51663 time to create 1 rle with old method : 0.05959463119506836 length of segment : 200 time for calcul the mask position with numpy : 0.0019097328186035156 nb_pixel_total : 71813 time to create 1 rle with old method : 0.09997987747192383 length of segment : 440 time for calcul the mask position with numpy : 0.000997304916381836 nb_pixel_total : 41834 time to create 1 rle with old method : 0.04777026176452637 length of segment : 203 time for calcul the mask position with numpy : 0.001931905746459961 nb_pixel_total : 84972 time to create 1 rle with old method : 0.0965268611907959 length of segment : 296 time for calcul the mask position with numpy : 0.003676176071166992 nb_pixel_total : 186803 time to create 1 rle with new method : 0.009723424911499023 length of segment : 870 time for calcul the mask position with numpy : 0.0027472972869873047 nb_pixel_total : 138539 time to create 1 rle with old method : 0.1558551788330078 length of segment : 457 time for calcul the mask position with numpy : 0.003926992416381836 nb_pixel_total : 172129 time to create 1 rle with new method : 0.010730981826782227 length of segment : 532 time for calcul the mask position with numpy : 0.0016350746154785156 nb_pixel_total : 88260 time to create 1 rle with old method : 0.0980837345123291 length of segment : 318 time for calcul the mask position with numpy : 0.002330780029296875 nb_pixel_total : 115238 time to create 1 rle with old method : 0.1295320987701416 length of segment : 418 time for calcul the mask position with numpy : 0.001253366470336914 nb_pixel_total : 62277 time to create 1 rle with old method : 0.07010459899902344 length of segment : 419 time for calcul the mask position with numpy : 0.0006761550903320312 nb_pixel_total : 19640 time to create 1 rle with old method : 0.023348093032836914 length of segment : 227 time for calcul the mask position with numpy : 0.017781496047973633 nb_pixel_total : 658439 time to create 1 rle with new method : 0.23586821556091309 length of segment : 902 time for calcul the mask position with numpy : 0.0006570816040039062 nb_pixel_total : 25273 time to create 1 rle with old method : 0.030246973037719727 length of segment : 273 time for calcul the mask position with numpy : 0.0026934146881103516 nb_pixel_total : 85788 time to create 1 rle with old method : 0.11429238319396973 length of segment : 527 time for calcul the mask position with numpy : 0.0007774829864501953 nb_pixel_total : 17640 time to create 1 rle with old method : 0.020901203155517578 length of segment : 133 time for calcul the mask position with numpy : 0.0023386478424072266 nb_pixel_total : 125584 time to create 1 rle with old method : 0.13959026336669922 length of segment : 750 time for calcul the mask position with numpy : 0.005630016326904297 nb_pixel_total : 222620 time to create 1 rle with new method : 0.021944522857666016 length of segment : 800 time for calcul the mask position with numpy : 0.001699686050415039 nb_pixel_total : 90472 time to create 1 rle with old method : 0.12551450729370117 length of segment : 327 time for calcul the mask position with numpy : 0.007729768753051758 nb_pixel_total : 374775 time to create 1 rle with new method : 0.030793428421020508 length of segment : 623 time for calcul the mask position with numpy : 0.0022749900817871094 nb_pixel_total : 99419 time to create 1 rle with old method : 0.11263084411621094 length of segment : 302 time for calcul the mask position with numpy : 0.0004911422729492188 nb_pixel_total : 17637 time to create 1 rle with old method : 0.02058887481689453 length of segment : 253 time for calcul the mask position with numpy : 0.0007281303405761719 nb_pixel_total : 30892 time to create 1 rle with old method : 0.03561878204345703 length of segment : 258 time for calcul the mask position with numpy : 0.0006237030029296875 nb_pixel_total : 22864 time to create 1 rle with old method : 0.02648305892944336 length of segment : 209 time for calcul the mask position with numpy : 0.0014455318450927734 nb_pixel_total : 72508 time to create 1 rle with old method : 0.08276486396789551 length of segment : 229 time for calcul the mask position with numpy : 0.030595779418945312 nb_pixel_total : 1393904 time to create 1 rle with new method : 0.15892529487609863 length of segment : 756 time for calcul the mask position with numpy : 0.0014247894287109375 nb_pixel_total : 52528 time to create 1 rle with old method : 0.06046414375305176 length of segment : 268 time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 17071 time to create 1 rle with old method : 0.02005600929260254 length of segment : 111 time for calcul the mask position with numpy : 0.0010673999786376953 nb_pixel_total : 31911 time to create 1 rle with old method : 0.03759598731994629 length of segment : 209 time for calcul the mask position with numpy : 0.009121417999267578 nb_pixel_total : 471632 time to create 1 rle with new method : 0.024910926818847656 length of segment : 782 time for calcul the mask position with numpy : 0.0010967254638671875 nb_pixel_total : 47362 time to create 1 rle with old method : 0.056143999099731445 length of segment : 380 time for calcul the mask position with numpy : 0.0015666484832763672 nb_pixel_total : 62941 time to create 1 rle with old method : 0.07243657112121582 length of segment : 258 time for calcul the mask position with numpy : 0.0019164085388183594 nb_pixel_total : 81452 time to create 1 rle with old method : 0.09746479988098145 length of segment : 279 time for calcul the mask position with numpy : 0.0014233589172363281 nb_pixel_total : 68896 time to create 1 rle with old method : 0.08382868766784668 length of segment : 335 time for calcul the mask position with numpy : 0.025356054306030273 nb_pixel_total : 1376285 time to create 1 rle with new method : 0.14516615867614746 length of segment : 755 time for calcul the mask position with numpy : 0.0006856918334960938 nb_pixel_total : 30120 time to create 1 rle with old method : 0.033777713775634766 length of segment : 262 time for calcul the mask position with numpy : 0.0026204586029052734 nb_pixel_total : 150878 time to create 1 rle with new method : 0.007185459136962891 length of segment : 611 time for calcul the mask position with numpy : 0.0027561187744140625 nb_pixel_total : 88003 time to create 1 rle with old method : 0.10024714469909668 length of segment : 585 time for calcul the mask position with numpy : 0.001865386962890625 nb_pixel_total : 62273 time to create 1 rle with old method : 0.07332873344421387 length of segment : 382 time for calcul the mask position with numpy : 0.003883838653564453 nb_pixel_total : 184878 time to create 1 rle with new method : 0.011966466903686523 length of segment : 490 time for calcul the mask position with numpy : 0.0018038749694824219 nb_pixel_total : 80815 time to create 1 rle with old method : 0.11470699310302734 length of segment : 308 time for calcul the mask position with numpy : 0.0008478164672851562 nb_pixel_total : 39834 time to create 1 rle with old method : 0.0464472770690918 length of segment : 175 time for calcul the mask position with numpy : 0.000986337661743164 nb_pixel_total : 39946 time to create 1 rle with old method : 0.04543256759643555 length of segment : 254 time for calcul the mask position with numpy : 0.004945278167724609 nb_pixel_total : 208448 time to create 1 rle with new method : 0.013173341751098633 length of segment : 359 time for calcul the mask position with numpy : 0.0022966861724853516 nb_pixel_total : 113709 time to create 1 rle with old method : 0.12752008438110352 length of segment : 490 time for calcul the mask position with numpy : 0.0014286041259765625 nb_pixel_total : 62999 time to create 1 rle with old method : 0.07197427749633789 length of segment : 294 time for calcul the mask position with numpy : 0.0011029243469238281 nb_pixel_total : 36046 time to create 1 rle with old method : 0.04169774055480957 length of segment : 231 time for calcul the mask position with numpy : 0.0012557506561279297 nb_pixel_total : 65631 time to create 1 rle with old method : 0.0744333267211914 length of segment : 311 time for calcul the mask position with numpy : 0.0038132667541503906 nb_pixel_total : 193785 time to create 1 rle with new method : 0.011385202407836914 length of segment : 654 time for calcul the mask position with numpy : 0.0028295516967773438 nb_pixel_total : 129562 time to create 1 rle with old method : 0.15035152435302734 length of segment : 599 time for calcul the mask position with numpy : 0.005746364593505859 nb_pixel_total : 153747 time to create 1 rle with new method : 0.019828081130981445 length of segment : 843 time for calcul the mask position with numpy : 0.0011827945709228516 nb_pixel_total : 39624 time to create 1 rle with old method : 0.05009198188781738 length of segment : 196 time for calcul the mask position with numpy : 0.002783060073852539 nb_pixel_total : 108719 time to create 1 rle with old method : 0.12265396118164062 length of segment : 395 time for calcul the mask position with numpy : 0.0011491775512695312 nb_pixel_total : 53632 time to create 1 rle with old method : 0.06046128273010254 length of segment : 265 time for calcul the mask position with numpy : 0.004051923751831055 nb_pixel_total : 159160 time to create 1 rle with new method : 0.012495279312133789 length of segment : 408 time for calcul the mask position with numpy : 0.0008630752563476562 nb_pixel_total : 38317 time to create 1 rle with old method : 0.04284954071044922 length of segment : 201 time for calcul the mask position with numpy : 0.0018453598022460938 nb_pixel_total : 79415 time to create 1 rle with old method : 0.09039497375488281 length of segment : 309 time for calcul the mask position with numpy : 0.0016295909881591797 nb_pixel_total : 83118 time to create 1 rle with old method : 0.11753177642822266 length of segment : 337 time for calcul the mask position with numpy : 0.0026121139526367188 nb_pixel_total : 120329 time to create 1 rle with old method : 0.1328575611114502 length of segment : 509 time for calcul the mask position with numpy : 0.2324812412261963 nb_pixel_total : 1913560 time to create 1 rle with new method : 0.2688572406768799 length of segment : 2599 time for calcul the mask position with numpy : 0.0030698776245117188 nb_pixel_total : 128705 time to create 1 rle with old method : 0.14516949653625488 length of segment : 409 time for calcul the mask position with numpy : 0.002506256103515625 nb_pixel_total : 131782 time to create 1 rle with old method : 0.16658520698547363 length of segment : 504 time for calcul the mask position with numpy : 0.014443159103393555 nb_pixel_total : 616700 time to create 1 rle with new method : 0.03472185134887695 length of segment : 1057 time for calcul the mask position with numpy : 0.00542140007019043 nb_pixel_total : 264780 time to create 1 rle with new method : 0.015196084976196289 length of segment : 653 time for calcul the mask position with numpy : 0.0009982585906982422 nb_pixel_total : 44336 time to create 1 rle with old method : 0.05638003349304199 length of segment : 342 time for calcul the mask position with numpy : 0.0035843849182128906 nb_pixel_total : 167506 time to create 1 rle with new method : 0.00986337661743164 length of segment : 571 time for calcul the mask position with numpy : 0.0015549659729003906 nb_pixel_total : 54318 time to create 1 rle with old method : 0.06354737281799316 length of segment : 389 time for calcul the mask position with numpy : 0.007676601409912109 nb_pixel_total : 364327 time to create 1 rle with new method : 0.02236485481262207 length of segment : 943 time for calcul the mask position with numpy : 0.0027511119842529297 nb_pixel_total : 127304 time to create 1 rle with old method : 0.14167070388793945 length of segment : 860 time for calcul the mask position with numpy : 0.0005445480346679688 nb_pixel_total : 14402 time to create 1 rle with old method : 0.0171358585357666 length of segment : 223 time for calcul the mask position with numpy : 0.0045816898345947266 nb_pixel_total : 200861 time to create 1 rle with new method : 0.011162757873535156 length of segment : 627 time for calcul the mask position with numpy : 0.004224300384521484 nb_pixel_total : 126730 time to create 1 rle with old method : 0.16288542747497559 length of segment : 793 time for calcul the mask position with numpy : 0.005336761474609375 nb_pixel_total : 322861 time to create 1 rle with new method : 0.012202978134155273 length of segment : 500 time for calcul the mask position with numpy : 0.03662538528442383 nb_pixel_total : 1188376 time to create 1 rle with new method : 0.32089662551879883 length of segment : 1727 time for calcul the mask position with numpy : 0.0009818077087402344 nb_pixel_total : 42497 time to create 1 rle with old method : 0.04854846000671387 length of segment : 245 time for calcul the mask position with numpy : 0.0010104179382324219 nb_pixel_total : 32586 time to create 1 rle with old method : 0.038329124450683594 length of segment : 306 time for calcul the mask position with numpy : 0.005609750747680664 nb_pixel_total : 326460 time to create 1 rle with new method : 0.014416217803955078 length of segment : 553 time for calcul the mask position with numpy : 0.0005347728729248047 nb_pixel_total : 12166 time to create 1 rle with old method : 0.014206409454345703 length of segment : 236 time for calcul the mask position with numpy : 0.0008180141448974609 nb_pixel_total : 35309 time to create 1 rle with old method : 0.04000449180603027 length of segment : 217 time for calcul the mask position with numpy : 0.0014612674713134766 nb_pixel_total : 59349 time to create 1 rle with old method : 0.06606292724609375 length of segment : 497 time for calcul the mask position with numpy : 0.00990605354309082 nb_pixel_total : 472460 time to create 1 rle with new method : 0.024475812911987305 length of segment : 566 time for calcul the mask position with numpy : 0.002763032913208008 nb_pixel_total : 136010 time to create 1 rle with old method : 0.15904498100280762 length of segment : 374 time for calcul the mask position with numpy : 0.0028405189514160156 nb_pixel_total : 134196 time to create 1 rle with old method : 0.15215206146240234 length of segment : 373 time for calcul the mask position with numpy : 0.0042345523834228516 nb_pixel_total : 210350 time to create 1 rle with new method : 0.013796567916870117 length of segment : 813 time for calcul the mask position with numpy : 0.0015225410461425781 nb_pixel_total : 82466 time to create 1 rle with old method : 0.09234476089477539 length of segment : 330 time for calcul the mask position with numpy : 0.001150369644165039 nb_pixel_total : 44444 time to create 1 rle with old method : 0.050598859786987305 length of segment : 294 time for calcul the mask position with numpy : 0.0043828487396240234 nb_pixel_total : 161814 time to create 1 rle with new method : 0.01355433464050293 length of segment : 559 time for calcul the mask position with numpy : 0.001262664794921875 nb_pixel_total : 59331 time to create 1 rle with old method : 0.06767010688781738 length of segment : 259 time for calcul the mask position with numpy : 0.0017366409301757812 nb_pixel_total : 72862 time to create 1 rle with old method : 0.10177922248840332 length of segment : 423 time for calcul the mask position with numpy : 0.0011348724365234375 nb_pixel_total : 47298 time to create 1 rle with old method : 0.053430795669555664 length of segment : 478 time for calcul the mask position with numpy : 0.0007741451263427734 nb_pixel_total : 22898 time to create 1 rle with old method : 0.026611804962158203 length of segment : 261 time for calcul the mask position with numpy : 0.0005939006805419922 nb_pixel_total : 19761 time to create 1 rle with old method : 0.022678613662719727 length of segment : 153 time for calcul the mask position with numpy : 0.003779888153076172 nb_pixel_total : 152687 time to create 1 rle with new method : 0.011798381805419922 length of segment : 446 time for calcul the mask position with numpy : 0.002054452896118164 nb_pixel_total : 102286 time to create 1 rle with old method : 0.11535263061523438 length of segment : 460 time for calcul the mask position with numpy : 0.0007529258728027344 nb_pixel_total : 30496 time to create 1 rle with old method : 0.03641533851623535 length of segment : 259 time for calcul the mask position with numpy : 0.008429765701293945 nb_pixel_total : 383393 time to create 1 rle with new method : 0.02309393882751465 length of segment : 712 time for calcul the mask position with numpy : 0.00024890899658203125 nb_pixel_total : 11768 time to create 1 rle with old method : 0.013979673385620117 length of segment : 94 time for calcul the mask position with numpy : 0.005196332931518555 nb_pixel_total : 186406 time to create 1 rle with new method : 0.017191648483276367 length of segment : 1058 time for calcul the mask position with numpy : 0.003153562545776367 nb_pixel_total : 125396 time to create 1 rle with old method : 0.15024638175964355 length of segment : 605 time for calcul the mask position with numpy : 0.0007891654968261719 nb_pixel_total : 21331 time to create 1 rle with old method : 0.0242764949798584 length of segment : 209 time for calcul the mask position with numpy : 0.0006122589111328125 nb_pixel_total : 28715 time to create 1 rle with old method : 0.03238940238952637 length of segment : 376 time for calcul the mask position with numpy : 0.0007421970367431641 nb_pixel_total : 28177 time to create 1 rle with old method : 0.032525062561035156 length of segment : 228 time for calcul the mask position with numpy : 0.0011858940124511719 nb_pixel_total : 49123 time to create 1 rle with old method : 0.05545926094055176 length of segment : 232 time for calcul the mask position with numpy : 0.014708280563354492 nb_pixel_total : 368291 time to create 1 rle with new method : 0.08891963958740234 length of segment : 1585 time for calcul the mask position with numpy : 0.0013785362243652344 nb_pixel_total : 58139 time to create 1 rle with old method : 0.0659799575805664 length of segment : 361 time for calcul the mask position with numpy : 0.0060536861419677734 nb_pixel_total : 226069 time to create 1 rle with new method : 0.0216825008392334 length of segment : 990 time for calcul the mask position with numpy : 0.004860401153564453 nb_pixel_total : 223141 time to create 1 rle with new method : 0.01311635971069336 length of segment : 758 time for calcul the mask position with numpy : 0.0017194747924804688 nb_pixel_total : 69105 time to create 1 rle with old method : 0.07727456092834473 length of segment : 507 time for calcul the mask position with numpy : 0.004286050796508789 nb_pixel_total : 95063 time to create 1 rle with old method : 0.12751507759094238 length of segment : 767 time for calcul the mask position with numpy : 0.002079010009765625 nb_pixel_total : 41380 time to create 1 rle with old method : 0.04696846008300781 length of segment : 478 time for calcul the mask position with numpy : 0.001646280288696289 nb_pixel_total : 73492 time to create 1 rle with old method : 0.08371257781982422 length of segment : 336 time for calcul the mask position with numpy : 0.0031194686889648438 nb_pixel_total : 104038 time to create 1 rle with old method : 0.11684679985046387 length of segment : 535 time for calcul the mask position with numpy : 0.0020127296447753906 nb_pixel_total : 78987 time to create 1 rle with old method : 0.10629391670227051 length of segment : 432 time for calcul the mask position with numpy : 0.0006556510925292969 nb_pixel_total : 37316 time to create 1 rle with old method : 0.04322242736816406 length of segment : 276 time for calcul the mask position with numpy : 0.0006358623504638672 nb_pixel_total : 34051 time to create 1 rle with old method : 0.039609670639038086 length of segment : 179 time for calcul the mask position with numpy : 0.003640413284301758 nb_pixel_total : 202547 time to create 1 rle with new method : 0.010835647583007812 length of segment : 820 time for calcul the mask position with numpy : 0.001130819320678711 nb_pixel_total : 48760 time to create 1 rle with old method : 0.05541801452636719 length of segment : 205 time for calcul the mask position with numpy : 0.0021746158599853516 nb_pixel_total : 100302 time to create 1 rle with old method : 0.10937881469726562 length of segment : 560 time for calcul the mask position with numpy : 0.0024695396423339844 nb_pixel_total : 129500 time to create 1 rle with old method : 0.14165210723876953 length of segment : 406 time for calcul the mask position with numpy : 0.0036427974700927734 nb_pixel_total : 210051 time to create 1 rle with new method : 0.00982356071472168 length of segment : 465 time for calcul the mask position with numpy : 0.00122833251953125 nb_pixel_total : 75789 time to create 1 rle with old method : 0.0838618278503418 length of segment : 302 time for calcul the mask position with numpy : 0.0009243488311767578 nb_pixel_total : 47136 time to create 1 rle with old method : 0.05356931686401367 length of segment : 386 time for calcul the mask position with numpy : 0.005922555923461914 nb_pixel_total : 224709 time to create 1 rle with new method : 0.01914525032043457 length of segment : 939 time for calcul the mask position with numpy : 0.003871917724609375 nb_pixel_total : 213872 time to create 1 rle with new method : 0.010992050170898438 length of segment : 598 time for calcul the mask position with numpy : 0.004637956619262695 nb_pixel_total : 217625 time to create 1 rle with new method : 0.014266490936279297 length of segment : 695 time for calcul the mask position with numpy : 0.006487846374511719 nb_pixel_total : 321660 time to create 1 rle with new method : 0.018430471420288086 length of segment : 809 time for calcul the mask position with numpy : 0.0022644996643066406 nb_pixel_total : 81650 time to create 1 rle with old method : 0.09249019622802734 length of segment : 480 time for calcul the mask position with numpy : 0.002530813217163086 nb_pixel_total : 126670 time to create 1 rle with old method : 0.15227341651916504 length of segment : 509 time for calcul the mask position with numpy : 0.0017054080963134766 nb_pixel_total : 89908 time to create 1 rle with old method : 0.1034388542175293 length of segment : 384 time for calcul the mask position with numpy : 0.0033168792724609375 nb_pixel_total : 154806 time to create 1 rle with new method : 0.009137392044067383 length of segment : 686 time for calcul the mask position with numpy : 0.0028836727142333984 nb_pixel_total : 135659 time to create 1 rle with old method : 0.16830182075500488 length of segment : 657 time for calcul the mask position with numpy : 0.004480600357055664 nb_pixel_total : 181949 time to create 1 rle with new method : 0.011294841766357422 length of segment : 373 time for calcul the mask position with numpy : 0.0007479190826416016 nb_pixel_total : 26782 time to create 1 rle with old method : 0.0296173095703125 length of segment : 196 time for calcul the mask position with numpy : 0.0038764476776123047 nb_pixel_total : 227113 time to create 1 rle with new method : 0.010220050811767578 length of segment : 661 time for calcul the mask position with numpy : 0.009325027465820312 nb_pixel_total : 426994 time to create 1 rle with new method : 0.05097484588623047 length of segment : 943 time for calcul the mask position with numpy : 0.0018949508666992188 nb_pixel_total : 74642 time to create 1 rle with old method : 0.08705353736877441 length of segment : 328 time for calcul the mask position with numpy : 0.007395267486572266 nb_pixel_total : 450852 time to create 1 rle with new method : 0.022711753845214844 length of segment : 664 time for calcul the mask position with numpy : 0.0010745525360107422 nb_pixel_total : 37257 time to create 1 rle with old method : 0.0425267219543457 length of segment : 352 time for calcul the mask position with numpy : 0.0014922618865966797 nb_pixel_total : 70178 time to create 1 rle with old method : 0.0866098403930664 length of segment : 298 time for calcul the mask position with numpy : 0.005814790725708008 nb_pixel_total : 325143 time to create 1 rle with new method : 0.017150402069091797 length of segment : 540 time for calcul the mask position with numpy : 0.002117156982421875 nb_pixel_total : 116648 time to create 1 rle with old method : 0.130263090133667 length of segment : 260 time for calcul the mask position with numpy : 0.005494832992553711 nb_pixel_total : 233247 time to create 1 rle with new method : 0.015992164611816406 length of segment : 444 time for calcul the mask position with numpy : 0.013356924057006836 nb_pixel_total : 639222 time to create 1 rle with new method : 0.03957986831665039 length of segment : 998 time for calcul the mask position with numpy : 0.00036263465881347656 nb_pixel_total : 16701 time to create 1 rle with old method : 0.03863263130187988 length of segment : 162 time for calcul the mask position with numpy : 0.0033714771270751953 nb_pixel_total : 200005 time to create 1 rle with new method : 0.009267568588256836 length of segment : 308 time for calcul the mask position with numpy : 0.002621173858642578 nb_pixel_total : 163787 time to create 1 rle with new method : 0.007389068603515625 length of segment : 620 time for calcul the mask position with numpy : 0.0026254653930664062 nb_pixel_total : 147451 time to create 1 rle with old method : 0.18505525588989258 length of segment : 488 time for calcul the mask position with numpy : 0.004105329513549805 nb_pixel_total : 247919 time to create 1 rle with new method : 0.01035928726196289 length of segment : 436 time for calcul the mask position with numpy : 0.0008361339569091797 nb_pixel_total : 20677 time to create 1 rle with old method : 0.02413463592529297 length of segment : 192 time for calcul the mask position with numpy : 0.0008292198181152344 nb_pixel_total : 48616 time to create 1 rle with old method : 0.05389714241027832 length of segment : 292 time for calcul the mask position with numpy : 0.001922607421875 nb_pixel_total : 76709 time to create 1 rle with old method : 0.08670592308044434 length of segment : 348 time for calcul the mask position with numpy : 0.003525972366333008 nb_pixel_total : 189152 time to create 1 rle with new method : 0.009683847427368164 length of segment : 507 time for calcul the mask position with numpy : 0.0046977996826171875 nb_pixel_total : 218287 time to create 1 rle with new method : 0.013295412063598633 length of segment : 873 time for calcul the mask position with numpy : 0.0030629634857177734 nb_pixel_total : 126215 time to create 1 rle with old method : 0.14064478874206543 length of segment : 485 time for calcul the mask position with numpy : 0.004715442657470703 nb_pixel_total : 211721 time to create 1 rle with new method : 0.013809919357299805 length of segment : 534 time for calcul the mask position with numpy : 0.005446434020996094 nb_pixel_total : 242778 time to create 1 rle with new method : 0.03359508514404297 length of segment : 551 time for calcul the mask position with numpy : 0.004842996597290039 nb_pixel_total : 183759 time to create 1 rle with new method : 0.014444828033447266 length of segment : 737 time for calcul the mask position with numpy : 0.0017423629760742188 nb_pixel_total : 85014 time to create 1 rle with old method : 0.09785890579223633 length of segment : 228 time for calcul the mask position with numpy : 0.0008940696716308594 nb_pixel_total : 34803 time to create 1 rle with old method : 0.046792030334472656 length of segment : 288 time for calcul the mask position with numpy : 0.026929855346679688 nb_pixel_total : 902583 time to create 1 rle with new method : 0.0938258171081543 length of segment : 1124 time for calcul the mask position with numpy : 0.00414729118347168 nb_pixel_total : 243976 time to create 1 rle with new method : 0.011299848556518555 length of segment : 803 time for calcul the mask position with numpy : 0.019183874130249023 nb_pixel_total : 880466 time to create 1 rle with new method : 0.25760483741760254 length of segment : 2104 time for calcul the mask position with numpy : 0.034644126892089844 nb_pixel_total : 1318459 time to create 1 rle with new method : 0.7281181812286377 length of segment : 1577 time for calcul the mask position with numpy : 0.001699209213256836 nb_pixel_total : 72226 time to create 1 rle with old method : 0.07904243469238281 length of segment : 783 time for calcul the mask position with numpy : 0.0007936954498291016 nb_pixel_total : 30119 time to create 1 rle with old method : 0.03450655937194824 length of segment : 224 time for calcul the mask position with numpy : 0.0007936954498291016 nb_pixel_total : 25279 time to create 1 rle with old method : 0.03539276123046875 length of segment : 186 time for calcul the mask position with numpy : 0.005371809005737305 nb_pixel_total : 198590 time to create 1 rle with new method : 0.014845132827758789 length of segment : 844 time for calcul the mask position with numpy : 0.0007584095001220703 nb_pixel_total : 9675 time to create 1 rle with old method : 0.011979341506958008 length of segment : 150 time for calcul the mask position with numpy : 0.002207517623901367 nb_pixel_total : 98913 time to create 1 rle with old method : 0.11358833312988281 length of segment : 473 time for calcul the mask position with numpy : 0.0012319087982177734 nb_pixel_total : 51857 time to create 1 rle with old method : 0.06019020080566406 length of segment : 288 time for calcul the mask position with numpy : 0.020456790924072266 nb_pixel_total : 930589 time to create 1 rle with new method : 0.10584092140197754 length of segment : 1265 time for calcul the mask position with numpy : 0.002125978469848633 nb_pixel_total : 98809 time to create 1 rle with old method : 0.10958623886108398 length of segment : 386 time for calcul the mask position with numpy : 0.003023862838745117 nb_pixel_total : 144056 time to create 1 rle with old method : 0.17157554626464844 length of segment : 616 time for calcul the mask position with numpy : 0.00748753547668457 nb_pixel_total : 368506 time to create 1 rle with new method : 0.029259920120239258 length of segment : 1310 time for calcul the mask position with numpy : 0.006197214126586914 nb_pixel_total : 348923 time to create 1 rle with new method : 0.017267227172851562 length of segment : 713 time for calcul the mask position with numpy : 0.003670930862426758 nb_pixel_total : 152214 time to create 1 rle with new method : 0.011434793472290039 length of segment : 775 time for calcul the mask position with numpy : 0.001207113265991211 nb_pixel_total : 58357 time to create 1 rle with old method : 0.08231663703918457 length of segment : 234 time for calcul the mask position with numpy : 0.002833843231201172 nb_pixel_total : 127800 time to create 1 rle with old method : 0.14574742317199707 length of segment : 620 time for calcul the mask position with numpy : 0.0049686431884765625 nb_pixel_total : 170130 time to create 1 rle with new method : 0.01461338996887207 length of segment : 536 time for calcul the mask position with numpy : 0.0012202262878417969 nb_pixel_total : 54608 time to create 1 rle with old method : 0.06752538681030273 length of segment : 327 time for calcul the mask position with numpy : 0.0017626285552978516 nb_pixel_total : 82440 time to create 1 rle with old method : 0.09471011161804199 length of segment : 520 time for calcul the mask position with numpy : 0.0028839111328125 nb_pixel_total : 113026 time to create 1 rle with old method : 0.14291906356811523 length of segment : 752 time for calcul the mask position with numpy : 0.0040132999420166016 nb_pixel_total : 215731 time to create 1 rle with new method : 0.012716054916381836 length of segment : 532 time for calcul the mask position with numpy : 0.0019829273223876953 nb_pixel_total : 86435 time to create 1 rle with old method : 0.11867618560791016 length of segment : 533 time for calcul the mask position with numpy : 0.00238800048828125 nb_pixel_total : 100653 time to create 1 rle with old method : 0.11781454086303711 length of segment : 427 time for calcul the mask position with numpy : 0.0020248889923095703 nb_pixel_total : 91503 time to create 1 rle with old method : 0.10069894790649414 length of segment : 637 time for calcul the mask position with numpy : 0.0008535385131835938 nb_pixel_total : 31129 time to create 1 rle with old method : 0.03406333923339844 length of segment : 227 time for calcul the mask position with numpy : 0.012632131576538086 nb_pixel_total : 658053 time to create 1 rle with new method : 0.04003477096557617 length of segment : 813 time for calcul the mask position with numpy : 0.0009181499481201172 nb_pixel_total : 46598 time to create 1 rle with old method : 0.05102109909057617 length of segment : 251 time for calcul the mask position with numpy : 0.001256704330444336 nb_pixel_total : 57212 time to create 1 rle with old method : 0.06254839897155762 length of segment : 253 time for calcul the mask position with numpy : 0.00043702125549316406 nb_pixel_total : 12701 time to create 1 rle with old method : 0.014825582504272461 length of segment : 231 time for calcul the mask position with numpy : 0.0020432472229003906 nb_pixel_total : 76522 time to create 1 rle with old method : 0.08453106880187988 length of segment : 340 time for calcul the mask position with numpy : 0.0077474117279052734 nb_pixel_total : 340756 time to create 1 rle with new method : 0.02189469337463379 length of segment : 1189 time for calcul the mask position with numpy : 0.002145051956176758 nb_pixel_total : 118956 time to create 1 rle with old method : 0.1322498321533203 length of segment : 422 time for calcul the mask position with numpy : 0.00825643539428711 nb_pixel_total : 327618 time to create 1 rle with new method : 0.02672743797302246 length of segment : 639 time for calcul the mask position with numpy : 0.009137868881225586 nb_pixel_total : 262284 time to create 1 rle with new method : 0.03056049346923828 length of segment : 980 time for calcul the mask position with numpy : 0.0013363361358642578 nb_pixel_total : 63978 time to create 1 rle with old method : 0.07605195045471191 length of segment : 277 time for calcul the mask position with numpy : 0.0012311935424804688 nb_pixel_total : 54410 time to create 1 rle with old method : 0.0641181468963623 length of segment : 304 time for calcul the mask position with numpy : 0.0006997585296630859 nb_pixel_total : 26688 time to create 1 rle with old method : 0.05237078666687012 length of segment : 251 time for calcul the mask position with numpy : 0.025594472885131836 nb_pixel_total : 946096 time to create 1 rle with new method : 0.08658671379089355 length of segment : 1283 time for calcul the mask position with numpy : 0.006004810333251953 nb_pixel_total : 362768 time to create 1 rle with new method : 0.021024703979492188 length of segment : 890 time for calcul the mask position with numpy : 0.0013468265533447266 nb_pixel_total : 61784 time to create 1 rle with old method : 0.06997299194335938 length of segment : 321 time for calcul the mask position with numpy : 0.001697540283203125 nb_pixel_total : 69849 time to create 1 rle with old method : 0.08707261085510254 length of segment : 478 time for calcul the mask position with numpy : 0.003921985626220703 nb_pixel_total : 170577 time to create 1 rle with new method : 0.009542703628540039 length of segment : 234 time for calcul the mask position with numpy : 0.0033054351806640625 nb_pixel_total : 114118 time to create 1 rle with old method : 0.14662766456604004 length of segment : 618 time for calcul the mask position with numpy : 0.000701904296875 nb_pixel_total : 28054 time to create 1 rle with old method : 0.04132819175720215 length of segment : 177 time for calcul the mask position with numpy : 0.0036242008209228516 nb_pixel_total : 142808 time to create 1 rle with old method : 0.17301583290100098 length of segment : 602 time for calcul the mask position with numpy : 0.0008559226989746094 nb_pixel_total : 32062 time to create 1 rle with old method : 0.0380091667175293 length of segment : 166 time for calcul the mask position with numpy : 0.020168066024780273 nb_pixel_total : 824825 time to create 1 rle with new method : 0.12467837333679199 length of segment : 1833 time for calcul the mask position with numpy : 0.018650054931640625 nb_pixel_total : 695474 time to create 1 rle with new method : 0.41522979736328125 length of segment : 786 time for calcul the mask position with numpy : 0.0009706020355224609 nb_pixel_total : 12882 time to create 1 rle with old method : 0.01601123809814453 length of segment : 209 time for calcul the mask position with numpy : 0.0014595985412597656 nb_pixel_total : 49527 time to create 1 rle with old method : 0.05727696418762207 length of segment : 269 time for calcul the mask position with numpy : 0.003731250762939453 nb_pixel_total : 77746 time to create 1 rle with old method : 0.09957337379455566 length of segment : 601 time for calcul the mask position with numpy : 0.005565643310546875 nb_pixel_total : 168044 time to create 1 rle with new method : 0.01740288734436035 length of segment : 402 time for calcul the mask position with numpy : 0.0021333694458007812 nb_pixel_total : 71625 time to create 1 rle with old method : 0.08330512046813965 length of segment : 264 time for calcul the mask position with numpy : 0.002246379852294922 nb_pixel_total : 65841 time to create 1 rle with old method : 0.07824134826660156 length of segment : 275 time for calcul the mask position with numpy : 0.001961946487426758 nb_pixel_total : 95032 time to create 1 rle with old method : 0.11217474937438965 length of segment : 365 time for calcul the mask position with numpy : 0.0038852691650390625 nb_pixel_total : 169122 time to create 1 rle with new method : 0.014666318893432617 length of segment : 838 time for calcul the mask position with numpy : 0.0018463134765625 nb_pixel_total : 97983 time to create 1 rle with old method : 0.11230254173278809 length of segment : 284 time for calcul the mask position with numpy : 0.007849931716918945 nb_pixel_total : 390648 time to create 1 rle with new method : 0.055583953857421875 length of segment : 770 time for calcul the mask position with numpy : 0.004261493682861328 nb_pixel_total : 148843 time to create 1 rle with old method : 0.1678018569946289 length of segment : 719 time for calcul the mask position with numpy : 0.016014575958251953 nb_pixel_total : 520825 time to create 1 rle with new method : 0.4361152648925781 length of segment : 1914 time for calcul the mask position with numpy : 0.0011744499206542969 nb_pixel_total : 30883 time to create 1 rle with old method : 0.036223649978637695 length of segment : 373 time for calcul the mask position with numpy : 0.0014042854309082031 nb_pixel_total : 22944 time to create 1 rle with old method : 0.02758502960205078 length of segment : 243 time for calcul the mask position with numpy : 0.002331256866455078 nb_pixel_total : 97596 time to create 1 rle with old method : 0.11779952049255371 length of segment : 435 time for calcul the mask position with numpy : 0.043505191802978516 nb_pixel_total : 631341 time to create 1 rle with new method : 0.584505558013916 length of segment : 2387 time for calcul the mask position with numpy : 0.0012531280517578125 nb_pixel_total : 60600 time to create 1 rle with old method : 0.07514834403991699 length of segment : 253 time for calcul the mask position with numpy : 0.0019271373748779297 nb_pixel_total : 110615 time to create 1 rle with old method : 0.12993669509887695 length of segment : 414 time for calcul the mask position with numpy : 0.002145051956176758 nb_pixel_total : 93519 time to create 1 rle with old method : 0.10716938972473145 length of segment : 334 time for calcul the mask position with numpy : 0.004407167434692383 nb_pixel_total : 199810 time to create 1 rle with new method : 0.01235342025756836 length of segment : 463 time for calcul the mask position with numpy : 0.0009646415710449219 nb_pixel_total : 48650 time to create 1 rle with old method : 0.0556640625 length of segment : 194 time for calcul the mask position with numpy : 0.0076868534088134766 nb_pixel_total : 280353 time to create 1 rle with new method : 0.025331974029541016 length of segment : 843 time for calcul the mask position with numpy : 0.0014939308166503906 nb_pixel_total : 49487 time to create 1 rle with old method : 0.056290388107299805 length of segment : 217 time for calcul the mask position with numpy : 0.003033876419067383 nb_pixel_total : 120412 time to create 1 rle with old method : 0.17547273635864258 length of segment : 367 time for calcul the mask position with numpy : 0.004071950912475586 nb_pixel_total : 156040 time to create 1 rle with new method : 0.012287139892578125 length of segment : 435 time for calcul the mask position with numpy : 0.002685546875 nb_pixel_total : 79007 time to create 1 rle with old method : 0.0903773307800293 length of segment : 345 time for calcul the mask position with numpy : 0.0020749568939208984 nb_pixel_total : 19207 time to create 1 rle with old method : 0.026701688766479492 length of segment : 339 time for calcul the mask position with numpy : 0.004988431930541992 nb_pixel_total : 171431 time to create 1 rle with new method : 0.015716075897216797 length of segment : 400 time for calcul the mask position with numpy : 0.002040863037109375 nb_pixel_total : 73679 time to create 1 rle with old method : 0.08424854278564453 length of segment : 422 time for calcul the mask position with numpy : 0.004741191864013672 nb_pixel_total : 195633 time to create 1 rle with new method : 0.014543294906616211 length of segment : 656 time for calcul the mask position with numpy : 0.0036673545837402344 nb_pixel_total : 141409 time to create 1 rle with old method : 0.15881896018981934 length of segment : 558 time for calcul the mask position with numpy : 0.0048923492431640625 nb_pixel_total : 192535 time to create 1 rle with new method : 0.01548910140991211 length of segment : 661 time for calcul the mask position with numpy : 0.003744363784790039 nb_pixel_total : 123019 time to create 1 rle with old method : 0.13974881172180176 length of segment : 554 time for calcul the mask position with numpy : 0.001947641372680664 nb_pixel_total : 96521 time to create 1 rle with old method : 0.1341235637664795 length of segment : 326 time for calcul the mask position with numpy : 0.005692005157470703 nb_pixel_total : 159879 time to create 1 rle with new method : 0.020102500915527344 length of segment : 918 time for calcul the mask position with numpy : 0.003111600875854492 nb_pixel_total : 116859 time to create 1 rle with old method : 0.15172243118286133 length of segment : 477 time for calcul the mask position with numpy : 0.0012960433959960938 nb_pixel_total : 69703 time to create 1 rle with old method : 0.07953882217407227 length of segment : 303 time for calcul the mask position with numpy : 0.0014233589172363281 nb_pixel_total : 72482 time to create 1 rle with old method : 0.0907137393951416 length of segment : 304 time for calcul the mask position with numpy : 0.002530813217163086 nb_pixel_total : 131732 time to create 1 rle with old method : 0.14704203605651855 length of segment : 448 time for calcul the mask position with numpy : 0.36083149909973145 nb_pixel_total : 5108009 time to create 1 rle with new method : 0.8208532333374023 length of segment : 3481 time for calcul the mask position with numpy : 0.006993293762207031 nb_pixel_total : 367767 time to create 1 rle with new method : 0.01947641372680664 length of segment : 696 time for calcul the mask position with numpy : 0.0005936622619628906 nb_pixel_total : 27087 time to create 1 rle with old method : 0.03049182891845703 length of segment : 248 time for calcul the mask position with numpy : 0.0012156963348388672 nb_pixel_total : 65807 time to create 1 rle with old method : 0.07457494735717773 length of segment : 316 time for calcul the mask position with numpy : 0.0005702972412109375 nb_pixel_total : 37884 time to create 1 rle with old method : 0.046144962310791016 length of segment : 246 time for calcul the mask position with numpy : 0.0008401870727539062 nb_pixel_total : 61963 time to create 1 rle with old method : 0.09969925880432129 length of segment : 278 time for calcul the mask position with numpy : 0.013686418533325195 nb_pixel_total : 708981 time to create 1 rle with new method : 0.04047966003417969 length of segment : 1207 time for calcul the mask position with numpy : 0.019832849502563477 nb_pixel_total : 338771 time to create 1 rle with new method : 0.20940542221069336 length of segment : 911 time for calcul the mask position with numpy : 0.0011186599731445312 nb_pixel_total : 69803 time to create 1 rle with old method : 0.08416628837585449 length of segment : 455 time for calcul the mask position with numpy : 0.0006034374237060547 nb_pixel_total : 36537 time to create 1 rle with old method : 0.04554891586303711 length of segment : 154 time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 25225 time to create 1 rle with old method : 0.02901005744934082 length of segment : 165 time for calcul the mask position with numpy : 0.0013306140899658203 nb_pixel_total : 112824 time to create 1 rle with old method : 0.12943696975708008 length of segment : 178 time for calcul the mask position with numpy : 0.0003275871276855469 nb_pixel_total : 17941 time to create 1 rle with old method : 0.030290842056274414 length of segment : 109 time spent for convertir_results : 83.14653778076172 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 504 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 211.38999319076538 time spend to save output : 0.2088766098022461 total time spend for step 2 : 211.59886980056763 step3:blur_detection Tue Apr 1 11:06:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.009998083114624023 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.008951663970947266 save missing photos in datou_result : time spend for datou_step_exec : 0.029347658157348633 time spend to save output : 0.023923873901367188 total time spend for step 3 : 0.05327153205871582 step4:brightness Tue Apr 1 11:06:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.009062051773071289 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.008888006210327148 save missing photos in datou_result : time spend for datou_step_exec : 0.025069713592529297 time spend to save output : 0.022780179977416992 total time spend for step 4 : 0.04784989356994629 step5:rle_unique_nms_with_priority Tue Apr 1 11:06:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 504 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 83 nb_hashtags : 9 time to prepare the origin masks : 63.787959575653076 time for calcul the mask position with numpy : 1.561887264251709 nb_pixel_total : 3693025 time to create 1 rle with new method : 1.6318798065185547 time for calcul the mask position with numpy : 0.05460834503173828 nb_pixel_total : 9488 time to create 1 rle with old method : 0.01585102081298828 time for calcul the mask position with numpy : 0.06069350242614746 nb_pixel_total : 68622 time to create 1 rle with old method : 0.0764017105102539 time for calcul the mask position with numpy : 0.05339860916137695 nb_pixel_total : 36379 time to create 1 rle with old method : 0.04117870330810547 time for calcul the mask position with numpy : 0.05433082580566406 nb_pixel_total : 300774 time to create 1 rle with new method : 1.0272862911224365 time for calcul the mask position with numpy : 0.054033756256103516 nb_pixel_total : 118116 time to create 1 rle with old method : 0.1364765167236328 time for calcul the mask position with numpy : 0.05370974540710449 nb_pixel_total : 14596 time to create 1 rle with old method : 0.01677227020263672 time for calcul the mask position with numpy : 0.05325961112976074 nb_pixel_total : 7386 time to create 1 rle with old method : 0.008780241012573242 time for calcul the mask position with numpy : 0.05676388740539551 nb_pixel_total : 95810 time to create 1 rle with old method : 0.10767149925231934 time for calcul the mask position with numpy : 0.05402803421020508 nb_pixel_total : 186468 time to create 1 rle with new method : 1.1151299476623535 time for calcul the mask position with numpy : 0.052913665771484375 nb_pixel_total : 77777 time to create 1 rle with old method : 0.08513832092285156 time for calcul the mask position with numpy : 0.052697181701660156 nb_pixel_total : 22441 time to create 1 rle with old method : 0.02510237693786621 time for calcul the mask position with numpy : 0.05327320098876953 nb_pixel_total : 160067 time to create 1 rle with new method : 1.1262271404266357 time for calcul the mask position with numpy : 0.06214141845703125 nb_pixel_total : 59936 time to create 1 rle with old method : 0.07796382904052734 time for calcul the mask position with numpy : 0.05607914924621582 nb_pixel_total : 164109 time to create 1 rle with new method : 1.1781206130981445 time for calcul the mask position with numpy : 0.05393075942993164 nb_pixel_total : 4356 time to create 1 rle with old method : 0.005247354507446289 time for calcul the mask position with numpy : 0.05361795425415039 nb_pixel_total : 154 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.054209232330322266 nb_pixel_total : 77159 time to create 1 rle with old method : 0.08826398849487305 time for calcul the mask position with numpy : 0.053618669509887695 nb_pixel_total : 462 time to create 1 rle with old method : 0.0010678768157958984 time for calcul the mask position with numpy : 0.05909848213195801 nb_pixel_total : 600968 time to create 1 rle with new method : 0.9050142765045166 time for calcul the mask position with numpy : 0.057747602462768555 nb_pixel_total : 24345 time to create 1 rle with old method : 0.02755880355834961 time for calcul the mask position with numpy : 0.05435681343078613 nb_pixel_total : 73245 time to create 1 rle with old method : 0.08352828025817871 time for calcul the mask position with numpy : 0.05357980728149414 nb_pixel_total : 2402 time to create 1 rle with old method : 0.002774953842163086 time for calcul the mask position with numpy : 0.05592203140258789 nb_pixel_total : 7360 time to create 1 rle with old method : 0.008759021759033203 time for calcul the mask position with numpy : 0.05623579025268555 nb_pixel_total : 134958 time to create 1 rle with old method : 0.17980027198791504 time for calcul the mask position with numpy : 0.05429673194885254 nb_pixel_total : 457 time to create 1 rle with old method : 0.0009713172912597656 time for calcul the mask position with numpy : 0.054407358169555664 nb_pixel_total : 106684 time to create 1 rle with old method : 0.12046551704406738 time for calcul the mask position with numpy : 0.05960249900817871 nb_pixel_total : 436816 time to create 1 rle with new method : 0.9353194236755371 time for calcul the mask position with numpy : 0.057830095291137695 nb_pixel_total : 22789 time to create 1 rle with old method : 0.027306556701660156 time for calcul the mask position with numpy : 0.05420279502868652 nb_pixel_total : 8585 time to create 1 rle with old method : 0.010532617568969727 time for calcul the mask position with numpy : 0.0558779239654541 nb_pixel_total : 45093 time to create 1 rle with old method : 0.06394004821777344 time for calcul the mask position with numpy : 0.07602572441101074 nb_pixel_total : 187063 time to create 1 rle with new method : 1.3041210174560547 time for calcul the mask position with numpy : 0.05586528778076172 nb_pixel_total : 72745 time to create 1 rle with old method : 0.0801079273223877 time for calcul the mask position with numpy : 0.05245614051818848 nb_pixel_total : 8135 time to create 1 rle with old method : 0.00900888442993164 time for calcul the mask position with numpy : 0.05147695541381836 nb_pixel_total : 47199 time to create 1 rle with old method : 0.054578304290771484 time for calcul the mask position with numpy : 0.0537111759185791 nb_pixel_total : 45652 time to create 1 rle with old method : 0.05052328109741211 time for calcul the mask position with numpy : 0.05310392379760742 nb_pixel_total : 86776 time to create 1 rle with old method : 0.10298585891723633 time for calcul the mask position with numpy : 0.05314755439758301 nb_pixel_total : 16996 time to create 1 rle with old method : 0.01905536651611328 time for calcul the mask position with numpy : 0.05328059196472168 nb_pixel_total : 4573 time to create 1 rle with old method : 0.00556182861328125 time for calcul the mask position with numpy : 0.05358314514160156 nb_pixel_total : 37777 time to create 1 rle with old method : 0.04351162910461426 time for calcul the mask position with numpy : 0.056791067123413086 nb_pixel_total : 270920 time to create 1 rle with new method : 1.3177661895751953 time for calcul the mask position with numpy : 0.05263257026672363 nb_pixel_total : 520 time to create 1 rle with old method : 0.0009243488311767578 time for calcul the mask position with numpy : 0.051845550537109375 nb_pixel_total : 72048 time to create 1 rle with old method : 0.07587313652038574 time for calcul the mask position with numpy : 0.0508878231048584 nb_pixel_total : 7285 time to create 1 rle with old method : 0.007930994033813477 time for calcul the mask position with numpy : 0.059148550033569336 nb_pixel_total : 37 time to create 1 rle with old method : 0.00026679039001464844 time for calcul the mask position with numpy : 0.05890297889709473 nb_pixel_total : 277789 time to create 1 rle with new method : 1.0050673484802246 time for calcul the mask position with numpy : 0.05399346351623535 nb_pixel_total : 144663 time to create 1 rle with old method : 0.16611170768737793 time for calcul the mask position with numpy : 0.05360531806945801 nb_pixel_total : 41725 time to create 1 rle with old method : 0.04698348045349121 time for calcul the mask position with numpy : 0.053423404693603516 nb_pixel_total : 14158 time to create 1 rle with old method : 0.015970230102539062 time for calcul the mask position with numpy : 0.0544741153717041 nb_pixel_total : 337319 time to create 1 rle with new method : 1.1549897193908691 time for calcul the mask position with numpy : 0.05637359619140625 nb_pixel_total : 3408 time to create 1 rle with old method : 0.00428462028503418 time for calcul the mask position with numpy : 0.05345582962036133 nb_pixel_total : 394564 time to create 1 rle with new method : 1.4769585132598877 time for calcul the mask position with numpy : 0.05891585350036621 nb_pixel_total : 32336 time to create 1 rle with old method : 0.03683757781982422 time for calcul the mask position with numpy : 0.05309653282165527 nb_pixel_total : 13315 time to create 1 rle with old method : 0.015413761138916016 time for calcul the mask position with numpy : 0.05487513542175293 nb_pixel_total : 13081 time to create 1 rle with old method : 0.015082597732543945 time for calcul the mask position with numpy : 0.05496406555175781 nb_pixel_total : 345329 time to create 1 rle with new method : 1.175248146057129 time for calcul the mask position with numpy : 0.05661201477050781 nb_pixel_total : 20665 time to create 1 rle with old method : 0.023462533950805664 time for calcul the mask position with numpy : 0.05409812927246094 nb_pixel_total : 95609 time to create 1 rle with old method : 0.1284923553466797 time for calcul the mask position with numpy : 0.05495309829711914 nb_pixel_total : 36961 time to create 1 rle with old method : 0.04230237007141113 time for calcul the mask position with numpy : 0.05500316619873047 nb_pixel_total : 282438 time to create 1 rle with new method : 1.0478262901306152 time for calcul the mask position with numpy : 0.054114580154418945 nb_pixel_total : 199329 time to create 1 rle with new method : 2.4791314601898193 time for calcul the mask position with numpy : 0.05551767349243164 nb_pixel_total : 88917 time to create 1 rle with old method : 0.10406756401062012 time for calcul the mask position with numpy : 0.07059717178344727 nb_pixel_total : 1116685 time to create 1 rle with new method : 1.6631839275360107 time for calcul the mask position with numpy : 0.0515742301940918 nb_pixel_total : 20104 time to create 1 rle with old method : 0.02364206314086914 time for calcul the mask position with numpy : 0.052609920501708984 nb_pixel_total : 3770 time to create 1 rle with old method : 0.004669666290283203 time for calcul the mask position with numpy : 0.05401968955993652 nb_pixel_total : 226871 time to create 1 rle with new method : 1.751837968826294 time for calcul the mask position with numpy : 0.05361604690551758 nb_pixel_total : 3926 time to create 1 rle with old method : 0.0051805973052978516 time for calcul the mask position with numpy : 0.062458038330078125 nb_pixel_total : 138018 time to create 1 rle with old method : 0.16503143310546875 time for calcul the mask position with numpy : 0.05610013008117676 nb_pixel_total : 32314 time to create 1 rle with old method : 0.03703880310058594 time for calcul the mask position with numpy : 0.053618669509887695 nb_pixel_total : 49500 time to create 1 rle with old method : 0.05751371383666992 time for calcul the mask position with numpy : 0.056005001068115234 nb_pixel_total : 227318 time to create 1 rle with new method : 2.586796998977661 time for calcul the mask position with numpy : 0.05448746681213379 nb_pixel_total : 56628 time to create 1 rle with old method : 0.08472275733947754 time for calcul the mask position with numpy : 0.05632734298706055 nb_pixel_total : 54121 time to create 1 rle with old method : 0.06211566925048828 time for calcul the mask position with numpy : 0.053411245346069336 nb_pixel_total : 8583 time to create 1 rle with old method : 0.010633468627929688 time for calcul the mask position with numpy : 0.0555572509765625 nb_pixel_total : 279380 time to create 1 rle with new method : 0.9529380798339844 time for calcul the mask position with numpy : 0.05352425575256348 nb_pixel_total : 13384 time to create 1 rle with old method : 0.01587080955505371 time for calcul the mask position with numpy : 0.05700325965881348 nb_pixel_total : 590228 time to create 1 rle with new method : 1.0864572525024414 time for calcul the mask position with numpy : 0.050141096115112305 nb_pixel_total : 2280 time to create 1 rle with old method : 0.0025556087493896484 time for calcul the mask position with numpy : 0.05011272430419922 nb_pixel_total : 4861 time to create 1 rle with old method : 0.005323886871337891 time for calcul the mask position with numpy : 0.052134037017822266 nb_pixel_total : 311746 time to create 1 rle with new method : 1.219301700592041 time for calcul the mask position with numpy : 0.05241703987121582 nb_pixel_total : 1178 time to create 1 rle with old method : 0.0015399456024169922 time for calcul the mask position with numpy : 0.052822113037109375 nb_pixel_total : 44275 time to create 1 rle with old method : 0.049825191497802734 time for calcul the mask position with numpy : 0.05294990539550781 nb_pixel_total : 19841 time to create 1 rle with old method : 0.021944284439086914 time for calcul the mask position with numpy : 0.05168485641479492 nb_pixel_total : 14030 time to create 1 rle with old method : 0.01517033576965332 create new chi : 38.08691453933716 time to delete rle : 0.03137779235839844 batch 1 Loaded 84 chid ids of type : 4855 Number RLEs to save : 351 TO DO : save crop sub photo not yet done ! save time : 0.3481621742248535 nb_obj : 63 nb_hashtags : 10 time to prepare the origin masks : 51.58114004135132 time for calcul the mask position with numpy : 0.38280701637268066 nb_pixel_total : 3208287 time to create 1 rle with new method : 1.3140590190887451 time for calcul the mask position with numpy : 0.05514955520629883 nb_pixel_total : 152188 time to create 1 rle with new method : 1.093743085861206 time for calcul the mask position with numpy : 0.06250905990600586 nb_pixel_total : 254991 time to create 1 rle with new method : 0.9563603401184082 time for calcul the mask position with numpy : 0.05406498908996582 nb_pixel_total : 36941 time to create 1 rle with old method : 0.04279685020446777 time for calcul the mask position with numpy : 0.05364513397216797 nb_pixel_total : 36308 time to create 1 rle with old method : 0.04058980941772461 time for calcul the mask position with numpy : 0.05276346206665039 nb_pixel_total : 58002 time to create 1 rle with old method : 0.06729340553283691 time for calcul the mask position with numpy : 0.05413937568664551 nb_pixel_total : 72112 time to create 1 rle with old method : 0.08117151260375977 time for calcul the mask position with numpy : 0.05358290672302246 nb_pixel_total : 6461 time to create 1 rle with old method : 0.0074710845947265625 time for calcul the mask position with numpy : 0.05816841125488281 nb_pixel_total : 394719 time to create 1 rle with new method : 1.3110036849975586 time for calcul the mask position with numpy : 0.05296802520751953 nb_pixel_total : 44418 time to create 1 rle with old method : 0.05332231521606445 time for calcul the mask position with numpy : 0.05338859558105469 nb_pixel_total : 96772 time to create 1 rle with old method : 0.10767602920532227 time for calcul the mask position with numpy : 0.05377054214477539 nb_pixel_total : 2328 time to create 1 rle with old method : 0.002881288528442383 time for calcul the mask position with numpy : 0.05836749076843262 nb_pixel_total : 26485 time to create 1 rle with old method : 0.029660463333129883 time for calcul the mask position with numpy : 0.0531773567199707 nb_pixel_total : 47839 time to create 1 rle with old method : 0.05242729187011719 time for calcul the mask position with numpy : 0.053873300552368164 nb_pixel_total : 54240 time to create 1 rle with old method : 0.06054878234863281 time for calcul the mask position with numpy : 0.057662010192871094 nb_pixel_total : 147807 time to create 1 rle with old method : 0.17589497566223145 time for calcul the mask position with numpy : 0.05453181266784668 nb_pixel_total : 7956 time to create 1 rle with old method : 0.009236812591552734 time for calcul the mask position with numpy : 0.05386996269226074 nb_pixel_total : 115236 time to create 1 rle with old method : 0.12784671783447266 time for calcul the mask position with numpy : 0.05375075340270996 nb_pixel_total : 25647 time to create 1 rle with old method : 0.03419017791748047 time for calcul the mask position with numpy : 0.05649423599243164 nb_pixel_total : 56446 time to create 1 rle with old method : 0.06343626976013184 time for calcul the mask position with numpy : 0.055948495864868164 nb_pixel_total : 502050 time to create 1 rle with new method : 0.8615665435791016 time for calcul the mask position with numpy : 0.05591464042663574 nb_pixel_total : 3614 time to create 1 rle with old method : 0.0041961669921875 time for calcul the mask position with numpy : 0.054197072982788086 nb_pixel_total : 119206 time to create 1 rle with old method : 0.14569711685180664 time for calcul the mask position with numpy : 0.053461551666259766 nb_pixel_total : 9500 time to create 1 rle with old method : 0.0115509033203125 time for calcul the mask position with numpy : 0.05371451377868652 nb_pixel_total : 17448 time to create 1 rle with old method : 0.02014756202697754 time for calcul the mask position with numpy : 0.05957436561584473 nb_pixel_total : 649493 time to create 1 rle with new method : 0.836545467376709 time for calcul the mask position with numpy : 0.054036855697631836 nb_pixel_total : 42439 time to create 1 rle with old method : 0.04889655113220215 time for calcul the mask position with numpy : 0.05306386947631836 nb_pixel_total : 5665 time to create 1 rle with old method : 0.006947994232177734 time for calcul the mask position with numpy : 0.05293083190917969 nb_pixel_total : 202520 time to create 1 rle with new method : 0.9619297981262207 time for calcul the mask position with numpy : 0.0500483512878418 nb_pixel_total : 2913 time to create 1 rle with old method : 0.0034897327423095703 time for calcul the mask position with numpy : 0.05225849151611328 nb_pixel_total : 91869 time to create 1 rle with old method : 0.09583640098571777 time for calcul the mask position with numpy : 0.05060005187988281 nb_pixel_total : 70381 time to create 1 rle with old method : 0.07537293434143066 time for calcul the mask position with numpy : 0.05129528045654297 nb_pixel_total : 34328 time to create 1 rle with old method : 0.03969550132751465 time for calcul the mask position with numpy : 0.080169677734375 nb_pixel_total : 2301042 time to create 1 rle with new method : 0.7970156669616699 time for calcul the mask position with numpy : 0.05294346809387207 nb_pixel_total : 25926 time to create 1 rle with old method : 0.028382539749145508 time for calcul the mask position with numpy : 0.05181312561035156 nb_pixel_total : 102422 time to create 1 rle with old method : 0.1064295768737793 time for calcul the mask position with numpy : 0.05293846130371094 nb_pixel_total : 273283 time to create 1 rle with new method : 1.0395140647888184 time for calcul the mask position with numpy : 0.05335283279418945 nb_pixel_total : 128205 time to create 1 rle with old method : 0.13720703125 time for calcul the mask position with numpy : 0.0562131404876709 nb_pixel_total : 244513 time to create 1 rle with new method : 1.563398838043213 time for calcul the mask position with numpy : 0.05013418197631836 nb_pixel_total : 110 time to create 1 rle with old method : 0.00017714500427246094 time for calcul the mask position with numpy : 0.05350828170776367 nb_pixel_total : 33899 time to create 1 rle with old method : 0.037712812423706055 time for calcul the mask position with numpy : 0.05295586585998535 nb_pixel_total : 59896 time to create 1 rle with old method : 0.0658576488494873 time for calcul the mask position with numpy : 0.052999258041381836 nb_pixel_total : 5212 time to create 1 rle with old method : 0.0060498714447021484 time for calcul the mask position with numpy : 0.05214047431945801 nb_pixel_total : 315 time to create 1 rle with old method : 0.0006849765777587891 time for calcul the mask position with numpy : 0.05241107940673828 nb_pixel_total : 156902 time to create 1 rle with new method : 1.9753012657165527 time for calcul the mask position with numpy : 0.05640149116516113 nb_pixel_total : 218658 time to create 1 rle with new method : 2.2242236137390137 time for calcul the mask position with numpy : 0.05052828788757324 nb_pixel_total : 1104 time to create 1 rle with old method : 0.0018291473388671875 time for calcul the mask position with numpy : 0.05085587501525879 nb_pixel_total : 15536 time to create 1 rle with old method : 0.01695728302001953 time for calcul the mask position with numpy : 0.05060911178588867 nb_pixel_total : 28046 time to create 1 rle with old method : 0.030211448669433594 time for calcul the mask position with numpy : 0.060616254806518555 nb_pixel_total : 618340 time to create 1 rle with new method : 1.236807107925415 time for calcul the mask position with numpy : 0.053498268127441406 nb_pixel_total : 5734 time to create 1 rle with old method : 0.006902456283569336 time for calcul the mask position with numpy : 0.054620981216430664 nb_pixel_total : 66999 time to create 1 rle with old method : 0.07413005828857422 time for calcul the mask position with numpy : 0.05302143096923828 nb_pixel_total : 799 time to create 1 rle with old method : 0.0012080669403076172 time for calcul the mask position with numpy : 0.05435752868652344 nb_pixel_total : 34185 time to create 1 rle with old method : 0.037256717681884766 time for calcul the mask position with numpy : 0.05202031135559082 nb_pixel_total : 2065 time to create 1 rle with old method : 0.002398967742919922 time for calcul the mask position with numpy : 0.05260443687438965 nb_pixel_total : 49869 time to create 1 rle with old method : 0.0537114143371582 time for calcul the mask position with numpy : 0.055292367935180664 nb_pixel_total : 293862 time to create 1 rle with new method : 1.1070632934570312 time for calcul the mask position with numpy : 0.05374264717102051 nb_pixel_total : 158494 time to create 1 rle with new method : 1.1172256469726562 time for calcul the mask position with numpy : 0.05513477325439453 nb_pixel_total : 46085 time to create 1 rle with old method : 0.047605037689208984 time for calcul the mask position with numpy : 0.0628061294555664 nb_pixel_total : 910529 time to create 1 rle with new method : 0.9500322341918945 time for calcul the mask position with numpy : 0.06018376350402832 nb_pixel_total : 560959 time to create 1 rle with new method : 0.9922192096710205 time for calcul the mask position with numpy : 0.0536954402923584 nb_pixel_total : 20276 time to create 1 rle with old method : 0.0227203369140625 time for calcul the mask position with numpy : 0.053285837173461914 nb_pixel_total : 9681 time to create 1 rle with old method : 0.010825872421264648 time for calcul the mask position with numpy : 0.05223202705383301 nb_pixel_total : 9645 time to create 1 rle with old method : 0.010714292526245117 create new chi : 27.11480140686035 time to delete rle : 0.006748199462890625 batch 1 Loaded 64 chid ids of type : 4855 Number RLEs to save : 54885 TO DO : save crop sub photo not yet done ! save time : 3.515561103820801 nb_obj : 96 nb_hashtags : 10 time to prepare the origin masks : 67.82905697822571 time for calcul the mask position with numpy : 0.6745634078979492 nb_pixel_total : 3842527 time to create 1 rle with new method : 1.7280099391937256 time for calcul the mask position with numpy : 0.056864261627197266 nb_pixel_total : 139299 time to create 1 rle with old method : 0.1640331745147705 time for calcul the mask position with numpy : 0.057814836502075195 nb_pixel_total : 208083 time to create 1 rle with new method : 0.6865262985229492 time for calcul the mask position with numpy : 0.054329633712768555 nb_pixel_total : 30234 time to create 1 rle with old method : 0.034014225006103516 time for calcul the mask position with numpy : 0.05351424217224121 nb_pixel_total : 4073 time to create 1 rle with old method : 0.0056078433990478516 time for calcul the mask position with numpy : 0.05332684516906738 nb_pixel_total : 30334 time to create 1 rle with old method : 0.034338951110839844 time for calcul the mask position with numpy : 0.053775787353515625 nb_pixel_total : 2024 time to create 1 rle with old method : 0.0025103092193603516 time for calcul the mask position with numpy : 0.05393671989440918 nb_pixel_total : 80629 time to create 1 rle with old method : 0.08937668800354004 time for calcul the mask position with numpy : 0.052907466888427734 nb_pixel_total : 1655 time to create 1 rle with old method : 0.002161264419555664 time for calcul the mask position with numpy : 0.0577390193939209 nb_pixel_total : 373950 time to create 1 rle with new method : 1.3956797122955322 time for calcul the mask position with numpy : 0.052567243576049805 nb_pixel_total : 2550 time to create 1 rle with old method : 0.0030226707458496094 time for calcul the mask position with numpy : 0.05179762840270996 nb_pixel_total : 19005 time to create 1 rle with old method : 0.02095174789428711 time for calcul the mask position with numpy : 0.05323219299316406 nb_pixel_total : 109804 time to create 1 rle with old method : 0.12011528015136719 time for calcul the mask position with numpy : 0.05263543128967285 nb_pixel_total : 1858 time to create 1 rle with old method : 0.002905607223510742 time for calcul the mask position with numpy : 0.05358386039733887 nb_pixel_total : 465 time to create 1 rle with old method : 0.0011115074157714844 time for calcul the mask position with numpy : 0.055391788482666016 nb_pixel_total : 198151 time to create 1 rle with new method : 0.992457389831543 time for calcul the mask position with numpy : 0.05279064178466797 nb_pixel_total : 555 time to create 1 rle with old method : 0.0010073184967041016 time for calcul the mask position with numpy : 0.05393362045288086 nb_pixel_total : 4141 time to create 1 rle with old method : 0.005132436752319336 time for calcul the mask position with numpy : 0.05591773986816406 nb_pixel_total : 47265 time to create 1 rle with old method : 0.05295252799987793 time for calcul the mask position with numpy : 0.053710222244262695 nb_pixel_total : 30027 time to create 1 rle with old method : 0.03382420539855957 time for calcul the mask position with numpy : 0.055158138275146484 nb_pixel_total : 55853 time to create 1 rle with old method : 0.08212661743164062 time for calcul the mask position with numpy : 0.05397796630859375 nb_pixel_total : 41070 time to create 1 rle with old method : 0.05692911148071289 time for calcul the mask position with numpy : 0.062409400939941406 nb_pixel_total : 79408 time to create 1 rle with old method : 0.09216570854187012 time for calcul the mask position with numpy : 0.05444955825805664 nb_pixel_total : 59429 time to create 1 rle with old method : 0.06588172912597656 time for calcul the mask position with numpy : 0.054074764251708984 nb_pixel_total : 62881 time to create 1 rle with old method : 0.07421708106994629 time for calcul the mask position with numpy : 0.05866646766662598 nb_pixel_total : 25220 time to create 1 rle with old method : 0.028024673461914062 time for calcul the mask position with numpy : 0.054796457290649414 nb_pixel_total : 36190 time to create 1 rle with old method : 0.03960704803466797 time for calcul the mask position with numpy : 0.053534507751464844 nb_pixel_total : 173377 time to create 1 rle with new method : 1.855482578277588 time for calcul the mask position with numpy : 0.05365586280822754 nb_pixel_total : 62747 time to create 1 rle with old method : 0.06962895393371582 time for calcul the mask position with numpy : 0.05398058891296387 nb_pixel_total : 40169 time to create 1 rle with old method : 0.04611063003540039 time for calcul the mask position with numpy : 0.05364370346069336 nb_pixel_total : 39696 time to create 1 rle with old method : 0.04393744468688965 time for calcul the mask position with numpy : 0.05358767509460449 nb_pixel_total : 58214 time to create 1 rle with old method : 0.0663154125213623 time for calcul the mask position with numpy : 0.054162025451660156 nb_pixel_total : 38225 time to create 1 rle with old method : 0.04256772994995117 time for calcul the mask position with numpy : 0.054058074951171875 nb_pixel_total : 52021 time to create 1 rle with old method : 0.05825161933898926 time for calcul the mask position with numpy : 0.053839921951293945 nb_pixel_total : 2197 time to create 1 rle with old method : 0.003981590270996094 time for calcul the mask position with numpy : 0.053972482681274414 nb_pixel_total : 51429 time to create 1 rle with old method : 0.05808568000793457 time for calcul the mask position with numpy : 0.053133249282836914 nb_pixel_total : 84671 time to create 1 rle with old method : 0.09362459182739258 time for calcul the mask position with numpy : 0.05520939826965332 nb_pixel_total : 20538 time to create 1 rle with old method : 0.022222042083740234 time for calcul the mask position with numpy : 0.05164980888366699 nb_pixel_total : 4311 time to create 1 rle with old method : 0.004897117614746094 time for calcul the mask position with numpy : 0.0515286922454834 nb_pixel_total : 88181 time to create 1 rle with old method : 0.09465599060058594 time for calcul the mask position with numpy : 0.05197572708129883 nb_pixel_total : 1221 time to create 1 rle with old method : 0.0015866756439208984 time for calcul the mask position with numpy : 0.05161905288696289 nb_pixel_total : 41736 time to create 1 rle with old method : 0.04723167419433594 time for calcul the mask position with numpy : 0.06363606452941895 nb_pixel_total : 173648 time to create 1 rle with new method : 1.7499608993530273 time for calcul the mask position with numpy : 0.05384635925292969 nb_pixel_total : 6890 time to create 1 rle with old method : 0.008163690567016602 time for calcul the mask position with numpy : 0.05362057685852051 nb_pixel_total : 42392 time to create 1 rle with old method : 0.04828214645385742 time for calcul the mask position with numpy : 0.057242393493652344 nb_pixel_total : 376947 time to create 1 rle with new method : 1.780543565750122 time for calcul the mask position with numpy : 0.05443859100341797 nb_pixel_total : 71567 time to create 1 rle with old method : 0.08598732948303223 time for calcul the mask position with numpy : 0.056368112564086914 nb_pixel_total : 171999 time to create 1 rle with new method : 1.1511213779449463 time for calcul the mask position with numpy : 0.05376553535461426 nb_pixel_total : 55106 time to create 1 rle with old method : 0.06203460693359375 time for calcul the mask position with numpy : 0.0541996955871582 nb_pixel_total : 35916 time to create 1 rle with old method : 0.04381084442138672 time for calcul the mask position with numpy : 0.05470418930053711 nb_pixel_total : 222417 time to create 1 rle with new method : 1.5955586433410645 time for calcul the mask position with numpy : 0.055448055267333984 nb_pixel_total : 39682 time to create 1 rle with old method : 0.0446324348449707 time for calcul the mask position with numpy : 0.05633044242858887 nb_pixel_total : 22731 time to create 1 rle with old method : 0.03061819076538086 time for calcul the mask position with numpy : 0.054894208908081055 nb_pixel_total : 45820 time to create 1 rle with old method : 0.0550692081451416 time for calcul the mask position with numpy : 0.05697178840637207 nb_pixel_total : 115117 time to create 1 rle with old method : 0.13255071640014648 time for calcul the mask position with numpy : 0.06133627891540527 nb_pixel_total : 147224 time to create 1 rle with old method : 0.16518521308898926 time for calcul the mask position with numpy : 0.05944681167602539 nb_pixel_total : 182701 time to create 1 rle with new method : 1.2543399333953857 time for calcul the mask position with numpy : 0.053641557693481445 nb_pixel_total : 17041 time to create 1 rle with old method : 0.01924753189086914 time for calcul the mask position with numpy : 0.05425834655761719 nb_pixel_total : 107808 time to create 1 rle with old method : 0.1263725757598877 time for calcul the mask position with numpy : 0.054245948791503906 nb_pixel_total : 16100 time to create 1 rle with old method : 0.020710229873657227 time for calcul the mask position with numpy : 0.0548098087310791 nb_pixel_total : 92379 time to create 1 rle with old method : 0.10880470275878906 time for calcul the mask position with numpy : 0.05523490905761719 nb_pixel_total : 84800 time to create 1 rle with old method : 0.09601497650146484 time for calcul the mask position with numpy : 0.054837703704833984 nb_pixel_total : 89015 time to create 1 rle with old method : 0.09938168525695801 time for calcul the mask position with numpy : 0.05469083786010742 nb_pixel_total : 23403 time to create 1 rle with old method : 0.026596784591674805 time for calcul the mask position with numpy : 0.0543978214263916 nb_pixel_total : 47788 time to create 1 rle with old method : 0.05513477325439453 time for calcul the mask position with numpy : 0.05423474311828613 nb_pixel_total : 2759 time to create 1 rle with old method : 0.005352973937988281 time for calcul the mask position with numpy : 0.05361294746398926 nb_pixel_total : 4079 time to create 1 rle with old method : 0.006986141204833984 time for calcul the mask position with numpy : 0.07032537460327148 nb_pixel_total : 1373149 time to create 1 rle with new method : 3.0908455848693848 time for calcul the mask position with numpy : 0.05497264862060547 nb_pixel_total : 17606 time to create 1 rle with old method : 0.020123720169067383 time for calcul the mask position with numpy : 0.06259322166442871 nb_pixel_total : 26991 time to create 1 rle with old method : 0.03310108184814453 time for calcul the mask position with numpy : 0.06529712677001953 nb_pixel_total : 1130001 time to create 1 rle with new method : 1.6186151504516602 time for calcul the mask position with numpy : 0.05958247184753418 nb_pixel_total : 608786 time to create 1 rle with new method : 0.8492674827575684 time for calcul the mask position with numpy : 0.061576128005981445 nb_pixel_total : 8139 time to create 1 rle with old method : 0.0098876953125 time for calcul the mask position with numpy : 0.053453683853149414 nb_pixel_total : 864 time to create 1 rle with old method : 0.0015909671783447266 time for calcul the mask position with numpy : 0.05519413948059082 nb_pixel_total : 191712 time to create 1 rle with new method : 1.0138776302337646 time for calcul the mask position with numpy : 0.054065704345703125 nb_pixel_total : 19340 time to create 1 rle with old method : 0.021885395050048828 time for calcul the mask position with numpy : 0.05427408218383789 nb_pixel_total : 455 time to create 1 rle with old method : 0.0007660388946533203 time for calcul the mask position with numpy : 0.053707122802734375 nb_pixel_total : 439 time to create 1 rle with old method : 0.0011017322540283203 time for calcul the mask position with numpy : 0.05522656440734863 nb_pixel_total : 135575 time to create 1 rle with old method : 0.15147614479064941 time for calcul the mask position with numpy : 0.05402374267578125 nb_pixel_total : 41609 time to create 1 rle with old method : 0.04715228080749512 time for calcul the mask position with numpy : 0.0547633171081543 nb_pixel_total : 85322 time to create 1 rle with old method : 0.09569144248962402 time for calcul the mask position with numpy : 0.055047035217285156 nb_pixel_total : 19902 time to create 1 rle with old method : 0.022825241088867188 time for calcul the mask position with numpy : 0.05401158332824707 nb_pixel_total : 8314 time to create 1 rle with old method : 0.010218143463134766 time for calcul the mask position with numpy : 0.05414462089538574 nb_pixel_total : 21876 time to create 1 rle with old method : 0.024843215942382812 time for calcul the mask position with numpy : 0.05462217330932617 nb_pixel_total : 115285 time to create 1 rle with old method : 0.13105297088623047 time for calcul the mask position with numpy : 0.05785036087036133 nb_pixel_total : 256135 time to create 1 rle with new method : 0.5164260864257812 time for calcul the mask position with numpy : 0.05254054069519043 nb_pixel_total : 71790 time to create 1 rle with old method : 0.07883477210998535 time for calcul the mask position with numpy : 0.05335545539855957 nb_pixel_total : 166406 time to create 1 rle with new method : 0.5926048755645752 time for calcul the mask position with numpy : 0.05343174934387207 nb_pixel_total : 149 time to create 1 rle with old method : 0.0005040168762207031 time for calcul the mask position with numpy : 0.05429792404174805 nb_pixel_total : 66620 time to create 1 rle with old method : 0.0747222900390625 time for calcul the mask position with numpy : 0.05314373970031738 nb_pixel_total : 357 time to create 1 rle with old method : 0.0006890296936035156 time for calcul the mask position with numpy : 0.05503535270690918 nb_pixel_total : 22678 time to create 1 rle with old method : 0.032624006271362305 time for calcul the mask position with numpy : 0.061183929443359375 nb_pixel_total : 79106 time to create 1 rle with old method : 0.08639693260192871 time for calcul the mask position with numpy : 0.05149078369140625 nb_pixel_total : 14724 time to create 1 rle with old method : 0.016521453857421875 time for calcul the mask position with numpy : 0.05431079864501953 nb_pixel_total : 23408 time to create 1 rle with old method : 0.026736974716186523 time for calcul the mask position with numpy : 0.0540313720703125 nb_pixel_total : 31408 time to create 1 rle with old method : 0.042324066162109375 time for calcul the mask position with numpy : 0.06079602241516113 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004889965057373047 create new chi : 32.36950325965881 time to delete rle : 0.00812530517578125 batch 1 Loaded 97 chid ids of type : 4855 Number RLEs to save : 63766 TO DO : save crop sub photo not yet done ! save time : 3.7824008464813232 nb_obj : 84 nb_hashtags : 11 time to prepare the origin masks : 64.73885416984558 time for calcul the mask position with numpy : 1.259742021560669 nb_pixel_total : 4118507 time to create 1 rle with new method : 1.9926433563232422 time for calcul the mask position with numpy : 0.05719256401062012 nb_pixel_total : 30195 time to create 1 rle with old method : 0.03476214408874512 time for calcul the mask position with numpy : 0.053312063217163086 nb_pixel_total : 16884 time to create 1 rle with old method : 0.01928544044494629 time for calcul the mask position with numpy : 0.07188010215759277 nb_pixel_total : 322290 time to create 1 rle with new method : 1.8798680305480957 time for calcul the mask position with numpy : 0.05820012092590332 nb_pixel_total : 308624 time to create 1 rle with new method : 1.8083369731903076 time for calcul the mask position with numpy : 0.05650186538696289 nb_pixel_total : 132511 time to create 1 rle with old method : 0.14719152450561523 time for calcul the mask position with numpy : 0.05385184288024902 nb_pixel_total : 1342 time to create 1 rle with old method : 0.0019741058349609375 time for calcul the mask position with numpy : 0.052539825439453125 nb_pixel_total : 9595 time to create 1 rle with old method : 0.010918140411376953 time for calcul the mask position with numpy : 0.05355358123779297 nb_pixel_total : 59242 time to create 1 rle with old method : 0.06665182113647461 time for calcul the mask position with numpy : 0.05623435974121094 nb_pixel_total : 264311 time to create 1 rle with new method : 1.484100341796875 time for calcul the mask position with numpy : 0.05309128761291504 nb_pixel_total : 14777 time to create 1 rle with old method : 0.016379117965698242 time for calcul the mask position with numpy : 0.05380868911743164 nb_pixel_total : 333 time to create 1 rle with old method : 0.0005650520324707031 time for calcul the mask position with numpy : 0.05640602111816406 nb_pixel_total : 131575 time to create 1 rle with old method : 0.15375852584838867 time for calcul the mask position with numpy : 0.05194497108459473 nb_pixel_total : 126409 time to create 1 rle with old method : 0.13739442825317383 time for calcul the mask position with numpy : 0.052251338958740234 nb_pixel_total : 47208 time to create 1 rle with old method : 0.05311918258666992 time for calcul the mask position with numpy : 0.05315756797790527 nb_pixel_total : 38612 time to create 1 rle with old method : 0.04209542274475098 time for calcul the mask position with numpy : 0.050911903381347656 nb_pixel_total : 32390 time to create 1 rle with old method : 0.03421473503112793 time for calcul the mask position with numpy : 0.05079174041748047 nb_pixel_total : 44303 time to create 1 rle with old method : 0.04674220085144043 time for calcul the mask position with numpy : 0.05117201805114746 nb_pixel_total : 94665 time to create 1 rle with old method : 0.10230612754821777 time for calcul the mask position with numpy : 0.05237984657287598 nb_pixel_total : 94688 time to create 1 rle with old method : 0.10265016555786133 time for calcul the mask position with numpy : 0.051178932189941406 nb_pixel_total : 47000 time to create 1 rle with old method : 0.049971580505371094 time for calcul the mask position with numpy : 0.05127549171447754 nb_pixel_total : 35432 time to create 1 rle with old method : 0.03861546516418457 time for calcul the mask position with numpy : 0.05145072937011719 nb_pixel_total : 69331 time to create 1 rle with old method : 0.07397961616516113 time for calcul the mask position with numpy : 0.05062699317932129 nb_pixel_total : 33641 time to create 1 rle with old method : 0.035286903381347656 time for calcul the mask position with numpy : 0.050786495208740234 nb_pixel_total : 54134 time to create 1 rle with old method : 0.058103084564208984 time for calcul the mask position with numpy : 0.05248618125915527 nb_pixel_total : 152278 time to create 1 rle with new method : 2.6126790046691895 time for calcul the mask position with numpy : 0.05413031578063965 nb_pixel_total : 364048 time to create 1 rle with new method : 1.33638596534729 time for calcul the mask position with numpy : 0.05246257781982422 nb_pixel_total : 20245 time to create 1 rle with old method : 0.022699594497680664 time for calcul the mask position with numpy : 0.05334138870239258 nb_pixel_total : 78660 time to create 1 rle with old method : 0.1063544750213623 time for calcul the mask position with numpy : 0.05389809608459473 nb_pixel_total : 21762 time to create 1 rle with old method : 0.025021076202392578 time for calcul the mask position with numpy : 0.05243682861328125 nb_pixel_total : 289 time to create 1 rle with old method : 0.0005724430084228516 time for calcul the mask position with numpy : 0.055513858795166016 nb_pixel_total : 1131 time to create 1 rle with old method : 0.0021729469299316406 time for calcul the mask position with numpy : 0.060199737548828125 nb_pixel_total : 28127 time to create 1 rle with old method : 0.0333559513092041 time for calcul the mask position with numpy : 0.05428147315979004 nb_pixel_total : 58344 time to create 1 rle with old method : 0.06567955017089844 time for calcul the mask position with numpy : 0.0536348819732666 nb_pixel_total : 129377 time to create 1 rle with old method : 0.17418122291564941 time for calcul the mask position with numpy : 0.05526399612426758 nb_pixel_total : 222925 time to create 1 rle with new method : 1.9087915420532227 time for calcul the mask position with numpy : 0.05315685272216797 nb_pixel_total : 157656 time to create 1 rle with new method : 1.754643440246582 time for calcul the mask position with numpy : 0.05449080467224121 nb_pixel_total : 3011 time to create 1 rle with old method : 0.0038788318634033203 time for calcul the mask position with numpy : 0.055902719497680664 nb_pixel_total : 383052 time to create 1 rle with new method : 1.4106147289276123 time for calcul the mask position with numpy : 0.05253314971923828 nb_pixel_total : 42360 time to create 1 rle with old method : 0.046791791915893555 time for calcul the mask position with numpy : 0.05287647247314453 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007305145263671875 time for calcul the mask position with numpy : 0.053700923919677734 nb_pixel_total : 40537 time to create 1 rle with old method : 0.04468655586242676 time for calcul the mask position with numpy : 0.05313515663146973 nb_pixel_total : 63236 time to create 1 rle with old method : 0.08181023597717285 time for calcul the mask position with numpy : 0.053952932357788086 nb_pixel_total : 3947 time to create 1 rle with old method : 0.004958152770996094 time for calcul the mask position with numpy : 0.054061174392700195 nb_pixel_total : 79033 time to create 1 rle with old method : 0.08829164505004883 time for calcul the mask position with numpy : 0.060332298278808594 nb_pixel_total : 59855 time to create 1 rle with old method : 0.06409668922424316 time for calcul the mask position with numpy : 0.052788734436035156 nb_pixel_total : 12170 time to create 1 rle with old method : 0.01430964469909668 time for calcul the mask position with numpy : 0.05237102508544922 nb_pixel_total : 82205 time to create 1 rle with old method : 0.11343526840209961 time for calcul the mask position with numpy : 0.05366921424865723 nb_pixel_total : 4 time to create 1 rle with old method : 4.982948303222656e-05 time for calcul the mask position with numpy : 0.06921029090881348 nb_pixel_total : 616340 time to create 1 rle with new method : 0.8408920764923096 time for calcul the mask position with numpy : 0.05935978889465332 nb_pixel_total : 14362 time to create 1 rle with old method : 0.02173781394958496 time for calcul the mask position with numpy : 0.05423855781555176 nb_pixel_total : 114290 time to create 1 rle with old method : 0.13204383850097656 time for calcul the mask position with numpy : 0.05188894271850586 nb_pixel_total : 28764 time to create 1 rle with old method : 0.03296017646789551 time for calcul the mask position with numpy : 0.054082393646240234 nb_pixel_total : 236801 time to create 1 rle with new method : 1.108583688735962 time for calcul the mask position with numpy : 0.0514681339263916 nb_pixel_total : 129440 time to create 1 rle with old method : 0.1458754539489746 time for calcul the mask position with numpy : 0.056517601013183594 nb_pixel_total : 14403 time to create 1 rle with old method : 0.016487598419189453 time for calcul the mask position with numpy : 0.05405163764953613 nb_pixel_total : 166836 time to create 1 rle with new method : 1.2347545623779297 time for calcul the mask position with numpy : 0.06356525421142578 nb_pixel_total : 951948 time to create 1 rle with new method : 1.5397493839263916 time for calcul the mask position with numpy : 0.053900718688964844 nb_pixel_total : 200625 time to create 1 rle with new method : 1.616565227508545 time for calcul the mask position with numpy : 0.0538787841796875 nb_pixel_total : 35250 time to create 1 rle with old method : 0.03946995735168457 time for calcul the mask position with numpy : 0.05265307426452637 nb_pixel_total : 31252 time to create 1 rle with old method : 0.03539109230041504 time for calcul the mask position with numpy : 0.054129600524902344 nb_pixel_total : 72692 time to create 1 rle with old method : 0.0825204849243164 time for calcul the mask position with numpy : 0.05706191062927246 nb_pixel_total : 30442 time to create 1 rle with old method : 0.0341031551361084 time for calcul the mask position with numpy : 0.05582118034362793 nb_pixel_total : 165270 time to create 1 rle with new method : 1.5304253101348877 time for calcul the mask position with numpy : 0.050786733627319336 nb_pixel_total : 1788 time to create 1 rle with old method : 0.0025637149810791016 time for calcul the mask position with numpy : 0.05191326141357422 nb_pixel_total : 111066 time to create 1 rle with old method : 0.11942124366760254 time for calcul the mask position with numpy : 0.049916982650756836 nb_pixel_total : 15275 time to create 1 rle with old method : 0.017560720443725586 time for calcul the mask position with numpy : 0.053751230239868164 nb_pixel_total : 210423 time to create 1 rle with new method : 1.6989293098449707 time for calcul the mask position with numpy : 0.05128788948059082 nb_pixel_total : 2717 time to create 1 rle with old method : 0.0033545494079589844 time for calcul the mask position with numpy : 0.05018043518066406 nb_pixel_total : 10106 time to create 1 rle with old method : 0.011149883270263672 time for calcul the mask position with numpy : 0.05109524726867676 nb_pixel_total : 153347 time to create 1 rle with new method : 1.2111778259277344 time for calcul the mask position with numpy : 0.05037498474121094 nb_pixel_total : 22653 time to create 1 rle with old method : 0.02509331703186035 time for calcul the mask position with numpy : 0.05725812911987305 nb_pixel_total : 319650 time to create 1 rle with new method : 0.9095275402069092 time for calcul the mask position with numpy : 0.05372118949890137 nb_pixel_total : 133753 time to create 1 rle with old method : 0.1466681957244873 time for calcul the mask position with numpy : 0.05228781700134277 nb_pixel_total : 905 time to create 1 rle with old method : 0.0011568069458007812 time for calcul the mask position with numpy : 0.054605722427368164 nb_pixel_total : 207240 time to create 1 rle with new method : 1.4476392269134521 time for calcul the mask position with numpy : 0.0531003475189209 nb_pixel_total : 199308 time to create 1 rle with new method : 1.6815013885498047 time for calcul the mask position with numpy : 0.05457162857055664 nb_pixel_total : 454465 time to create 1 rle with new method : 1.7071974277496338 time for calcul the mask position with numpy : 0.05222964286804199 nb_pixel_total : 2730 time to create 1 rle with old method : 0.003242015838623047 time for calcul the mask position with numpy : 0.052165985107421875 nb_pixel_total : 44217 time to create 1 rle with old method : 0.04824328422546387 time for calcul the mask position with numpy : 0.052965402603149414 nb_pixel_total : 59086 time to create 1 rle with old method : 0.06535577774047852 time for calcul the mask position with numpy : 0.05202436447143555 nb_pixel_total : 9886 time to create 1 rle with old method : 0.011299371719360352 time for calcul the mask position with numpy : 0.0524139404296875 nb_pixel_total : 48871 time to create 1 rle with old method : 0.05292797088623047 time for calcul the mask position with numpy : 0.05298471450805664 nb_pixel_total : 18526 time to create 1 rle with old method : 0.02027130126953125 time for calcul the mask position with numpy : 0.05153036117553711 nb_pixel_total : 11714 time to create 1 rle with old method : 0.012638330459594727 create new chi : 42.963173389434814 time to delete rle : 0.008341550827026367 batch 1 Loaded 85 chid ids of type : 4855 Number RLEs to save : 71731 TO DO : save crop sub photo not yet done ! save time : 3.9375476837158203 nb_obj : 68 nb_hashtags : 10 time to prepare the origin masks : 58.02720499038696 time for calcul the mask position with numpy : 0.8986353874206543 nb_pixel_total : 3464919 time to create 1 rle with new method : 1.5577516555786133 time for calcul the mask position with numpy : 0.05366349220275879 nb_pixel_total : 21225 time to create 1 rle with old method : 0.02386188507080078 time for calcul the mask position with numpy : 0.05260586738586426 nb_pixel_total : 5445 time to create 1 rle with old method : 0.006749868392944336 time for calcul the mask position with numpy : 0.05505776405334473 nb_pixel_total : 261442 time to create 1 rle with new method : 2.1953463554382324 time for calcul the mask position with numpy : 0.05260634422302246 nb_pixel_total : 137217 time to create 1 rle with old method : 0.17667889595031738 time for calcul the mask position with numpy : 0.05447793006896973 nb_pixel_total : 74288 time to create 1 rle with old method : 0.08256363868713379 time for calcul the mask position with numpy : 0.05303454399108887 nb_pixel_total : 3215 time to create 1 rle with old method : 0.004030466079711914 time for calcul the mask position with numpy : 0.053487539291381836 nb_pixel_total : 136760 time to create 1 rle with old method : 0.15244603157043457 time for calcul the mask position with numpy : 0.05335569381713867 nb_pixel_total : 98665 time to create 1 rle with old method : 0.1086735725402832 time for calcul the mask position with numpy : 0.05279064178466797 nb_pixel_total : 29748 time to create 1 rle with old method : 0.03267407417297363 time for calcul the mask position with numpy : 0.053648948669433594 nb_pixel_total : 218542 time to create 1 rle with new method : 1.9690272808074951 time for calcul the mask position with numpy : 0.06616473197937012 nb_pixel_total : 324319 time to create 1 rle with new method : 1.5655303001403809 time for calcul the mask position with numpy : 0.052169084548950195 nb_pixel_total : 26134 time to create 1 rle with old method : 0.035233497619628906 time for calcul the mask position with numpy : 0.0613706111907959 nb_pixel_total : 51818 time to create 1 rle with old method : 0.05689287185668945 time for calcul the mask position with numpy : 0.05369853973388672 nb_pixel_total : 205383 time to create 1 rle with new method : 1.2421278953552246 time for calcul the mask position with numpy : 0.0522463321685791 nb_pixel_total : 6961 time to create 1 rle with old method : 0.008508920669555664 time for calcul the mask position with numpy : 0.05211901664733887 nb_pixel_total : 16657 time to create 1 rle with old method : 0.018138647079467773 time for calcul the mask position with numpy : 0.05962944030761719 nb_pixel_total : 428508 time to create 1 rle with new method : 2.5413708686828613 time for calcul the mask position with numpy : 0.054299354553222656 nb_pixel_total : 25777 time to create 1 rle with old method : 0.030455589294433594 time for calcul the mask position with numpy : 0.05365753173828125 nb_pixel_total : 33888 time to create 1 rle with old method : 0.03802680969238281 time for calcul the mask position with numpy : 0.05701637268066406 nb_pixel_total : 168628 time to create 1 rle with new method : 1.7215144634246826 time for calcul the mask position with numpy : 0.05646467208862305 nb_pixel_total : 3219 time to create 1 rle with old method : 0.004039764404296875 time for calcul the mask position with numpy : 0.054552555084228516 nb_pixel_total : 53309 time to create 1 rle with old method : 0.06304335594177246 time for calcul the mask position with numpy : 0.05373692512512207 nb_pixel_total : 37172 time to create 1 rle with old method : 0.041703224182128906 time for calcul the mask position with numpy : 0.05415630340576172 nb_pixel_total : 69953 time to create 1 rle with old method : 0.07909631729125977 time for calcul the mask position with numpy : 0.05567669868469238 nb_pixel_total : 70383 time to create 1 rle with old method : 0.07860755920410156 time for calcul the mask position with numpy : 0.06873536109924316 nb_pixel_total : 900278 time to create 1 rle with new method : 0.9917812347412109 time for calcul the mask position with numpy : 0.053731679916381836 nb_pixel_total : 32224 time to create 1 rle with old method : 0.037636756896972656 time for calcul the mask position with numpy : 0.05370950698852539 nb_pixel_total : 54568 time to create 1 rle with old method : 0.06125593185424805 time for calcul the mask position with numpy : 0.05506420135498047 nb_pixel_total : 242254 time to create 1 rle with new method : 2.0113778114318848 time for calcul the mask position with numpy : 0.055433034896850586 nb_pixel_total : 97903 time to create 1 rle with old method : 0.11131596565246582 time for calcul the mask position with numpy : 0.05460929870605469 nb_pixel_total : 5935 time to create 1 rle with old method : 0.0073397159576416016 time for calcul the mask position with numpy : 0.054784536361694336 nb_pixel_total : 213298 time to create 1 rle with new method : 1.3168315887451172 time for calcul the mask position with numpy : 0.05416440963745117 nb_pixel_total : 9622 time to create 1 rle with old method : 0.011493921279907227 time for calcul the mask position with numpy : 0.05379462242126465 nb_pixel_total : 112807 time to create 1 rle with old method : 0.126662015914917 time for calcul the mask position with numpy : 0.05963420867919922 nb_pixel_total : 57603 time to create 1 rle with old method : 0.07526659965515137 time for calcul the mask position with numpy : 0.058925628662109375 nb_pixel_total : 126023 time to create 1 rle with old method : 0.14705491065979004 time for calcul the mask position with numpy : 0.05345630645751953 nb_pixel_total : 116210 time to create 1 rle with old method : 0.12882685661315918 time for calcul the mask position with numpy : 0.05539417266845703 nb_pixel_total : 207286 time to create 1 rle with new method : 1.7632970809936523 time for calcul the mask position with numpy : 0.056123971939086914 nb_pixel_total : 181428 time to create 1 rle with new method : 1.3634138107299805 time for calcul the mask position with numpy : 0.05367136001586914 nb_pixel_total : 232489 time to create 1 rle with new method : 1.7517781257629395 time for calcul the mask position with numpy : 0.05507683753967285 nb_pixel_total : 146459 time to create 1 rle with old method : 0.1639866828918457 time for calcul the mask position with numpy : 0.06100583076477051 nb_pixel_total : 507038 time to create 1 rle with new method : 2.1818225383758545 time for calcul the mask position with numpy : 0.05395102500915527 nb_pixel_total : 26651 time to create 1 rle with old method : 0.030226469039916992 time for calcul the mask position with numpy : 0.07621932029724121 nb_pixel_total : 1314570 time to create 1 rle with new method : 1.5107307434082031 time for calcul the mask position with numpy : 0.05406475067138672 nb_pixel_total : 117607 time to create 1 rle with old method : 0.12940621376037598 time for calcul the mask position with numpy : 0.05433177947998047 nb_pixel_total : 89761 time to create 1 rle with old method : 0.10054326057434082 time for calcul the mask position with numpy : 0.05541682243347168 nb_pixel_total : 154235 time to create 1 rle with new method : 1.5863609313964844 time for calcul the mask position with numpy : 0.05718183517456055 nb_pixel_total : 37979 time to create 1 rle with old method : 0.05732893943786621 time for calcul the mask position with numpy : 0.0548245906829834 nb_pixel_total : 111752 time to create 1 rle with old method : 0.12981057167053223 time for calcul the mask position with numpy : 0.05664801597595215 nb_pixel_total : 57341 time to create 1 rle with old method : 0.06560969352722168 time for calcul the mask position with numpy : 0.061780452728271484 nb_pixel_total : 47679 time to create 1 rle with old method : 0.059626102447509766 time for calcul the mask position with numpy : 0.05555987358093262 nb_pixel_total : 226861 time to create 1 rle with new method : 1.4665923118591309 time for calcul the mask position with numpy : 0.05448102951049805 nb_pixel_total : 96688 time to create 1 rle with old method : 0.10788846015930176 time for calcul the mask position with numpy : 0.05824995040893555 nb_pixel_total : 256293 time to create 1 rle with new method : 1.3384218215942383 time for calcul the mask position with numpy : 0.05180549621582031 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005269050598144531 time for calcul the mask position with numpy : 0.05245089530944824 nb_pixel_total : 14754 time to create 1 rle with old method : 0.016696691513061523 time for calcul the mask position with numpy : 0.05328845977783203 nb_pixel_total : 189965 time to create 1 rle with new method : 0.9389026165008545 time for calcul the mask position with numpy : 0.058405160903930664 nb_pixel_total : 464548 time to create 1 rle with new method : 1.494767665863037 time for calcul the mask position with numpy : 0.05605506896972656 nb_pixel_total : 69744 time to create 1 rle with old method : 0.08058404922485352 time for calcul the mask position with numpy : 0.06028604507446289 nb_pixel_total : 23587 time to create 1 rle with old method : 0.02766728401184082 time for calcul the mask position with numpy : 0.053330183029174805 nb_pixel_total : 188673 time to create 1 rle with new method : 0.9623234272003174 time for calcul the mask position with numpy : 0.0521082878112793 nb_pixel_total : 41625 time to create 1 rle with old method : 0.0486607551574707 time for calcul the mask position with numpy : 0.060697078704833984 nb_pixel_total : 425 time to create 1 rle with old method : 0.0009372234344482422 time for calcul the mask position with numpy : 0.054448843002319336 nb_pixel_total : 90703 time to create 1 rle with old method : 0.09981727600097656 time for calcul the mask position with numpy : 0.054038286209106445 nb_pixel_total : 47805 time to create 1 rle with old method : 0.05257081985473633 time for calcul the mask position with numpy : 0.05476045608520508 nb_pixel_total : 74720 time to create 1 rle with old method : 0.08517861366271973 time for calcul the mask position with numpy : 0.05310535430908203 nb_pixel_total : 17824 time to create 1 rle with old method : 0.020702123641967773 time for calcul the mask position with numpy : 0.05335640907287598 nb_pixel_total : 11 time to create 1 rle with old method : 4.9114227294921875e-05 create new chi : 42.131513595581055 time to delete rle : 0.00613856315612793 batch 1 Loaded 69 chid ids of type : 4855 Number RLEs to save : 63298 TO DO : save crop sub photo not yet done ! save time : 3.413461208343506 nb_obj : 90 nb_hashtags : 9 time to prepare the origin masks : 62.134475231170654 time for calcul the mask position with numpy : 0.42159342765808105 nb_pixel_total : 4112348 time to create 1 rle with new method : 1.3398845195770264 time for calcul the mask position with numpy : 0.05409669876098633 nb_pixel_total : 3928 time to create 1 rle with old method : 0.004832029342651367 time for calcul the mask position with numpy : 0.05509233474731445 nb_pixel_total : 114703 time to create 1 rle with old method : 0.1259622573852539 time for calcul the mask position with numpy : 0.052780866622924805 nb_pixel_total : 27966 time to create 1 rle with old method : 0.03035283088684082 time for calcul the mask position with numpy : 0.0528254508972168 nb_pixel_total : 169593 time to create 1 rle with new method : 1.6945300102233887 time for calcul the mask position with numpy : 0.07027554512023926 nb_pixel_total : 670837 time to create 1 rle with new method : 1.7124037742614746 time for calcul the mask position with numpy : 0.05688047409057617 nb_pixel_total : 49269 time to create 1 rle with old method : 0.0574650764465332 time for calcul the mask position with numpy : 0.05372333526611328 nb_pixel_total : 15663 time to create 1 rle with old method : 0.017800331115722656 time for calcul the mask position with numpy : 0.054123878479003906 nb_pixel_total : 37899 time to create 1 rle with old method : 0.04265856742858887 time for calcul the mask position with numpy : 0.06275773048400879 nb_pixel_total : 360483 time to create 1 rle with new method : 1.1079890727996826 time for calcul the mask position with numpy : 0.05063033103942871 nb_pixel_total : 4782 time to create 1 rle with old method : 0.005300283432006836 time for calcul the mask position with numpy : 0.05058789253234863 nb_pixel_total : 61643 time to create 1 rle with old method : 0.06800961494445801 time for calcul the mask position with numpy : 0.08178281784057617 nb_pixel_total : 46482 time to create 1 rle with old method : 0.05856943130493164 time for calcul the mask position with numpy : 0.05319666862487793 nb_pixel_total : 71435 time to create 1 rle with old method : 0.09491610527038574 time for calcul the mask position with numpy : 0.052670955657958984 nb_pixel_total : 327431 time to create 1 rle with new method : 1.281609296798706 time for calcul the mask position with numpy : 0.055069684982299805 nb_pixel_total : 39342 time to create 1 rle with old method : 0.05542778968811035 time for calcul the mask position with numpy : 0.06385493278503418 nb_pixel_total : 1048 time to create 1 rle with old method : 0.0015604496002197266 time for calcul the mask position with numpy : 0.05727696418762207 nb_pixel_total : 100729 time to create 1 rle with old method : 0.11577391624450684 time for calcul the mask position with numpy : 0.05366158485412598 nb_pixel_total : 52071 time to create 1 rle with old method : 0.058068275451660156 time for calcul the mask position with numpy : 0.05379176139831543 nb_pixel_total : 42815 time to create 1 rle with old method : 0.04794907569885254 time for calcul the mask position with numpy : 0.058213233947753906 nb_pixel_total : 156084 time to create 1 rle with new method : 1.38777756690979 time for calcul the mask position with numpy : 0.05394744873046875 nb_pixel_total : 72165 time to create 1 rle with old method : 0.08703398704528809 time for calcul the mask position with numpy : 0.061057090759277344 nb_pixel_total : 49228 time to create 1 rle with old method : 0.05466198921203613 time for calcul the mask position with numpy : 0.054134368896484375 nb_pixel_total : 31906 time to create 1 rle with old method : 0.0353703498840332 time for calcul the mask position with numpy : 0.05242586135864258 nb_pixel_total : 118701 time to create 1 rle with old method : 0.1300215721130371 time for calcul the mask position with numpy : 0.05394434928894043 nb_pixel_total : 7020 time to create 1 rle with old method : 0.008317232131958008 time for calcul the mask position with numpy : 0.053888797760009766 nb_pixel_total : 50277 time to create 1 rle with old method : 0.055960655212402344 time for calcul the mask position with numpy : 0.052030324935913086 nb_pixel_total : 12799 time to create 1 rle with old method : 0.01419830322265625 time for calcul the mask position with numpy : 0.05241990089416504 nb_pixel_total : 54330 time to create 1 rle with old method : 0.06368875503540039 time for calcul the mask position with numpy : 0.05409407615661621 nb_pixel_total : 119935 time to create 1 rle with old method : 0.13070940971374512 time for calcul the mask position with numpy : 0.05126762390136719 nb_pixel_total : 3621 time to create 1 rle with old method : 0.004519462585449219 time for calcul the mask position with numpy : 0.05295133590698242 nb_pixel_total : 181876 time to create 1 rle with new method : 1.4799621105194092 time for calcul the mask position with numpy : 0.05269813537597656 nb_pixel_total : 20674 time to create 1 rle with old method : 0.022697925567626953 time for calcul the mask position with numpy : 0.051026344299316406 nb_pixel_total : 114024 time to create 1 rle with old method : 0.12307286262512207 time for calcul the mask position with numpy : 0.049989938735961914 nb_pixel_total : 113 time to create 1 rle with old method : 0.0003390312194824219 time for calcul the mask position with numpy : 0.05097246170043945 nb_pixel_total : 215297 time to create 1 rle with new method : 1.3582477569580078 time for calcul the mask position with numpy : 0.05642843246459961 nb_pixel_total : 76309 time to create 1 rle with old method : 0.08427166938781738 time for calcul the mask position with numpy : 0.052275657653808594 nb_pixel_total : 167432 time to create 1 rle with new method : 1.7901978492736816 time for calcul the mask position with numpy : 0.05487656593322754 nb_pixel_total : 261631 time to create 1 rle with new method : 1.5740725994110107 time for calcul the mask position with numpy : 0.05965423583984375 nb_pixel_total : 720038 time to create 1 rle with new method : 1.4712271690368652 time for calcul the mask position with numpy : 0.05574607849121094 nb_pixel_total : 124779 time to create 1 rle with old method : 0.14376211166381836 time for calcul the mask position with numpy : 0.05503082275390625 nb_pixel_total : 134883 time to create 1 rle with old method : 0.14963912963867188 time for calcul the mask position with numpy : 0.05373358726501465 nb_pixel_total : 2325 time to create 1 rle with old method : 0.003080606460571289 time for calcul the mask position with numpy : 0.05462288856506348 nb_pixel_total : 97769 time to create 1 rle with old method : 0.11036801338195801 time for calcul the mask position with numpy : 0.05467081069946289 nb_pixel_total : 12969 time to create 1 rle with old method : 0.014414548873901367 time for calcul the mask position with numpy : 0.055396318435668945 nb_pixel_total : 112692 time to create 1 rle with old method : 0.1239769458770752 time for calcul the mask position with numpy : 0.05259847640991211 nb_pixel_total : 3486 time to create 1 rle with old method : 0.004209756851196289 time for calcul the mask position with numpy : 0.05342435836791992 nb_pixel_total : 12683 time to create 1 rle with old method : 0.01443624496459961 time for calcul the mask position with numpy : 0.05259561538696289 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005633831024169922 time for calcul the mask position with numpy : 0.05216407775878906 nb_pixel_total : 18068 time to create 1 rle with old method : 0.020447969436645508 time for calcul the mask position with numpy : 0.055980682373046875 nb_pixel_total : 151896 time to create 1 rle with new method : 0.6275279521942139 time for calcul the mask position with numpy : 0.05475306510925293 nb_pixel_total : 46582 time to create 1 rle with old method : 0.05234503746032715 time for calcul the mask position with numpy : 0.053687095642089844 nb_pixel_total : 34137 time to create 1 rle with old method : 0.03843855857849121 time for calcul the mask position with numpy : 0.06949663162231445 nb_pixel_total : 774860 time to create 1 rle with new method : 1.7630412578582764 time for calcul the mask position with numpy : 0.05408740043640137 nb_pixel_total : 17342 time to create 1 rle with old method : 0.020504474639892578 time for calcul the mask position with numpy : 0.05553388595581055 nb_pixel_total : 547 time to create 1 rle with old method : 0.0012004375457763672 time for calcul the mask position with numpy : 0.05517172813415527 nb_pixel_total : 185958 time to create 1 rle with new method : 1.2903740406036377 time for calcul the mask position with numpy : 0.054949045181274414 nb_pixel_total : 130918 time to create 1 rle with old method : 0.1482689380645752 time for calcul the mask position with numpy : 0.05450940132141113 nb_pixel_total : 515 time to create 1 rle with old method : 0.0008814334869384766 time for calcul the mask position with numpy : 0.05553770065307617 nb_pixel_total : 90988 time to create 1 rle with old method : 0.10171318054199219 time for calcul the mask position with numpy : 0.060065269470214844 nb_pixel_total : 122 time to create 1 rle with old method : 0.00019693374633789062 time for calcul the mask position with numpy : 0.053533077239990234 nb_pixel_total : 5996 time to create 1 rle with old method : 0.0072977542877197266 time for calcul the mask position with numpy : 0.05464673042297363 nb_pixel_total : 101020 time to create 1 rle with old method : 0.1134023666381836 time for calcul the mask position with numpy : 0.05464315414428711 nb_pixel_total : 163965 time to create 1 rle with new method : 1.4186434745788574 time for calcul the mask position with numpy : 0.053924560546875 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0019314289093017578 time for calcul the mask position with numpy : 0.05414891242980957 nb_pixel_total : 4854 time to create 1 rle with old method : 0.006047487258911133 time for calcul the mask position with numpy : 0.0538785457611084 nb_pixel_total : 12360 time to create 1 rle with old method : 0.013659238815307617 time for calcul the mask position with numpy : 0.053719282150268555 nb_pixel_total : 103 time to create 1 rle with old method : 0.0005235671997070312 time for calcul the mask position with numpy : 0.05396127700805664 nb_pixel_total : 69640 time to create 1 rle with old method : 0.07756853103637695 time for calcul the mask position with numpy : 0.05437159538269043 nb_pixel_total : 25212 time to create 1 rle with old method : 0.027936458587646484 time for calcul the mask position with numpy : 0.05865025520324707 nb_pixel_total : 340823 time to create 1 rle with new method : 1.266993761062622 time for calcul the mask position with numpy : 0.05373215675354004 nb_pixel_total : 42166 time to create 1 rle with old method : 0.04873514175415039 time for calcul the mask position with numpy : 0.054633140563964844 nb_pixel_total : 64340 time to create 1 rle with old method : 0.0808110237121582 time for calcul the mask position with numpy : 0.05459856986999512 nb_pixel_total : 2643 time to create 1 rle with old method : 0.0033583641052246094 time for calcul the mask position with numpy : 0.054604291915893555 nb_pixel_total : 11241 time to create 1 rle with old method : 0.013155698776245117 time for calcul the mask position with numpy : 0.05623292922973633 nb_pixel_total : 1622 time to create 1 rle with old method : 0.002279996871948242 time for calcul the mask position with numpy : 0.05650472640991211 nb_pixel_total : 15370 time to create 1 rle with old method : 0.018393278121948242 time for calcul the mask position with numpy : 0.05698037147521973 nb_pixel_total : 180735 time to create 1 rle with new method : 1.2935190200805664 time for calcul the mask position with numpy : 0.06421422958374023 nb_pixel_total : 546073 time to create 1 rle with new method : 1.2476093769073486 time for calcul the mask position with numpy : 0.061583757400512695 nb_pixel_total : 20670 time to create 1 rle with old method : 0.02813720703125 time for calcul the mask position with numpy : 0.059325456619262695 nb_pixel_total : 128889 time to create 1 rle with old method : 0.14670944213867188 time for calcul the mask position with numpy : 0.05529284477233887 nb_pixel_total : 78710 time to create 1 rle with old method : 0.09119224548339844 time for calcul the mask position with numpy : 0.05471515655517578 nb_pixel_total : 12822 time to create 1 rle with old method : 0.019031047821044922 time for calcul the mask position with numpy : 0.056427955627441406 nb_pixel_total : 86855 time to create 1 rle with old method : 0.09885406494140625 time for calcul the mask position with numpy : 0.0561060905456543 nb_pixel_total : 16579 time to create 1 rle with old method : 0.018754005432128906 time for calcul the mask position with numpy : 0.05535173416137695 nb_pixel_total : 91465 time to create 1 rle with old method : 0.12060713768005371 time for calcul the mask position with numpy : 0.05888485908508301 nb_pixel_total : 10208 time to create 1 rle with old method : 0.011411666870117188 time for calcul the mask position with numpy : 0.05543327331542969 nb_pixel_total : 31060 time to create 1 rle with old method : 0.04439210891723633 time for calcul the mask position with numpy : 0.05432939529418945 nb_pixel_total : 147547 time to create 1 rle with old method : 0.19632172584533691 time for calcul the mask position with numpy : 0.054677724838256836 nb_pixel_total : 60562 time to create 1 rle with old method : 0.08362460136413574 time for calcul the mask position with numpy : 0.055164337158203125 nb_pixel_total : 6612 time to create 1 rle with old method : 0.009680032730102539 create new chi : 35.20202445983887 time to delete rle : 0.00983428955078125 batch 1 Loaded 91 chid ids of type : 4855 Number RLEs to save : 69584 TO DO : save crop sub photo not yet done ! save time : 3.8024704456329346 nb_obj : 14 nb_hashtags : 6 time to prepare the origin masks : 30.6339054107666 time for calcul the mask position with numpy : 0.0843052864074707 nb_pixel_total : 2360816 time to create 1 rle with new method : 1.3476064205169678 time for calcul the mask position with numpy : 0.05922198295593262 nb_pixel_total : 17882 time to create 1 rle with old method : 0.020197391510009766 time for calcul the mask position with numpy : 0.04118824005126953 nb_pixel_total : 12977 time to create 1 rle with old method : 0.014947891235351562 time for calcul the mask position with numpy : 0.03927302360534668 nb_pixel_total : 70 time to create 1 rle with old method : 0.00015425682067871094 time for calcul the mask position with numpy : 0.03782033920288086 nb_pixel_total : 45287 time to create 1 rle with old method : 0.049283504486083984 time for calcul the mask position with numpy : 0.03699445724487305 nb_pixel_total : 83 time to create 1 rle with old method : 0.00012254714965820312 time for calcul the mask position with numpy : 0.03665328025817871 nb_pixel_total : 1149 time to create 1 rle with old method : 0.0015082359313964844 time for calcul the mask position with numpy : 0.04001951217651367 nb_pixel_total : 29372 time to create 1 rle with old method : 0.03307843208312988 time for calcul the mask position with numpy : 0.03865480422973633 nb_pixel_total : 3954 time to create 1 rle with old method : 0.004442930221557617 time for calcul the mask position with numpy : 0.03764700889587402 nb_pixel_total : 30155 time to create 1 rle with old method : 0.03315138816833496 time for calcul the mask position with numpy : 0.03964829444885254 nb_pixel_total : 27004 time to create 1 rle with old method : 0.030730724334716797 time for calcul the mask position with numpy : 0.08160924911499023 nb_pixel_total : 3778369 time to create 1 rle with new method : 0.9872784614562988 time for calcul the mask position with numpy : 0.05094313621520996 nb_pixel_total : 1132865 time to create 1 rle with new method : 1.2351069450378418 time for calcul the mask position with numpy : 0.06567883491516113 nb_pixel_total : 127043 time to create 1 rle with old method : 0.14994359016418457 time for calcul the mask position with numpy : 0.40729832649230957 nb_pixel_total : 5412174 time to create 1 rle with new method : 1.2249011993408203 create new chi : 6.421730279922485 time to delete rle : 0.0019996166229248047 batch 1 Loaded 15 chid ids of type : 4855 Number RLEs to save : 22481 TO DO : save crop sub photo not yet done ! save time : 1.7063801288604736 map_output_result : {1349041168: (0.4441234649987248, 'Should be the crop_list due to order', 0.20573836328410156), 1349041164: (0.4441234649987248, 'Should be the crop_list due to order', 0.26324731264554735), 1349041154: (0.4441234649987248, 'Should be the crop_list due to order', 0.3323361656428346), 1349041147: (0.4441234649987248, 'Should be the crop_list due to order', 0.41716339206229547), 1349041131: (0.4441234649987248, 'Should be the crop_list due to order', 0.39309813347915373), 1349041117: (0.4441234649987248, 'Should be the crop_list due to order', 0.5320632960506361), 1349040967: (0.4441234649987248, 'Should be the crop_list due to order', 0.9652175918265052)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1349041168, 1349041164, 1349041154, 1349041147, 1349041131, 1349041117, 1349040967] Looping around the photos to save general results len do output : 7 /1349041168.Didn't retrieve data . /1349041164.Didn't retrieve data . /1349041154.Didn't retrieve data . /1349041147.Didn't retrieve data . /1349041131.Didn't retrieve data . /1349041117.Didn't retrieve data . /1349040967.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041168', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041164', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041154', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041147', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041131', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041117', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349040967', None, None, None, None, None, '2709794') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.348416805267334 save_final save missing photos in datou_result : time spend for datou_step_exec : 647.0116124153137 time spend to save output : 0.35111331939697266 total time spend for step 5 : 647.3627257347107 step6:crop_condition Tue Apr 1 11:16:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 505 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 70 About to insert : list_path_to_insert length 70 new photo from crops ! About to upload 70 photos upload in portfolio : 3015255 init cache_photo without model_param we have 70 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499099_253855 we have uploaded 70 photos in the portfolio 3015255 time of upload the photos Elapsed time : 29.6402268409729 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 73 About to insert : list_path_to_insert length 73 new photo from crops ! About to upload 73 photos upload in portfolio : 3015255 init cache_photo without model_param we have 73 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499187_253855 we have uploaded 73 photos in the portfolio 3015255 time of upload the photos Elapsed time : 22.377212047576904 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3015255 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499219_253855 we have uploaded 27 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.948786735534668 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3015255 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499239_253855 we have uploaded 17 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.5486531257629395 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499253_253855 we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.4285686016082764 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499259_253855 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.000227928161621 we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3015255 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499304_253855 we have uploaded 33 photos in the portfolio 3015255 time of upload the photos Elapsed time : 12.988045454025269 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3015255 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499322_253855 we have uploaded 5 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.759462594985962 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 3015255 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499367_253855 we have uploaded 48 photos in the portfolio 3015255 time of upload the photos Elapsed time : 17.404826879501343 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499388_253855 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5429582595825195 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3015255 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499405_253855 we have uploaded 20 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.071142196655273 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 3015255 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743499486_253855 we have uploaded 48 photos in the portfolio 3015255 time of upload the photos Elapsed time : 19.355584621429443 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1349041168, 1349041164, 1349041154, 1349041147, 1349041131, 1349041117, 1349040967] Looping around the photos to save general results len do output : 347 /1349255685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349255759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349256999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349257015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041168', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041164', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041154', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041147', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041131', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041117', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349040967', None, None, None, None, None, '2709794') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1048 time used for this insertion : 1.1048476696014404 save_final save missing photos in datou_result : time spend for datou_step_exec : 489.8551721572876 time spend to save output : 1.1443109512329102 total time spend for step 6 : 490.9994831085205 step7:ventilate_hashtags_in_portfolio Tue Apr 1 11:25:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21916090 get user id for portfolio 21916090 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916090 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916090 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916090 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916090 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/21943479,21943480,21943481,21943482,21943483,21943488,21943490,21943491,21943492,21943493,21943494,21943495,21943497,21943498,21943499,21943500,21943501,21943502,21943503,21943504?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21916090 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1349041168, 1349041164, 1349041154, 1349041147, 1349041131, 1349041117, 1349040967] Looping around the photos to save general results len do output : 1 /21916090. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041168', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041164', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041154', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041147', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041131', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041117', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349040967', None, None, None, None, None, '2709794') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.12815260887145996 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.848000764846802 time spend to save output : 0.12862849235534668 total time spend for step 7 : 11.976629257202148 step8:final Tue Apr 1 11:25:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1349041168: ('0.3976190150949056',), 1349041164: ('0.3976190150949056',), 1349041154: ('0.3976190150949056',), 1349041147: ('0.3976190150949056',), 1349041131: ('0.3976190150949056',), 1349041117: ('0.3976190150949056',), 1349040967: ('0.3976190150949056',)} new output for save of step final : {1349041168: ('0.3976190150949056',), 1349041164: ('0.3976190150949056',), 1349041154: ('0.3976190150949056',), 1349041147: ('0.3976190150949056',), 1349041131: ('0.3976190150949056',), 1349041117: ('0.3976190150949056',), 1349040967: ('0.3976190150949056',)} [1349041168, 1349041164, 1349041154, 1349041147, 1349041131, 1349041117, 1349040967] Looping around the photos to save general results len do output : 7 /1349041168.Didn't retrieve data . /1349041164.Didn't retrieve data . /1349041154.Didn't retrieve data . /1349041147.Didn't retrieve data . /1349041131.Didn't retrieve data . /1349041117.Didn't retrieve data . /1349040967.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041168', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041164', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041154', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041147', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041131', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041117', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349040967', None, None, None, None, None, '2709794') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.012383699417114258 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1121973991394043 time spend to save output : 0.012710332870483398 total time spend for step 8 : 0.1249077320098877 step9:velours_tree Tue Apr 1 11:25:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.26863789558410645 time spend to save output : 3.814697265625e-05 total time spend for step 9 : 0.2686760425567627 step10:send_mail_cod Tue Apr 1 11:25:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21916090_01-04-2025_11_25_22.pdf 21943453 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219434531743499522 21943454 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219434541743499524 21943455 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219434551743499526 21943456 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219434561743499527 21943457 change filename to text .change filename to text .change filename to text .change filename to text .imagette219434571743499529 21943458 change filename to text .imagette219434581743499529 21943459 imagette219434591743499529 21943460 imagette219434601743499529 21943461 imagette219434611743499529 21943462 imagette219434621743499529 21943463 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219434631743499529 21943464 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219434641743499531 21943465 imagette219434651743499532 21943466 imagette219434661743499532 21943467 imagette219434671743499532 21943468 imagette219434681743499532 21943469 imagette219434691743499532 21943470 change filename to text .imagette219434701743499532 21943471 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219434711743499532 21943473 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219434731743499533 21943474 imagette219434741743499535 21943475 imagette219434751743499535 21943476 imagette219434761743499535 21943477 imagette219434771743499535 21943478 imagette219434781743499535 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21916090 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21943479,21943480,21943481,21943482,21943483,21943488,21943490,21943491,21943492,21943493,21943494,21943495,21943497,21943498,21943499,21943500,21943501,21943502,21943503,21943504?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21916090 your option no_mail is active, we will not send the real mail to your client args[1349041168] : ((1349041168, 2110.8450056297497, 492609224), (1349041168, -0.22477948989137442, 496442774), '0.3976190150949056') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349041164] : ((1349041164, 1031.6186350648197, 2107751945), (1349041164, -0.1223113290779035, 496442774), '0.3976190150949056') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349041154] : ((1349041154, 636.576680645326, 492688767), (1349041154, -0.17547476439581614, 496442774), '0.3976190150949056') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349041147] : ((1349041147, 1249.610931132207, 2107751945), (1349041147, -0.30061787749925567, 496442774), '0.3976190150949056') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349041131] : ((1349041131, 3335.8826189881606, 492609224), (1349041131, -0.230651933507519, 496442774), '0.3976190150949056') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349041117] : ((1349041117, 2431.3849205165825, 492609224), (1349041117, -0.27948312147375065, 496442774), '0.3976190150949056') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349040967] : ((1349040967, 1326.6687168376432, 2107751945), (1349040967, -0.546348266845591, 501862349), '0.3976190150949056') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.3976190150949056 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21916090_01-04-2025_11_25_22.pdf results_Auto_P21916090_01-04-2025_11_25_22.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21916090_01-04-2025_11_25_22.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','21916090','results_Auto_P21916090_01-04-2025_11_25_22.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21916090_01-04-2025_11_25_22.pdf','pdf','','3.3','0.3976190150949056') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1349041168, 1349041164, 1349041154, 1349041147, 1349041131, 1349041117, 1349040967] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041168', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041164', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041154', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041147', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041131', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041117', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349040967', None, None, None, None, None, '2709794') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.013693571090698242 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.378913164138794 time spend to save output : 0.014053821563720703 total time spend for step 10 : 18.392966985702515 step11:split_time_score Tue Apr 1 11:25:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('25', 1), ('26', 2), ('27', 4)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20022025 21916090 Nombre de photos uploadées : 7 / 23040 (0%) 20022025 21916090 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 20022025 21916090 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 4.291534423828125e-06 elapsed_time : order_list_meta_photo_and_scores 1.1920928955078125e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0004940032958984375 elapsed_time : insert_dashboard_record_day_entry 0.025699377059936523 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.3741446335319554 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21916087_01-04-2025_01_00_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21916087 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916087 AND mptpi.`type`=4855 To do Qualite : 0.4979083931972827 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21916088_01-04-2025_07_58_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21916088 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916088 AND mptpi.`type`=4855 To do Qualite : 0.6367444636219008 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21916089_01-04-2025_01_11_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21916089 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916089 AND mptpi.`type`=4855 To do Qualite : 0.3976190150949056 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21916090_01-04-2025_11_25_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21916090 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916090 AND mptpi.`type`=4855 To do Qualite : 0.525217096723536 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21916092_01-04-2025_01_34_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21916092 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916092 AND mptpi.`type`=4855 To do Qualite : 0.4980890661554585 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21916093_01-04-2025_01_43_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21916093 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21916093 AND mptpi.`type`=4855 To do Qualite : 0.5211586715670522 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21919644_01-04-2025_05_47_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21919644 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21919644 AND mptpi.`type`=4855 To do Qualite : 0.44233934358721044 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21919645_31-03-2025_19_47_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21919645 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21919645 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20022025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1349041168, 1349041164, 1349041154, 1349041147, 1349041131, 1349041117, 1349040967] Looping around the photos to save general results len do output : 1 /21916090Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041168', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041164', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041154', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041147', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041131', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349041117', None, None, None, None, None, '2709794') ('4741', None, None, None, None, None, None, None, '2709794') ('4741', '21916090', '1349040967', None, None, None, None, None, '2709794') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.5512063503265381 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7872745990753174 time spend to save output : 0.5514388084411621 total time spend for step 11 : 1.3387134075164795 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 874.02user 455.41system 24:18.67elapsed 91%CPU (0avgtext+0avgdata 9129132maxresident)k 3232992inputs+870896outputs (79118major+72789560minor)pagefaults 0swaps