python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2414188 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2799185'] with mtr_portfolio_ids : ['22731300'] and first list_photo_ids : [] new path : /proc/2414188/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 2.0543479919433594 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue May 6 23:01:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5083 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-06 23:01:33.396884: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-06 23:01:33.423336: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-06 23:01:33.425112: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f1bf8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-06 23:01:33.425183: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-06 23:01:33.428747: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-06 23:01:33.592488: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x12eaaeb0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-06 23:01:33.592570: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-06 23:01:33.593217: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 23:01:33.593908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 23:01:33.597740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 23:01:33.600435: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 23:01:33.601908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 23:01:33.604793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 23:01:33.606199: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 23:01:33.612855: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 23:01:33.614342: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 23:01:33.614498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 23:01:33.615248: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 23:01:33.615271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 23:01:33.615281: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 23:01:33.616498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4631 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-06 23:01:33.943143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 23:01:33.943251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 23:01:33.943278: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 23:01:33.943301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 23:01:33.943323: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 23:01:33.943345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 23:01:33.943366: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 23:01:33.943388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 23:01:33.944619: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 23:01:33.945996: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 23:01:33.946040: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 23:01:33.946066: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 23:01:33.946087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 23:01:33.946122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 23:01:33.946143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 23:01:33.946164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 23:01:33.946184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 23:01:33.947419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 23:01:33.947459: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 23:01:33.947471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 23:01:33.947481: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 23:01:33.948745: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4631 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-06 23:01:49.411635: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 23:01:49.678510: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 23:01:51.457561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.458518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.459019: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.459497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.459994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.460463: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.460932: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.460969: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.461511: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.461529: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.467830: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.467878: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.468361: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.468377: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.474380: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.474438: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.474952: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.474973: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.501363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.501429: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.501919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.501935: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.507320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.507367: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.507892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.507939: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 23:01:51.536050: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.536579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.538142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.538632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.575101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.575731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.577768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.578323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.606046: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.606698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.608554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.609202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.615996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.617000: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.628666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.629613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.661017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.661579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.663176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.663724: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.721022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.721655: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.722155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.722650: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.726409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.727021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.743978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.744568: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.745137: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.745742: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.759007: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.759647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.760186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.760717: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.765474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.766073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.771543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.772139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.784815: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.785445: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.789777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.790316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.790849: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.791444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.792801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.793349: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.804140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.804807: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.805428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.805988: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.806548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.807127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.807686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.808194: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.817977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.818536: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.825299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.825879: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.870405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.871053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.871586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.872101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.880531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.881117: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.897282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.897871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.898417: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.898941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.903073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.903639: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.904195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.904736: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.906049: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.906077: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-06 23:01:51.916401: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.916988: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.926643: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.927290: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.927892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.928444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.929017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 23:01:51.929561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 2414456 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 113 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1306 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.8550839424133301 nb_pixel_total : 2344993 time to create 1 rle with new method : 0.5600135326385498 length of segment : 3577 time for calcul the mask position with numpy : 0.042151689529418945 nb_pixel_total : 1489985 time to create 1 rle with new method : 0.7937626838684082 length of segment : 4626 time for calcul the mask position with numpy : 0.012029647827148438 nb_pixel_total : 636708 time to create 1 rle with new method : 0.9739792346954346 length of segment : 3079 time for calcul the mask position with numpy : 0.002711772918701172 nb_pixel_total : 197563 time to create 1 rle with new method : 0.0065691471099853516 length of segment : 1007 time for calcul the mask position with numpy : 0.031054973602294922 nb_pixel_total : 765174 time to create 1 rle with new method : 0.11472105979919434 length of segment : 2654 time for calcul the mask position with numpy : 0.00585627555847168 nb_pixel_total : 297210 time to create 1 rle with new method : 0.010715246200561523 length of segment : 1101 time for calcul the mask position with numpy : 1.0532035827636719 nb_pixel_total : 1295291 time to create 1 rle with new method : 0.6843600273132324 length of segment : 3228 time for calcul the mask position with numpy : 0.00990438461303711 nb_pixel_total : 408701 time to create 1 rle with new method : 0.17831730842590332 length of segment : 1520 time for calcul the mask position with numpy : 0.0020182132720947266 nb_pixel_total : 59353 time to create 1 rle with old method : 0.07012128829956055 length of segment : 256 time for calcul the mask position with numpy : 0.002974987030029297 nb_pixel_total : 130024 time to create 1 rle with old method : 0.1473100185394287 length of segment : 671 time for calcul the mask position with numpy : 0.004287242889404297 nb_pixel_total : 121684 time to create 1 rle with old method : 0.16255712509155273 length of segment : 413 time for calcul the mask position with numpy : 0.0033104419708251953 nb_pixel_total : 100205 time to create 1 rle with old method : 0.12601327896118164 length of segment : 389 time for calcul the mask position with numpy : 0.0013117790222167969 nb_pixel_total : 24289 time to create 1 rle with old method : 0.0283963680267334 length of segment : 220 time for calcul the mask position with numpy : 0.029684066772460938 nb_pixel_total : 801293 time to create 1 rle with new method : 0.60186767578125 length of segment : 1073 time for calcul the mask position with numpy : 0.0017032623291015625 nb_pixel_total : 46790 time to create 1 rle with old method : 0.05222606658935547 length of segment : 316 time for calcul the mask position with numpy : 0.0012035369873046875 nb_pixel_total : 37459 time to create 1 rle with old method : 0.043087005615234375 length of segment : 213 time for calcul the mask position with numpy : 0.0018527507781982422 nb_pixel_total : 44411 time to create 1 rle with old method : 0.05013108253479004 length of segment : 328 time for calcul the mask position with numpy : 0.0025725364685058594 nb_pixel_total : 72227 time to create 1 rle with old method : 0.08271360397338867 length of segment : 284 time for calcul the mask position with numpy : 0.011131048202514648 nb_pixel_total : 404378 time to create 1 rle with new method : 0.023955821990966797 length of segment : 719 time for calcul the mask position with numpy : 0.0009520053863525391 nb_pixel_total : 17335 time to create 1 rle with old method : 0.027084827423095703 length of segment : 134 time for calcul the mask position with numpy : 0.0017473697662353516 nb_pixel_total : 38641 time to create 1 rle with old method : 0.04536747932434082 length of segment : 409 time for calcul the mask position with numpy : 0.001024007797241211 nb_pixel_total : 27628 time to create 1 rle with old method : 0.03177165985107422 length of segment : 278 time for calcul the mask position with numpy : 0.0015139579772949219 nb_pixel_total : 39959 time to create 1 rle with old method : 0.04969167709350586 length of segment : 275 time for calcul the mask position with numpy : 0.0004177093505859375 nb_pixel_total : 8258 time to create 1 rle with old method : 0.009844779968261719 length of segment : 155 time for calcul the mask position with numpy : 0.0006556510925292969 nb_pixel_total : 17072 time to create 1 rle with old method : 0.0201723575592041 length of segment : 124 time for calcul the mask position with numpy : 0.0005962848663330078 nb_pixel_total : 14623 time to create 1 rle with old method : 0.017441987991333008 length of segment : 182 time for calcul the mask position with numpy : 0.0003323554992675781 nb_pixel_total : 14103 time to create 1 rle with old method : 0.016787052154541016 length of segment : 140 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 6501 time to create 1 rle with old method : 0.007939815521240234 length of segment : 145 time for calcul the mask position with numpy : 0.0002884864807128906 nb_pixel_total : 6825 time to create 1 rle with old method : 0.008123636245727539 length of segment : 93 time for calcul the mask position with numpy : 0.002978086471557617 nb_pixel_total : 93919 time to create 1 rle with old method : 0.10454082489013672 length of segment : 278 time for calcul the mask position with numpy : 0.002614736557006836 nb_pixel_total : 96396 time to create 1 rle with old method : 0.10840749740600586 length of segment : 324 time for calcul the mask position with numpy : 0.00023055076599121094 nb_pixel_total : 7287 time to create 1 rle with old method : 0.008663177490234375 length of segment : 120 time for calcul the mask position with numpy : 0.0018966197967529297 nb_pixel_total : 65135 time to create 1 rle with old method : 0.07369208335876465 length of segment : 428 time for calcul the mask position with numpy : 0.0015339851379394531 nb_pixel_total : 39301 time to create 1 rle with old method : 0.06405091285705566 length of segment : 187 time for calcul the mask position with numpy : 0.004057645797729492 nb_pixel_total : 103610 time to create 1 rle with old method : 0.11582469940185547 length of segment : 420 time for calcul the mask position with numpy : 0.0007147789001464844 nb_pixel_total : 12618 time to create 1 rle with old method : 0.01466059684753418 length of segment : 200 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 5064 time to create 1 rle with old method : 0.006031513214111328 length of segment : 81 time for calcul the mask position with numpy : 0.0005290508270263672 nb_pixel_total : 18232 time to create 1 rle with old method : 0.020905494689941406 length of segment : 198 time for calcul the mask position with numpy : 0.0014362335205078125 nb_pixel_total : 32603 time to create 1 rle with old method : 0.03942370414733887 length of segment : 288 time for calcul the mask position with numpy : 0.0002694129943847656 nb_pixel_total : 10925 time to create 1 rle with old method : 0.012846708297729492 length of segment : 155 time for calcul the mask position with numpy : 0.0005886554718017578 nb_pixel_total : 15981 time to create 1 rle with old method : 0.019255399703979492 length of segment : 100 time for calcul the mask position with numpy : 0.0031545162200927734 nb_pixel_total : 137302 time to create 1 rle with old method : 0.15447640419006348 length of segment : 437 time for calcul the mask position with numpy : 0.0008423328399658203 nb_pixel_total : 33832 time to create 1 rle with old method : 0.03919792175292969 length of segment : 185 time for calcul the mask position with numpy : 0.003054380416870117 nb_pixel_total : 98008 time to create 1 rle with old method : 0.11237406730651855 length of segment : 474 time for calcul the mask position with numpy : 0.002414703369140625 nb_pixel_total : 79887 time to create 1 rle with old method : 0.09152746200561523 length of segment : 337 time for calcul the mask position with numpy : 0.002025604248046875 nb_pixel_total : 74295 time to create 1 rle with old method : 0.08490753173828125 length of segment : 354 time for calcul the mask position with numpy : 0.0017094612121582031 nb_pixel_total : 59170 time to create 1 rle with old method : 0.06805849075317383 length of segment : 275 time for calcul the mask position with numpy : 0.0006687641143798828 nb_pixel_total : 22746 time to create 1 rle with old method : 0.026093482971191406 length of segment : 125 time for calcul the mask position with numpy : 0.0009849071502685547 nb_pixel_total : 22786 time to create 1 rle with old method : 0.027462244033813477 length of segment : 173 time for calcul the mask position with numpy : 0.00040650367736816406 nb_pixel_total : 9450 time to create 1 rle with old method : 0.012701034545898438 length of segment : 92 time for calcul the mask position with numpy : 0.0014238357543945312 nb_pixel_total : 61159 time to create 1 rle with old method : 0.07007861137390137 length of segment : 293 time for calcul the mask position with numpy : 0.0011336803436279297 nb_pixel_total : 50457 time to create 1 rle with old method : 0.06055855751037598 length of segment : 296 time for calcul the mask position with numpy : 0.0023920536041259766 nb_pixel_total : 102592 time to create 1 rle with old method : 0.11738419532775879 length of segment : 294 time for calcul the mask position with numpy : 0.0008182525634765625 nb_pixel_total : 19303 time to create 1 rle with old method : 0.022477388381958008 length of segment : 203 time for calcul the mask position with numpy : 0.0008134841918945312 nb_pixel_total : 26987 time to create 1 rle with old method : 0.031465768814086914 length of segment : 189 time for calcul the mask position with numpy : 0.0007503032684326172 nb_pixel_total : 16424 time to create 1 rle with old method : 0.02193164825439453 length of segment : 235 time for calcul the mask position with numpy : 0.0009932518005371094 nb_pixel_total : 45254 time to create 1 rle with old method : 0.05411696434020996 length of segment : 240 time for calcul the mask position with numpy : 0.0011572837829589844 nb_pixel_total : 32293 time to create 1 rle with old method : 0.03740215301513672 length of segment : 209 time for calcul the mask position with numpy : 0.0030596256256103516 nb_pixel_total : 86167 time to create 1 rle with old method : 0.10448408126831055 length of segment : 521 time for calcul the mask position with numpy : 0.006263017654418945 nb_pixel_total : 182779 time to create 1 rle with new method : 0.010282516479492188 length of segment : 528 time for calcul the mask position with numpy : 0.0009856224060058594 nb_pixel_total : 27421 time to create 1 rle with old method : 0.03161501884460449 length of segment : 259 time for calcul the mask position with numpy : 0.0031816959381103516 nb_pixel_total : 122657 time to create 1 rle with old method : 0.13883352279663086 length of segment : 519 time for calcul the mask position with numpy : 0.0023317337036132812 nb_pixel_total : 62234 time to create 1 rle with old method : 0.07121849060058594 length of segment : 311 time for calcul the mask position with numpy : 0.003162384033203125 nb_pixel_total : 100405 time to create 1 rle with old method : 0.11415386199951172 length of segment : 373 time for calcul the mask position with numpy : 0.0019457340240478516 nb_pixel_total : 49692 time to create 1 rle with old method : 0.057462215423583984 length of segment : 271 time for calcul the mask position with numpy : 0.0009157657623291016 nb_pixel_total : 25585 time to create 1 rle with old method : 0.02999734878540039 length of segment : 329 time for calcul the mask position with numpy : 0.0005507469177246094 nb_pixel_total : 6988 time to create 1 rle with old method : 0.01134634017944336 length of segment : 284 time for calcul the mask position with numpy : 0.0013377666473388672 nb_pixel_total : 21802 time to create 1 rle with old method : 0.02618861198425293 length of segment : 144 time for calcul the mask position with numpy : 0.0017499923706054688 nb_pixel_total : 49266 time to create 1 rle with old method : 0.06521201133728027 length of segment : 400 time for calcul the mask position with numpy : 0.0008246898651123047 nb_pixel_total : 25820 time to create 1 rle with old method : 0.030908584594726562 length of segment : 148 time for calcul the mask position with numpy : 0.0030252933502197266 nb_pixel_total : 103432 time to create 1 rle with old method : 0.12343001365661621 length of segment : 306 time for calcul the mask position with numpy : 0.0007240772247314453 nb_pixel_total : 16567 time to create 1 rle with old method : 0.019528627395629883 length of segment : 160 time for calcul the mask position with numpy : 0.000888824462890625 nb_pixel_total : 15965 time to create 1 rle with old method : 0.02727198600769043 length of segment : 153 time for calcul the mask position with numpy : 0.00047326087951660156 nb_pixel_total : 3443 time to create 1 rle with old method : 0.004896879196166992 length of segment : 84 time for calcul the mask position with numpy : 0.008582353591918945 nb_pixel_total : 305109 time to create 1 rle with new method : 0.01602768898010254 length of segment : 533 time for calcul the mask position with numpy : 0.0008351802825927734 nb_pixel_total : 36856 time to create 1 rle with old method : 0.04496049880981445 length of segment : 226 time for calcul the mask position with numpy : 0.0008349418640136719 nb_pixel_total : 22793 time to create 1 rle with old method : 0.03789043426513672 length of segment : 132 time for calcul the mask position with numpy : 0.0005688667297363281 nb_pixel_total : 13945 time to create 1 rle with old method : 0.017744779586791992 length of segment : 116 time for calcul the mask position with numpy : 0.0004534721374511719 nb_pixel_total : 32101 time to create 1 rle with old method : 0.03753662109375 length of segment : 143 time for calcul the mask position with numpy : 0.00043320655822753906 nb_pixel_total : 22127 time to create 1 rle with old method : 0.026189804077148438 length of segment : 135 time for calcul the mask position with numpy : 0.0003998279571533203 nb_pixel_total : 9620 time to create 1 rle with old method : 0.011274576187133789 length of segment : 108 time for calcul the mask position with numpy : 0.0010335445404052734 nb_pixel_total : 36448 time to create 1 rle with old method : 0.042769670486450195 length of segment : 235 time for calcul the mask position with numpy : 0.21572232246398926 nb_pixel_total : 2033126 time to create 1 rle with new method : 0.9461028575897217 length of segment : 1217 time for calcul the mask position with numpy : 0.014670610427856445 nb_pixel_total : 833218 time to create 1 rle with new method : 0.0998833179473877 length of segment : 1150 time for calcul the mask position with numpy : 0.0007107257843017578 nb_pixel_total : 21871 time to create 1 rle with old method : 0.02700185775756836 length of segment : 219 time for calcul the mask position with numpy : 0.0023581981658935547 nb_pixel_total : 78463 time to create 1 rle with old method : 0.0950922966003418 length of segment : 371 time for calcul the mask position with numpy : 0.0018663406372070312 nb_pixel_total : 75910 time to create 1 rle with old method : 0.0907278060913086 length of segment : 261 time for calcul the mask position with numpy : 0.0038437843322753906 nb_pixel_total : 104009 time to create 1 rle with old method : 0.11892509460449219 length of segment : 564 time for calcul the mask position with numpy : 0.00771331787109375 nb_pixel_total : 242177 time to create 1 rle with new method : 0.013508319854736328 length of segment : 431 time for calcul the mask position with numpy : 0.0015332698822021484 nb_pixel_total : 42049 time to create 1 rle with old method : 0.047762155532836914 length of segment : 268 time for calcul the mask position with numpy : 0.0029060840606689453 nb_pixel_total : 148759 time to create 1 rle with old method : 0.17030048370361328 length of segment : 359 time for calcul the mask position with numpy : 0.0027353763580322266 nb_pixel_total : 56538 time to create 1 rle with old method : 0.06537365913391113 length of segment : 287 time for calcul the mask position with numpy : 0.003912210464477539 nb_pixel_total : 127546 time to create 1 rle with old method : 0.15097546577453613 length of segment : 337 time for calcul the mask position with numpy : 0.0007417201995849609 nb_pixel_total : 21541 time to create 1 rle with old method : 0.025298357009887695 length of segment : 142 time for calcul the mask position with numpy : 0.0016970634460449219 nb_pixel_total : 49532 time to create 1 rle with old method : 0.05750751495361328 length of segment : 272 time for calcul the mask position with numpy : 0.0008473396301269531 nb_pixel_total : 28790 time to create 1 rle with old method : 0.03349113464355469 length of segment : 186 time for calcul the mask position with numpy : 0.001194000244140625 nb_pixel_total : 6079 time to create 1 rle with old method : 0.007737874984741211 length of segment : 153 time for calcul the mask position with numpy : 0.000446319580078125 nb_pixel_total : 10938 time to create 1 rle with old method : 0.013269662857055664 length of segment : 118 time for calcul the mask position with numpy : 0.0006692409515380859 nb_pixel_total : 12460 time to create 1 rle with old method : 0.01504659652709961 length of segment : 157 time for calcul the mask position with numpy : 0.048337459564208984 nb_pixel_total : 2617825 time to create 1 rle with new method : 0.44872283935546875 length of segment : 2356 time for calcul the mask position with numpy : 1.32000732421875 nb_pixel_total : 7313819 time to create 1 rle with new method : 2.4186432361602783 length of segment : 3783 time for calcul the mask position with numpy : 1.0073235034942627 nb_pixel_total : 9077015 time to create 1 rle with new method : 0.8505260944366455 length of segment : 2711 time for calcul the mask position with numpy : 0.03964662551879883 nb_pixel_total : 2718580 time to create 1 rle with new method : 0.8269250392913818 length of segment : 1411 time for calcul the mask position with numpy : 0.04333758354187012 nb_pixel_total : 2063099 time to create 1 rle with new method : 0.6982572078704834 length of segment : 2021 time for calcul the mask position with numpy : 0.46812939643859863 nb_pixel_total : 2926659 time to create 1 rle with new method : 0.4599745273590088 length of segment : 1913 time for calcul the mask position with numpy : 0.9952743053436279 nb_pixel_total : 5482938 time to create 1 rle with new method : 1.7437717914581299 length of segment : 5024 time for calcul the mask position with numpy : 0.0002732276916503906 nb_pixel_total : 14496 time to create 1 rle with old method : 0.016677379608154297 length of segment : 203 time for calcul the mask position with numpy : 0.0008511543273925781 nb_pixel_total : 63798 time to create 1 rle with old method : 0.07270216941833496 length of segment : 428 time for calcul the mask position with numpy : 0.0009047985076904297 nb_pixel_total : 20614 time to create 1 rle with old method : 0.024535655975341797 length of segment : 307 time for calcul the mask position with numpy : 0.0005917549133300781 nb_pixel_total : 14067 time to create 1 rle with old method : 0.023712873458862305 length of segment : 218 time spent for convertir_results : 47.285226345062256 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 347 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 113.98694944381714 time spend to save output : 0.13349008560180664 total time spend for step 1 : 114.12043952941895 step2:mask_detect Tue May 6 23:03:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5083 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-06 23:03:28.622325: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-06 23:03:28.659126: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-06 23:03:28.661106: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f1bec000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-06 23:03:28.661129: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-06 23:03:28.665905: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-06 23:03:28.822833: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1356e2d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-06 23:03:28.822884: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-06 23:03:28.824195: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 23:03:28.825806: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 23:03:28.846690: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 23:03:28.863158: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 23:03:28.866735: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 23:03:28.885524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 23:03:28.889914: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 23:03:28.919378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 23:03:28.920897: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 23:03:28.921381: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 23:03:28.922172: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 23:03:28.922191: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 23:03:28.922204: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 23:03:28.924889: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4631 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-06 23:03:29.120813: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 23:03:29.120933: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 23:03:29.120968: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 23:03:29.121012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 23:03:29.121040: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 23:03:29.121066: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 23:03:29.121092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 23:03:29.121119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 23:03:29.122440: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 23:03:29.123701: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 23:03:29.123745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 23:03:29.123773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 23:03:29.123799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 23:03:29.123825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 23:03:29.123850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 23:03:29.123876: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 23:03:29.123902: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 23:03:29.125322: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 23:03:29.125363: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 23:03:29.125382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 23:03:29.125400: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 23:03:29.126804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4631 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-06 23:03:46.299537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 23:03:46.669583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 23:03:48.675085: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 10 Detection mask done ! Trying to reset tf kernel 2421882 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1714 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6816 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 2.4567975997924805 nb_pixel_total : 4669340 time to create 1 rle with new method : 1.3822605609893799 length of segment : 5498 time for calcul the mask position with numpy : 0.09989356994628906 nb_pixel_total : 2335042 time to create 1 rle with new method : 0.6030724048614502 length of segment : 5925 time for calcul the mask position with numpy : 0.010746002197265625 nb_pixel_total : 178373 time to create 1 rle with new method : 0.017758846282958984 length of segment : 1769 time for calcul the mask position with numpy : 0.038507699966430664 nb_pixel_total : 1605864 time to create 1 rle with new method : 0.3256649971008301 length of segment : 5076 time for calcul the mask position with numpy : 0.0020284652709960938 nb_pixel_total : 39231 time to create 1 rle with old method : 0.04609227180480957 length of segment : 340 time for calcul the mask position with numpy : 0.013354778289794922 nb_pixel_total : 317575 time to create 1 rle with new method : 0.01580524444580078 length of segment : 1191 time for calcul the mask position with numpy : 0.020525455474853516 nb_pixel_total : 948931 time to create 1 rle with new method : 0.06778359413146973 length of segment : 1288 time for calcul the mask position with numpy : 0.002168416976928711 nb_pixel_total : 162186 time to create 1 rle with new method : 0.005483150482177734 length of segment : 689 time for calcul the mask position with numpy : 0.014865398406982422 nb_pixel_total : 685197 time to create 1 rle with new method : 0.019578218460083008 length of segment : 1327 time for calcul the mask position with numpy : 0.008456230163574219 nb_pixel_total : 526095 time to create 1 rle with new method : 0.01960897445678711 length of segment : 1403 time for calcul the mask position with numpy : 0.0035703182220458984 nb_pixel_total : 135973 time to create 1 rle with old method : 0.1653139591217041 length of segment : 587 time for calcul the mask position with numpy : 0.005417823791503906 nb_pixel_total : 308812 time to create 1 rle with new method : 0.011899232864379883 length of segment : 1472 time for calcul the mask position with numpy : 0.009903192520141602 nb_pixel_total : 456645 time to create 1 rle with new method : 0.017975568771362305 length of segment : 1338 time for calcul the mask position with numpy : 0.0006322860717773438 nb_pixel_total : 44643 time to create 1 rle with old method : 0.05083203315734863 length of segment : 158 time for calcul the mask position with numpy : 0.0009741783142089844 nb_pixel_total : 66879 time to create 1 rle with old method : 0.07762360572814941 length of segment : 239 time for calcul the mask position with numpy : 0.0066602230072021484 nb_pixel_total : 446229 time to create 1 rle with new method : 0.015813112258911133 length of segment : 1353 time for calcul the mask position with numpy : 0.0069849491119384766 nb_pixel_total : 386988 time to create 1 rle with new method : 0.019448041915893555 length of segment : 1271 time for calcul the mask position with numpy : 0.0008313655853271484 nb_pixel_total : 39172 time to create 1 rle with old method : 0.044100284576416016 length of segment : 147 time for calcul the mask position with numpy : 0.0014023780822753906 nb_pixel_total : 70778 time to create 1 rle with old method : 0.07954192161560059 length of segment : 261 time for calcul the mask position with numpy : 0.024317502975463867 nb_pixel_total : 149794 time to create 1 rle with old method : 0.17448186874389648 length of segment : 383 time for calcul the mask position with numpy : 0.0010204315185546875 nb_pixel_total : 44302 time to create 1 rle with old method : 0.04993486404418945 length of segment : 366 time for calcul the mask position with numpy : 0.0009133815765380859 nb_pixel_total : 56492 time to create 1 rle with old method : 0.06262922286987305 length of segment : 318 time for calcul the mask position with numpy : 0.0007517337799072266 nb_pixel_total : 33320 time to create 1 rle with old method : 0.038459062576293945 length of segment : 169 time for calcul the mask position with numpy : 0.01250004768371582 nb_pixel_total : 585581 time to create 1 rle with new method : 0.030332326889038086 length of segment : 802 time for calcul the mask position with numpy : 0.001688241958618164 nb_pixel_total : 76444 time to create 1 rle with old method : 0.08563446998596191 length of segment : 523 time for calcul the mask position with numpy : 0.0028336048126220703 nb_pixel_total : 136666 time to create 1 rle with old method : 0.15074563026428223 length of segment : 477 time for calcul the mask position with numpy : 0.0007600784301757812 nb_pixel_total : 40547 time to create 1 rle with old method : 0.04490232467651367 length of segment : 233 time for calcul the mask position with numpy : 0.0029098987579345703 nb_pixel_total : 216388 time to create 1 rle with new method : 0.00891423225402832 length of segment : 647 time for calcul the mask position with numpy : 0.0011572837829589844 nb_pixel_total : 38189 time to create 1 rle with old method : 0.047623395919799805 length of segment : 356 time for calcul the mask position with numpy : 0.0033643245697021484 nb_pixel_total : 191214 time to create 1 rle with new method : 0.009072542190551758 length of segment : 401 time for calcul the mask position with numpy : 0.0007202625274658203 nb_pixel_total : 36246 time to create 1 rle with old method : 0.04139852523803711 length of segment : 158 time for calcul the mask position with numpy : 0.0045108795166015625 nb_pixel_total : 320824 time to create 1 rle with new method : 0.023545026779174805 length of segment : 404 time for calcul the mask position with numpy : 0.0013456344604492188 nb_pixel_total : 58228 time to create 1 rle with old method : 0.06527495384216309 length of segment : 328 time for calcul the mask position with numpy : 0.0006995201110839844 nb_pixel_total : 27793 time to create 1 rle with old method : 0.03221416473388672 length of segment : 226 time for calcul the mask position with numpy : 0.0003504753112792969 nb_pixel_total : 16063 time to create 1 rle with old method : 0.01802659034729004 length of segment : 117 time for calcul the mask position with numpy : 0.0015439987182617188 nb_pixel_total : 66877 time to create 1 rle with old method : 0.0737600326538086 length of segment : 309 time for calcul the mask position with numpy : 0.0007727146148681641 nb_pixel_total : 29268 time to create 1 rle with old method : 0.03160214424133301 length of segment : 435 time for calcul the mask position with numpy : 0.009227275848388672 nb_pixel_total : 335630 time to create 1 rle with new method : 0.029653549194335938 length of segment : 943 time for calcul the mask position with numpy : 0.0034906864166259766 nb_pixel_total : 159143 time to create 1 rle with new method : 0.009702920913696289 length of segment : 437 time for calcul the mask position with numpy : 0.006566047668457031 nb_pixel_total : 321877 time to create 1 rle with new method : 0.019006729125976562 length of segment : 588 time for calcul the mask position with numpy : 0.009431123733520508 nb_pixel_total : 510431 time to create 1 rle with new method : 0.02327704429626465 length of segment : 881 time for calcul the mask position with numpy : 0.0011286735534667969 nb_pixel_total : 49750 time to create 1 rle with old method : 0.07743430137634277 length of segment : 248 time for calcul the mask position with numpy : 0.003971576690673828 nb_pixel_total : 125626 time to create 1 rle with old method : 0.14899086952209473 length of segment : 373 time for calcul the mask position with numpy : 0.004591464996337891 nb_pixel_total : 156962 time to create 1 rle with new method : 0.014943122863769531 length of segment : 431 time for calcul the mask position with numpy : 0.002303600311279297 nb_pixel_total : 98368 time to create 1 rle with old method : 0.11239910125732422 length of segment : 270 time for calcul the mask position with numpy : 0.001085519790649414 nb_pixel_total : 50657 time to create 1 rle with old method : 0.05916118621826172 length of segment : 240 time for calcul the mask position with numpy : 0.0007560253143310547 nb_pixel_total : 33798 time to create 1 rle with old method : 0.03992152214050293 length of segment : 177 time for calcul the mask position with numpy : 0.005553007125854492 nb_pixel_total : 237034 time to create 1 rle with new method : 0.016153335571289062 length of segment : 559 time for calcul the mask position with numpy : 0.0031304359436035156 nb_pixel_total : 131112 time to create 1 rle with old method : 0.17770648002624512 length of segment : 497 time for calcul the mask position with numpy : 0.003972053527832031 nb_pixel_total : 156019 time to create 1 rle with new method : 0.010129213333129883 length of segment : 370 time for calcul the mask position with numpy : 0.0006990432739257812 nb_pixel_total : 15691 time to create 1 rle with old method : 0.028186798095703125 length of segment : 118 time for calcul the mask position with numpy : 0.05201888084411621 nb_pixel_total : 1292257 time to create 1 rle with new method : 0.4176039695739746 length of segment : 2556 time for calcul the mask position with numpy : 0.0022270679473876953 nb_pixel_total : 112610 time to create 1 rle with old method : 0.15008306503295898 length of segment : 412 time for calcul the mask position with numpy : 0.003704547882080078 nb_pixel_total : 209383 time to create 1 rle with new method : 0.009781360626220703 length of segment : 407 time for calcul the mask position with numpy : 0.0009672641754150391 nb_pixel_total : 50648 time to create 1 rle with old method : 0.05619478225708008 length of segment : 275 time for calcul the mask position with numpy : 0.00037288665771484375 nb_pixel_total : 13485 time to create 1 rle with old method : 0.015965700149536133 length of segment : 126 time for calcul the mask position with numpy : 0.0026557445526123047 nb_pixel_total : 89392 time to create 1 rle with old method : 0.1000821590423584 length of segment : 291 time for calcul the mask position with numpy : 0.0008311271667480469 nb_pixel_total : 54844 time to create 1 rle with old method : 0.06199026107788086 length of segment : 219 time for calcul the mask position with numpy : 0.010474920272827148 nb_pixel_total : 547618 time to create 1 rle with new method : 0.03590250015258789 length of segment : 776 time for calcul the mask position with numpy : 0.0033957958221435547 nb_pixel_total : 182137 time to create 1 rle with new method : 0.009203672409057617 length of segment : 556 time for calcul the mask position with numpy : 0.0016312599182128906 nb_pixel_total : 95287 time to create 1 rle with old method : 0.12102890014648438 length of segment : 322 time for calcul the mask position with numpy : 0.005955934524536133 nb_pixel_total : 187778 time to create 1 rle with new method : 0.01882195472717285 length of segment : 788 time for calcul the mask position with numpy : 0.004248857498168945 nb_pixel_total : 240033 time to create 1 rle with new method : 0.011196613311767578 length of segment : 597 time for calcul the mask position with numpy : 0.009855031967163086 nb_pixel_total : 503458 time to create 1 rle with new method : 0.024807453155517578 length of segment : 1235 time for calcul the mask position with numpy : 0.0014615058898925781 nb_pixel_total : 74447 time to create 1 rle with old method : 0.08381056785583496 length of segment : 350 time for calcul the mask position with numpy : 0.0013866424560546875 nb_pixel_total : 71837 time to create 1 rle with old method : 0.08424210548400879 length of segment : 189 time for calcul the mask position with numpy : 0.0041463375091552734 nb_pixel_total : 192198 time to create 1 rle with new method : 0.012613534927368164 length of segment : 442 time for calcul the mask position with numpy : 0.0025582313537597656 nb_pixel_total : 149895 time to create 1 rle with old method : 0.16821861267089844 length of segment : 411 time for calcul the mask position with numpy : 0.003350496292114258 nb_pixel_total : 185515 time to create 1 rle with new method : 0.008966207504272461 length of segment : 325 time for calcul the mask position with numpy : 0.0024623870849609375 nb_pixel_total : 83418 time to create 1 rle with old method : 0.0940103530883789 length of segment : 497 time for calcul the mask position with numpy : 0.0020864009857177734 nb_pixel_total : 87876 time to create 1 rle with old method : 0.09987998008728027 length of segment : 511 time for calcul the mask position with numpy : 0.002118349075317383 nb_pixel_total : 42149 time to create 1 rle with old method : 0.047142982482910156 length of segment : 214 time for calcul the mask position with numpy : 0.004879474639892578 nb_pixel_total : 241038 time to create 1 rle with new method : 0.012151002883911133 length of segment : 563 time for calcul the mask position with numpy : 0.0005707740783691406 nb_pixel_total : 18308 time to create 1 rle with old method : 0.02082061767578125 length of segment : 221 time for calcul the mask position with numpy : 0.005244731903076172 nb_pixel_total : 176077 time to create 1 rle with new method : 0.015192985534667969 length of segment : 612 time for calcul the mask position with numpy : 0.0009682178497314453 nb_pixel_total : 37160 time to create 1 rle with old method : 0.04174995422363281 length of segment : 197 time for calcul the mask position with numpy : 0.005065441131591797 nb_pixel_total : 64686 time to create 1 rle with old method : 0.07437992095947266 length of segment : 376 time for calcul the mask position with numpy : 0.0014019012451171875 nb_pixel_total : 33426 time to create 1 rle with old method : 0.03892374038696289 length of segment : 203 time for calcul the mask position with numpy : 0.0034186840057373047 nb_pixel_total : 176639 time to create 1 rle with new method : 0.012882709503173828 length of segment : 438 time for calcul the mask position with numpy : 0.011581182479858398 nb_pixel_total : 634160 time to create 1 rle with new method : 0.02454829216003418 length of segment : 796 time for calcul the mask position with numpy : 0.0021936893463134766 nb_pixel_total : 93930 time to create 1 rle with old method : 0.1070244312286377 length of segment : 357 time for calcul the mask position with numpy : 0.0008914470672607422 nb_pixel_total : 26958 time to create 1 rle with old method : 0.03242063522338867 length of segment : 131 time for calcul the mask position with numpy : 0.0035369396209716797 nb_pixel_total : 113118 time to create 1 rle with old method : 0.13247466087341309 length of segment : 450 time for calcul the mask position with numpy : 0.002191781997680664 nb_pixel_total : 83167 time to create 1 rle with old method : 0.10695052146911621 length of segment : 295 time for calcul the mask position with numpy : 0.012034416198730469 nb_pixel_total : 526810 time to create 1 rle with new method : 0.0235750675201416 length of segment : 1193 time for calcul the mask position with numpy : 0.002153635025024414 nb_pixel_total : 97293 time to create 1 rle with old method : 0.11334872245788574 length of segment : 341 time for calcul the mask position with numpy : 0.0010089874267578125 nb_pixel_total : 52827 time to create 1 rle with old method : 0.06258225440979004 length of segment : 200 time for calcul the mask position with numpy : 0.0013422966003417969 nb_pixel_total : 74036 time to create 1 rle with old method : 0.10593748092651367 length of segment : 250 time for calcul the mask position with numpy : 0.006181001663208008 nb_pixel_total : 272476 time to create 1 rle with new method : 0.017168045043945312 length of segment : 739 time for calcul the mask position with numpy : 0.005015850067138672 nb_pixel_total : 149872 time to create 1 rle with old method : 0.16805744171142578 length of segment : 382 time for calcul the mask position with numpy : 0.0025360584259033203 nb_pixel_total : 82679 time to create 1 rle with old method : 0.10285758972167969 length of segment : 240 time for calcul the mask position with numpy : 0.001978158950805664 nb_pixel_total : 52461 time to create 1 rle with old method : 0.06035256385803223 length of segment : 254 time for calcul the mask position with numpy : 0.001489400863647461 nb_pixel_total : 67460 time to create 1 rle with old method : 0.07696890830993652 length of segment : 330 time for calcul the mask position with numpy : 0.0007894039154052734 nb_pixel_total : 34094 time to create 1 rle with old method : 0.03870725631713867 length of segment : 299 time for calcul the mask position with numpy : 0.0016939640045166016 nb_pixel_total : 94551 time to create 1 rle with old method : 0.10731101036071777 length of segment : 280 time for calcul the mask position with numpy : 0.0008304119110107422 nb_pixel_total : 31599 time to create 1 rle with old method : 0.036759376525878906 length of segment : 198 time for calcul the mask position with numpy : 0.0010523796081542969 nb_pixel_total : 46482 time to create 1 rle with old method : 0.05430960655212402 length of segment : 254 time for calcul the mask position with numpy : 0.005226850509643555 nb_pixel_total : 191021 time to create 1 rle with new method : 0.009203672409057617 length of segment : 486 time for calcul the mask position with numpy : 0.0008873939514160156 nb_pixel_total : 18988 time to create 1 rle with old method : 0.021628618240356445 length of segment : 345 time for calcul the mask position with numpy : 0.010246753692626953 nb_pixel_total : 409949 time to create 1 rle with new method : 0.033632516860961914 length of segment : 1279 time for calcul the mask position with numpy : 0.0006613731384277344 nb_pixel_total : 21917 time to create 1 rle with old method : 0.03432154655456543 length of segment : 124 time for calcul the mask position with numpy : 0.003671884536743164 nb_pixel_total : 132704 time to create 1 rle with old method : 0.14766573905944824 length of segment : 559 time for calcul the mask position with numpy : 0.002268075942993164 nb_pixel_total : 92873 time to create 1 rle with old method : 0.10276985168457031 length of segment : 389 time for calcul the mask position with numpy : 0.00729823112487793 nb_pixel_total : 347766 time to create 1 rle with new method : 0.020216941833496094 length of segment : 868 time for calcul the mask position with numpy : 0.0016829967498779297 nb_pixel_total : 81734 time to create 1 rle with old method : 0.09368157386779785 length of segment : 395 time for calcul the mask position with numpy : 0.004907846450805664 nb_pixel_total : 256166 time to create 1 rle with new method : 0.013875246047973633 length of segment : 842 time for calcul the mask position with numpy : 0.0015184879302978516 nb_pixel_total : 43821 time to create 1 rle with old method : 0.050171852111816406 length of segment : 255 time for calcul the mask position with numpy : 0.0028238296508789062 nb_pixel_total : 138261 time to create 1 rle with old method : 0.1555345058441162 length of segment : 432 time for calcul the mask position with numpy : 0.0022821426391601562 nb_pixel_total : 101103 time to create 1 rle with old method : 0.11162495613098145 length of segment : 567 time for calcul the mask position with numpy : 0.0011429786682128906 nb_pixel_total : 57548 time to create 1 rle with old method : 0.0652930736541748 length of segment : 194 time for calcul the mask position with numpy : 0.0019268989562988281 nb_pixel_total : 82542 time to create 1 rle with old method : 0.11778688430786133 length of segment : 379 time for calcul the mask position with numpy : 0.0012216567993164062 nb_pixel_total : 39005 time to create 1 rle with old method : 0.04503679275512695 length of segment : 231 time for calcul the mask position with numpy : 0.0010952949523925781 nb_pixel_total : 51631 time to create 1 rle with old method : 0.06105613708496094 length of segment : 182 time for calcul the mask position with numpy : 0.007963418960571289 nb_pixel_total : 353809 time to create 1 rle with new method : 0.02413463592529297 length of segment : 704 time for calcul the mask position with numpy : 0.019728899002075195 nb_pixel_total : 927256 time to create 1 rle with new method : 0.1105804443359375 length of segment : 1025 time for calcul the mask position with numpy : 0.0011396408081054688 nb_pixel_total : 26155 time to create 1 rle with old method : 0.03048992156982422 length of segment : 183 time for calcul the mask position with numpy : 0.0016398429870605469 nb_pixel_total : 45354 time to create 1 rle with old method : 0.05260491371154785 length of segment : 217 time for calcul the mask position with numpy : 0.0013494491577148438 nb_pixel_total : 71262 time to create 1 rle with old method : 0.0798947811126709 length of segment : 342 time for calcul the mask position with numpy : 0.0005540847778320312 nb_pixel_total : 16355 time to create 1 rle with old method : 0.019206523895263672 length of segment : 100 time for calcul the mask position with numpy : 0.0010678768157958984 nb_pixel_total : 36870 time to create 1 rle with old method : 0.060089111328125 length of segment : 252 time for calcul the mask position with numpy : 0.002225160598754883 nb_pixel_total : 87697 time to create 1 rle with old method : 0.09891271591186523 length of segment : 386 time for calcul the mask position with numpy : 0.009382486343383789 nb_pixel_total : 264463 time to create 1 rle with new method : 0.017411231994628906 length of segment : 871 time for calcul the mask position with numpy : 0.0026395320892333984 nb_pixel_total : 92285 time to create 1 rle with old method : 0.10317158699035645 length of segment : 480 time for calcul the mask position with numpy : 0.025824308395385742 nb_pixel_total : 1105115 time to create 1 rle with new method : 0.478163480758667 length of segment : 2110 time for calcul the mask position with numpy : 0.003242969512939453 nb_pixel_total : 88203 time to create 1 rle with old method : 0.09943556785583496 length of segment : 398 time for calcul the mask position with numpy : 0.0013353824615478516 nb_pixel_total : 68666 time to create 1 rle with old method : 0.0774991512298584 length of segment : 237 time for calcul the mask position with numpy : 0.008657455444335938 nb_pixel_total : 357163 time to create 1 rle with new method : 0.020400524139404297 length of segment : 564 time for calcul the mask position with numpy : 0.017270803451538086 nb_pixel_total : 428452 time to create 1 rle with new method : 0.09612321853637695 length of segment : 1140 time for calcul the mask position with numpy : 0.0014383792877197266 nb_pixel_total : 69189 time to create 1 rle with old method : 0.07863545417785645 length of segment : 249 time for calcul the mask position with numpy : 0.0018568038940429688 nb_pixel_total : 54674 time to create 1 rle with old method : 0.06454777717590332 length of segment : 368 time for calcul the mask position with numpy : 0.0027208328247070312 nb_pixel_total : 149807 time to create 1 rle with old method : 0.1704697608947754 length of segment : 579 time for calcul the mask position with numpy : 0.01077580451965332 nb_pixel_total : 436807 time to create 1 rle with new method : 0.027003765106201172 length of segment : 706 time for calcul the mask position with numpy : 0.0010411739349365234 nb_pixel_total : 37767 time to create 1 rle with old method : 0.04488348960876465 length of segment : 293 time for calcul the mask position with numpy : 0.0009579658508300781 nb_pixel_total : 46404 time to create 1 rle with old method : 0.06677389144897461 length of segment : 194 time for calcul the mask position with numpy : 0.0008273124694824219 nb_pixel_total : 39911 time to create 1 rle with old method : 0.04575634002685547 length of segment : 172 time for calcul the mask position with numpy : 0.0029222965240478516 nb_pixel_total : 124079 time to create 1 rle with old method : 0.16730570793151855 length of segment : 340 time for calcul the mask position with numpy : 0.009338617324829102 nb_pixel_total : 500558 time to create 1 rle with new method : 0.02088451385498047 length of segment : 695 time for calcul the mask position with numpy : 0.0006573200225830078 nb_pixel_total : 17611 time to create 1 rle with old method : 0.02078986167907715 length of segment : 170 time for calcul the mask position with numpy : 0.0006546974182128906 nb_pixel_total : 27467 time to create 1 rle with old method : 0.0328211784362793 length of segment : 239 time for calcul the mask position with numpy : 0.0009033679962158203 nb_pixel_total : 34943 time to create 1 rle with old method : 0.04068398475646973 length of segment : 359 time for calcul the mask position with numpy : 0.0006992816925048828 nb_pixel_total : 27828 time to create 1 rle with old method : 0.03233695030212402 length of segment : 199 time for calcul the mask position with numpy : 0.0011820793151855469 nb_pixel_total : 50984 time to create 1 rle with old method : 0.05876731872558594 length of segment : 218 time for calcul the mask position with numpy : 0.0031120777130126953 nb_pixel_total : 155796 time to create 1 rle with new method : 0.007353544235229492 length of segment : 386 time for calcul the mask position with numpy : 0.0020003318786621094 nb_pixel_total : 103567 time to create 1 rle with old method : 0.12089323997497559 length of segment : 717 time for calcul the mask position with numpy : 0.0007236003875732422 nb_pixel_total : 36420 time to create 1 rle with old method : 0.04597306251525879 length of segment : 193 time for calcul the mask position with numpy : 0.011618614196777344 nb_pixel_total : 458173 time to create 1 rle with new method : 0.02870488166809082 length of segment : 830 time for calcul the mask position with numpy : 0.0066680908203125 nb_pixel_total : 207516 time to create 1 rle with new method : 0.016707897186279297 length of segment : 656 time for calcul the mask position with numpy : 0.0014922618865966797 nb_pixel_total : 62540 time to create 1 rle with old method : 0.07442474365234375 length of segment : 249 time for calcul the mask position with numpy : 0.002128124237060547 nb_pixel_total : 93936 time to create 1 rle with old method : 0.11782360076904297 length of segment : 275 time for calcul the mask position with numpy : 0.0015747547149658203 nb_pixel_total : 72150 time to create 1 rle with old method : 0.08221888542175293 length of segment : 314 time for calcul the mask position with numpy : 0.005515336990356445 nb_pixel_total : 310410 time to create 1 rle with new method : 0.013868093490600586 length of segment : 652 time for calcul the mask position with numpy : 0.0017704963684082031 nb_pixel_total : 40795 time to create 1 rle with old method : 0.04856371879577637 length of segment : 526 time for calcul the mask position with numpy : 0.004499912261962891 nb_pixel_total : 191690 time to create 1 rle with new method : 0.01110386848449707 length of segment : 425 time for calcul the mask position with numpy : 0.002670764923095703 nb_pixel_total : 84689 time to create 1 rle with old method : 0.09778642654418945 length of segment : 536 time for calcul the mask position with numpy : 0.0016551017761230469 nb_pixel_total : 51407 time to create 1 rle with old method : 0.06071949005126953 length of segment : 299 time for calcul the mask position with numpy : 0.005887269973754883 nb_pixel_total : 189787 time to create 1 rle with new method : 0.017194747924804688 length of segment : 493 time for calcul the mask position with numpy : 0.001216888427734375 nb_pixel_total : 50191 time to create 1 rle with old method : 0.06505322456359863 length of segment : 246 time for calcul the mask position with numpy : 0.0010426044464111328 nb_pixel_total : 45876 time to create 1 rle with old method : 0.05260205268859863 length of segment : 254 time for calcul the mask position with numpy : 0.0012564659118652344 nb_pixel_total : 58676 time to create 1 rle with old method : 0.06515264511108398 length of segment : 263 time for calcul the mask position with numpy : 0.0022771358489990234 nb_pixel_total : 84938 time to create 1 rle with old method : 0.09586572647094727 length of segment : 224 time for calcul the mask position with numpy : 0.02401447296142578 nb_pixel_total : 552770 time to create 1 rle with new method : 0.12680912017822266 length of segment : 882 time for calcul the mask position with numpy : 0.00039768218994140625 nb_pixel_total : 14570 time to create 1 rle with old method : 0.017492294311523438 length of segment : 116 time for calcul the mask position with numpy : 0.0032541751861572266 nb_pixel_total : 134691 time to create 1 rle with old method : 0.15462803840637207 length of segment : 317 time for calcul the mask position with numpy : 0.0006427764892578125 nb_pixel_total : 20056 time to create 1 rle with old method : 0.03293800354003906 length of segment : 146 time for calcul the mask position with numpy : 0.0011730194091796875 nb_pixel_total : 40915 time to create 1 rle with old method : 0.04802250862121582 length of segment : 248 time for calcul the mask position with numpy : 0.003582000732421875 nb_pixel_total : 149106 time to create 1 rle with old method : 0.17143988609313965 length of segment : 324 time for calcul the mask position with numpy : 0.0047893524169921875 nb_pixel_total : 267921 time to create 1 rle with new method : 0.01294565200805664 length of segment : 582 time for calcul the mask position with numpy : 0.014163970947265625 nb_pixel_total : 643626 time to create 1 rle with new method : 0.1591038703918457 length of segment : 717 time for calcul the mask position with numpy : 0.0008893013000488281 nb_pixel_total : 44625 time to create 1 rle with old method : 0.05115985870361328 length of segment : 185 time for calcul the mask position with numpy : 0.003225564956665039 nb_pixel_total : 155390 time to create 1 rle with new method : 0.008293628692626953 length of segment : 386 time for calcul the mask position with numpy : 0.005576133728027344 nb_pixel_total : 272491 time to create 1 rle with new method : 0.013115406036376953 length of segment : 669 time for calcul the mask position with numpy : 0.0036118030548095703 nb_pixel_total : 181707 time to create 1 rle with new method : 0.009402036666870117 length of segment : 514 time for calcul the mask position with numpy : 0.0006184577941894531 nb_pixel_total : 11716 time to create 1 rle with old method : 0.014187097549438477 length of segment : 173 time for calcul the mask position with numpy : 0.0006635189056396484 nb_pixel_total : 33889 time to create 1 rle with old method : 0.04006052017211914 length of segment : 174 time for calcul the mask position with numpy : 0.0011181831359863281 nb_pixel_total : 64633 time to create 1 rle with old method : 0.07597994804382324 length of segment : 225 time for calcul the mask position with numpy : 0.0019843578338623047 nb_pixel_total : 95156 time to create 1 rle with old method : 0.10657691955566406 length of segment : 303 time for calcul the mask position with numpy : 0.018011093139648438 nb_pixel_total : 872701 time to create 1 rle with new method : 0.062131643295288086 length of segment : 1066 time for calcul the mask position with numpy : 0.03098130226135254 nb_pixel_total : 1410471 time to create 1 rle with new method : 0.2191329002380371 length of segment : 1295 time for calcul the mask position with numpy : 0.0023355484008789062 nb_pixel_total : 111763 time to create 1 rle with old method : 0.12666702270507812 length of segment : 394 time for calcul the mask position with numpy : 0.002587556838989258 nb_pixel_total : 111242 time to create 1 rle with old method : 0.1261594295501709 length of segment : 379 time for calcul the mask position with numpy : 0.0011603832244873047 nb_pixel_total : 51189 time to create 1 rle with old method : 0.07130956649780273 length of segment : 192 time for calcul the mask position with numpy : 0.0023810863494873047 nb_pixel_total : 108789 time to create 1 rle with old method : 0.12583470344543457 length of segment : 249 time for calcul the mask position with numpy : 0.007080078125 nb_pixel_total : 208931 time to create 1 rle with new method : 0.013342857360839844 length of segment : 456 time for calcul the mask position with numpy : 0.002320528030395508 nb_pixel_total : 68429 time to create 1 rle with old method : 0.09603667259216309 length of segment : 345 time for calcul the mask position with numpy : 0.0007662773132324219 nb_pixel_total : 28199 time to create 1 rle with old method : 0.032584428787231445 length of segment : 149 time for calcul the mask position with numpy : 0.014198064804077148 nb_pixel_total : 302409 time to create 1 rle with new method : 0.03347206115722656 length of segment : 1118 time for calcul the mask position with numpy : 0.007628917694091797 nb_pixel_total : 330754 time to create 1 rle with new method : 0.01253199577331543 length of segment : 569 time for calcul the mask position with numpy : 0.023479461669921875 nb_pixel_total : 658129 time to create 1 rle with new method : 0.6308856010437012 length of segment : 992 time for calcul the mask position with numpy : 0.0012412071228027344 nb_pixel_total : 37887 time to create 1 rle with old method : 0.04780149459838867 length of segment : 204 time for calcul the mask position with numpy : 0.0015156269073486328 nb_pixel_total : 50879 time to create 1 rle with old method : 0.06341862678527832 length of segment : 296 time for calcul the mask position with numpy : 0.0016393661499023438 nb_pixel_total : 78932 time to create 1 rle with old method : 0.08855867385864258 length of segment : 255 time for calcul the mask position with numpy : 0.001373291015625 nb_pixel_total : 41572 time to create 1 rle with old method : 0.046072959899902344 length of segment : 255 time for calcul the mask position with numpy : 0.0010933876037597656 nb_pixel_total : 29616 time to create 1 rle with old method : 0.03344249725341797 length of segment : 264 time for calcul the mask position with numpy : 0.004764556884765625 nb_pixel_total : 213194 time to create 1 rle with new method : 0.009357213973999023 length of segment : 541 time for calcul the mask position with numpy : 0.0019040107727050781 nb_pixel_total : 21177 time to create 1 rle with old method : 0.026072978973388672 length of segment : 297 time for calcul the mask position with numpy : 0.002565622329711914 nb_pixel_total : 124184 time to create 1 rle with old method : 0.15955519676208496 length of segment : 617 time for calcul the mask position with numpy : 0.006890058517456055 nb_pixel_total : 129175 time to create 1 rle with old method : 0.15814638137817383 length of segment : 328 time for calcul the mask position with numpy : 0.0013899803161621094 nb_pixel_total : 35003 time to create 1 rle with old method : 0.04510903358459473 length of segment : 202 time for calcul the mask position with numpy : 0.0031948089599609375 nb_pixel_total : 186032 time to create 1 rle with new method : 0.007932901382446289 length of segment : 492 time for calcul the mask position with numpy : 0.0009756088256835938 nb_pixel_total : 29820 time to create 1 rle with old method : 0.03456425666809082 length of segment : 185 time for calcul the mask position with numpy : 0.0011909008026123047 nb_pixel_total : 41341 time to create 1 rle with old method : 0.046889305114746094 length of segment : 209 time for calcul the mask position with numpy : 0.0015721321105957031 nb_pixel_total : 54499 time to create 1 rle with old method : 0.06232905387878418 length of segment : 304 time for calcul the mask position with numpy : 0.0016477108001708984 nb_pixel_total : 72898 time to create 1 rle with old method : 0.08391928672790527 length of segment : 282 time for calcul the mask position with numpy : 0.0008792877197265625 nb_pixel_total : 49339 time to create 1 rle with old method : 0.07074666023254395 length of segment : 239 time for calcul the mask position with numpy : 0.0005011558532714844 nb_pixel_total : 26133 time to create 1 rle with old method : 0.030847549438476562 length of segment : 161 time for calcul the mask position with numpy : 0.01093149185180664 nb_pixel_total : 421013 time to create 1 rle with new method : 0.02208089828491211 length of segment : 488 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 17410 time to create 1 rle with old method : 0.02032923698425293 length of segment : 143 time for calcul the mask position with numpy : 0.0012099742889404297 nb_pixel_total : 64887 time to create 1 rle with old method : 0.07483792304992676 length of segment : 305 time for calcul the mask position with numpy : 0.0034995079040527344 nb_pixel_total : 170398 time to create 1 rle with new method : 0.0077550411224365234 length of segment : 448 time for calcul the mask position with numpy : 0.0010411739349365234 nb_pixel_total : 51901 time to create 1 rle with old method : 0.058838844299316406 length of segment : 349 time for calcul the mask position with numpy : 0.0009310245513916016 nb_pixel_total : 47602 time to create 1 rle with old method : 0.05372500419616699 length of segment : 367 time for calcul the mask position with numpy : 0.9719610214233398 nb_pixel_total : 7907989 time to create 1 rle with new method : 1.3635187149047852 length of segment : 4648 time for calcul the mask position with numpy : 0.0014638900756835938 nb_pixel_total : 130705 time to create 1 rle with old method : 0.1655564308166504 length of segment : 256 time for calcul the mask position with numpy : 0.002941131591796875 nb_pixel_total : 289159 time to create 1 rle with new method : 0.005276203155517578 length of segment : 450 time for calcul the mask position with numpy : 0.01463770866394043 nb_pixel_total : 1043343 time to create 1 rle with new method : 0.04996848106384277 length of segment : 979 time for calcul the mask position with numpy : 0.025342226028442383 nb_pixel_total : 1200561 time to create 1 rle with new method : 0.25960755348205566 length of segment : 2067 time for calcul the mask position with numpy : 0.9894163608551025 nb_pixel_total : 6440750 time to create 1 rle with new method : 1.0397417545318604 length of segment : 4551 time for calcul the mask position with numpy : 0.0029230117797851562 nb_pixel_total : 151675 time to create 1 rle with new method : 0.007661342620849609 length of segment : 643 time for calcul the mask position with numpy : 0.01338052749633789 nb_pixel_total : 1021874 time to create 1 rle with new method : 0.062218666076660156 length of segment : 900 time for calcul the mask position with numpy : 0.0016627311706542969 nb_pixel_total : 118728 time to create 1 rle with old method : 0.13276243209838867 length of segment : 605 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 22506 time to create 1 rle with old method : 0.03349447250366211 length of segment : 162 time for calcul the mask position with numpy : 0.0005784034729003906 nb_pixel_total : 34888 time to create 1 rle with old method : 0.04021430015563965 length of segment : 193 time for calcul the mask position with numpy : 0.007565736770629883 nb_pixel_total : 247052 time to create 1 rle with new method : 0.026087522506713867 length of segment : 1097 time for calcul the mask position with numpy : 0.0007860660552978516 nb_pixel_total : 48598 time to create 1 rle with old method : 0.056853294372558594 length of segment : 134 time for calcul the mask position with numpy : 0.0010330677032470703 nb_pixel_total : 70812 time to create 1 rle with old method : 0.0843973159790039 length of segment : 251 time for calcul the mask position with numpy : 0.00453639030456543 nb_pixel_total : 343283 time to create 1 rle with new method : 0.01084136962890625 length of segment : 663 time spent for convertir_results : 64.66496181488037 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 363 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 173.82530069351196 time spend to save output : 0.1879723072052002 total time spend for step 2 : 174.01327300071716 step3:blur_detection Tue May 6 23:06:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.009541511535644531 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.008964776992797852 save missing photos in datou_result : time spend for datou_step_exec : 0.030872106552124023 time spend to save output : 0.026589155197143555 total time spend for step 3 : 0.05746126174926758 step4:brightness Tue May 6 23:06:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.009858846664428711 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.009916067123413086 save missing photos in datou_result : time spend for datou_step_exec : 0.029597759246826172 time spend to save output : 0.02455449104309082 total time spend for step 4 : 0.05415225028991699 step5:rle_unique_nms_with_priority Tue May 6 23:06:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 363 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 25 nb_hashtags : 5 time to prepare the origin masks : 45.78928875923157 time for calcul the mask position with numpy : 0.3433036804199219 nb_pixel_total : 1708256 time to create 1 rle with new method : 0.9875779151916504 time for calcul the mask position with numpy : 0.0585477352142334 nb_pixel_total : 110105 time to create 1 rle with old method : 0.12472128868103027 time for calcul the mask position with numpy : 0.05651354789733887 nb_pixel_total : 323023 time to create 1 rle with new method : 1.1391229629516602 time for calcul the mask position with numpy : 0.05812382698059082 nb_pixel_total : 676305 time to create 1 rle with new method : 1.1432476043701172 time for calcul the mask position with numpy : 0.054013729095458984 nb_pixel_total : 318187 time to create 1 rle with new method : 1.0033793449401855 time for calcul the mask position with numpy : 0.502190113067627 nb_pixel_total : 4651589 time to create 1 rle with new method : 0.9772188663482666 time for calcul the mask position with numpy : 0.10541105270385742 nb_pixel_total : 2238904 time to create 1 rle with new method : 1.1057071685791016 time for calcul the mask position with numpy : 0.056975364685058594 nb_pixel_total : 482189 time to create 1 rle with new method : 1.1594908237457275 time for calcul the mask position with numpy : 0.05335664749145508 nb_pixel_total : 17553 time to create 1 rle with old method : 0.020194292068481445 time for calcul the mask position with numpy : 0.054840087890625 nb_pixel_total : 372973 time to create 1 rle with new method : 1.4224257469177246 time for calcul the mask position with numpy : 0.05503535270690918 nb_pixel_total : 84639 time to create 1 rle with old method : 0.1015777587890625 time for calcul the mask position with numpy : 0.06064152717590332 nb_pixel_total : 686498 time to create 1 rle with new method : 1.1069574356079102 time for calcul the mask position with numpy : 0.06373214721679688 nb_pixel_total : 907688 time to create 1 rle with new method : 0.9610977172851562 time for calcul the mask position with numpy : 0.05424690246582031 nb_pixel_total : 38920 time to create 1 rle with old method : 0.04354286193847656 time for calcul the mask position with numpy : 0.0535886287689209 nb_pixel_total : 3902 time to create 1 rle with old method : 0.004583835601806641 time for calcul the mask position with numpy : 0.054227590560913086 nb_pixel_total : 10397 time to create 1 rle with old method : 0.012484073638916016 time for calcul the mask position with numpy : 0.05405378341674805 nb_pixel_total : 21303 time to create 1 rle with old method : 0.024397611618041992 time for calcul the mask position with numpy : 0.054065704345703125 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0016529560089111328 time for calcul the mask position with numpy : 0.05396389961242676 nb_pixel_total : 4964 time to create 1 rle with old method : 0.005692243576049805 time for calcul the mask position with numpy : 0.05200958251953125 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001862049102783203 time for calcul the mask position with numpy : 0.05287981033325195 nb_pixel_total : 10 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.05415201187133789 nb_pixel_total : 7 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.05753946304321289 nb_pixel_total : 6474 time to create 1 rle with old method : 0.007607460021972656 time for calcul the mask position with numpy : 0.05344510078430176 nb_pixel_total : 159 time to create 1 rle with old method : 0.000423431396484375 time for calcul the mask position with numpy : 0.05418252944946289 nb_pixel_total : 83101 time to create 1 rle with old method : 0.09782719612121582 time for calcul the mask position with numpy : 0.05651211738586426 nb_pixel_total : 230625 time to create 1 rle with new method : 1.1288108825683594 create new chi : 15.322521924972534 time to delete rle : 0.02952885627746582 batch 1 Loaded 28 chid ids of type : 4855 Number RLEs to save : 53364 TO DO : save crop sub photo not yet done ! save time : 3.295667886734009 nb_obj : 83 nb_hashtags : 10 time to prepare the origin masks : 65.32903718948364 time for calcul the mask position with numpy : 0.3277449607849121 nb_pixel_total : 5209177 time to create 1 rle with new method : 1.4432165622711182 time for calcul the mask position with numpy : 0.054436445236206055 nb_pixel_total : 99292 time to create 1 rle with old method : 0.112518310546875 time for calcul the mask position with numpy : 0.05342507362365723 nb_pixel_total : 26406 time to create 1 rle with old method : 0.02970576286315918 time for calcul the mask position with numpy : 0.06648015975952148 nb_pixel_total : 404300 time to create 1 rle with new method : 1.2247085571289062 time for calcul the mask position with numpy : 0.05390596389770508 nb_pixel_total : 36080 time to create 1 rle with old method : 0.04066061973571777 time for calcul the mask position with numpy : 0.05387520790100098 nb_pixel_total : 70662 time to create 1 rle with old method : 0.08589386940002441 time for calcul the mask position with numpy : 0.28549933433532715 nb_pixel_total : 799484 time to create 1 rle with new method : 1.6760952472686768 time for calcul the mask position with numpy : 0.053002357482910156 nb_pixel_total : 35005 time to create 1 rle with old method : 0.040686607360839844 time for calcul the mask position with numpy : 0.056128501892089844 nb_pixel_total : 39025 time to create 1 rle with old method : 0.05833625793457031 time for calcul the mask position with numpy : 0.054444074630737305 nb_pixel_total : 36369 time to create 1 rle with old method : 0.07497501373291016 time for calcul the mask position with numpy : 0.05917048454284668 nb_pixel_total : 301845 time to create 1 rle with new method : 1.0498886108398438 time for calcul the mask position with numpy : 0.06010890007019043 nb_pixel_total : 1036 time to create 1 rle with old method : 0.0018765926361083984 time for calcul the mask position with numpy : 0.060129642486572266 nb_pixel_total : 124168 time to create 1 rle with old method : 0.13574004173278809 time for calcul the mask position with numpy : 0.05355548858642578 nb_pixel_total : 43431 time to create 1 rle with old method : 0.0488591194152832 time for calcul the mask position with numpy : 0.05506706237792969 nb_pixel_total : 149393 time to create 1 rle with old method : 0.16608595848083496 time for calcul the mask position with numpy : 0.05394315719604492 nb_pixel_total : 132416 time to create 1 rle with old method : 0.15317559242248535 time for calcul the mask position with numpy : 0.05353212356567383 nb_pixel_total : 38475 time to create 1 rle with old method : 0.042336463928222656 time for calcul the mask position with numpy : 0.05265498161315918 nb_pixel_total : 149194 time to create 1 rle with old method : 0.16380596160888672 time for calcul the mask position with numpy : 0.05629396438598633 nb_pixel_total : 566245 time to create 1 rle with new method : 1.66294527053833 time for calcul the mask position with numpy : 0.053475379943847656 nb_pixel_total : 3088 time to create 1 rle with old method : 0.0035028457641601562 time for calcul the mask position with numpy : 0.05372476577758789 nb_pixel_total : 14067 time to create 1 rle with old method : 0.015847206115722656 time for calcul the mask position with numpy : 0.05479907989501953 nb_pixel_total : 24178 time to create 1 rle with old method : 0.039899349212646484 time for calcul the mask position with numpy : 0.06137967109680176 nb_pixel_total : 197982 time to create 1 rle with new method : 1.6003022193908691 time for calcul the mask position with numpy : 0.05530428886413574 nb_pixel_total : 6554 time to create 1 rle with old method : 0.007777690887451172 time for calcul the mask position with numpy : 0.05418753623962402 nb_pixel_total : 68120 time to create 1 rle with old method : 0.07897067070007324 time for calcul the mask position with numpy : 0.05289340019226074 nb_pixel_total : 6402 time to create 1 rle with old method : 0.007307767868041992 time for calcul the mask position with numpy : 0.05837392807006836 nb_pixel_total : 437987 time to create 1 rle with new method : 1.0356440544128418 time for calcul the mask position with numpy : 0.05403947830200195 nb_pixel_total : 17276 time to create 1 rle with old method : 0.019616127014160156 time for calcul the mask position with numpy : 0.05636167526245117 nb_pixel_total : 921 time to create 1 rle with old method : 0.0012845993041992188 time for calcul the mask position with numpy : 0.07828569412231445 nb_pixel_total : 58057 time to create 1 rle with old method : 0.06402373313903809 time for calcul the mask position with numpy : 0.05335545539855957 nb_pixel_total : 49485 time to create 1 rle with old method : 0.05505633354187012 time for calcul the mask position with numpy : 0.05734753608703613 nb_pixel_total : 33710 time to create 1 rle with old method : 0.03927969932556152 time for calcul the mask position with numpy : 0.05826377868652344 nb_pixel_total : 545625 time to create 1 rle with new method : 1.1766488552093506 time for calcul the mask position with numpy : 0.05318784713745117 nb_pixel_total : 38171 time to create 1 rle with old method : 0.054048776626586914 time for calcul the mask position with numpy : 0.06099081039428711 nb_pixel_total : 72015 time to create 1 rle with old method : 0.08076357841491699 time for calcul the mask position with numpy : 0.053684234619140625 nb_pixel_total : 4387 time to create 1 rle with old method : 0.005007743835449219 time for calcul the mask position with numpy : 0.057404279708862305 nb_pixel_total : 212079 time to create 1 rle with new method : 1.3571171760559082 time for calcul the mask position with numpy : 0.05560016632080078 nb_pixel_total : 93621 time to create 1 rle with old method : 0.10671353340148926 time for calcul the mask position with numpy : 0.05375480651855469 nb_pixel_total : 1318 time to create 1 rle with old method : 0.001996755599975586 time for calcul the mask position with numpy : 0.05673336982727051 nb_pixel_total : 44369 time to create 1 rle with old method : 0.051229238510131836 time for calcul the mask position with numpy : 0.0552215576171875 nb_pixel_total : 37394 time to create 1 rle with old method : 0.042032480239868164 time for calcul the mask position with numpy : 0.054451704025268555 nb_pixel_total : 191 time to create 1 rle with old method : 0.0010342597961425781 time for calcul the mask position with numpy : 0.05594444274902344 nb_pixel_total : 20540 time to create 1 rle with old method : 0.024839162826538086 time for calcul the mask position with numpy : 0.05658245086669922 nb_pixel_total : 32517 time to create 1 rle with old method : 0.05218696594238281 time for calcul the mask position with numpy : 0.05577826499938965 nb_pixel_total : 27345 time to create 1 rle with old method : 0.0322718620300293 time for calcul the mask position with numpy : 0.054294586181640625 nb_pixel_total : 39665 time to create 1 rle with old method : 0.044705867767333984 time for calcul the mask position with numpy : 0.05470108985900879 nb_pixel_total : 7950 time to create 1 rle with old method : 0.00917196273803711 time for calcul the mask position with numpy : 0.05663895606994629 nb_pixel_total : 27602 time to create 1 rle with old method : 0.03264451026916504 time for calcul the mask position with numpy : 0.05752897262573242 nb_pixel_total : 17027 time to create 1 rle with old method : 0.018904685974121094 time for calcul the mask position with numpy : 0.06366276741027832 nb_pixel_total : 584942 time to create 1 rle with new method : 1.5607635974884033 time for calcul the mask position with numpy : 0.05213785171508789 nb_pixel_total : 1666 time to create 1 rle with old method : 0.0026044845581054688 time for calcul the mask position with numpy : 0.05251669883728027 nb_pixel_total : 12532 time to create 1 rle with old method : 0.014307975769042969 time for calcul the mask position with numpy : 0.05438375473022461 nb_pixel_total : 1515 time to create 1 rle with old method : 0.001779317855834961 time for calcul the mask position with numpy : 0.053081512451171875 nb_pixel_total : 22348 time to create 1 rle with old method : 0.025757789611816406 time for calcul the mask position with numpy : 0.05306124687194824 nb_pixel_total : 101089 time to create 1 rle with old method : 0.1139061450958252 time for calcul the mask position with numpy : 0.05354189872741699 nb_pixel_total : 110342 time to create 1 rle with old method : 0.12966132164001465 time for calcul the mask position with numpy : 0.05440068244934082 nb_pixel_total : 14594 time to create 1 rle with old method : 0.016469478607177734 time for calcul the mask position with numpy : 0.06236743927001953 nb_pixel_total : 121168 time to create 1 rle with old method : 0.14465999603271484 time for calcul the mask position with numpy : 0.05236315727233887 nb_pixel_total : 2904 time to create 1 rle with old method : 0.003266572952270508 time for calcul the mask position with numpy : 0.05682206153869629 nb_pixel_total : 136568 time to create 1 rle with old method : 0.15358710289001465 time for calcul the mask position with numpy : 0.055826663970947266 nb_pixel_total : 95136 time to create 1 rle with old method : 0.10400843620300293 time for calcul the mask position with numpy : 0.05755209922790527 nb_pixel_total : 69099 time to create 1 rle with old method : 0.07808089256286621 time for calcul the mask position with numpy : 0.05400872230529785 nb_pixel_total : 27686 time to create 1 rle with old method : 0.031161069869995117 time for calcul the mask position with numpy : 0.05406308174133301 nb_pixel_total : 88373 time to create 1 rle with old method : 0.09850573539733887 time for calcul the mask position with numpy : 0.0609736442565918 nb_pixel_total : 59185 time to create 1 rle with old method : 0.07899355888366699 time for calcul the mask position with numpy : 0.054589033126831055 nb_pixel_total : 31920 time to create 1 rle with old method : 0.03647041320800781 time for calcul the mask position with numpy : 0.05487632751464844 nb_pixel_total : 76333 time to create 1 rle with old method : 0.08481574058532715 time for calcul the mask position with numpy : 0.053600311279296875 nb_pixel_total : 95514 time to create 1 rle with old method : 0.1061394214630127 time for calcul the mask position with numpy : 0.051456451416015625 nb_pixel_total : 42638 time to create 1 rle with old method : 0.04788541793823242 time for calcul the mask position with numpy : 0.06385469436645508 nb_pixel_total : 8218 time to create 1 rle with old method : 0.013347864151000977 time for calcul the mask position with numpy : 0.05590629577636719 nb_pixel_total : 39464 time to create 1 rle with old method : 0.044295549392700195 time for calcul the mask position with numpy : 0.05832815170288086 nb_pixel_total : 3925 time to create 1 rle with old method : 0.004895925521850586 time for calcul the mask position with numpy : 0.055257320404052734 nb_pixel_total : 136551 time to create 1 rle with old method : 0.1530451774597168 time for calcul the mask position with numpy : 0.054376840591430664 nb_pixel_total : 1239 time to create 1 rle with old method : 0.0019669532775878906 time for calcul the mask position with numpy : 0.05615520477294922 nb_pixel_total : 59447 time to create 1 rle with old method : 0.07113003730773926 time for calcul the mask position with numpy : 0.05476784706115723 nb_pixel_total : 162 time to create 1 rle with old method : 0.00027561187744140625 time for calcul the mask position with numpy : 0.05518913269042969 nb_pixel_total : 99941 time to create 1 rle with old method : 0.1099553108215332 time for calcul the mask position with numpy : 0.05336809158325195 nb_pixel_total : 1801 time to create 1 rle with old method : 0.002341032028198242 time for calcul the mask position with numpy : 0.05491185188293457 nb_pixel_total : 190872 time to create 1 rle with new method : 1.5638349056243896 time for calcul the mask position with numpy : 0.053896427154541016 nb_pixel_total : 155795 time to create 1 rle with new method : 1.1420748233795166 time for calcul the mask position with numpy : 0.0530703067779541 nb_pixel_total : 46687 time to create 1 rle with old method : 0.051477670669555664 time for calcul the mask position with numpy : 0.057889699935913086 nb_pixel_total : 10352 time to create 1 rle with old method : 0.012583255767822266 time for calcul the mask position with numpy : 0.05812835693359375 nb_pixel_total : 94419 time to create 1 rle with old method : 0.10475349426269531 time for calcul the mask position with numpy : 0.053507089614868164 nb_pixel_total : 33129 time to create 1 rle with old method : 0.03635907173156738 create new chi : 26.178974390029907 time to delete rle : 0.008370399475097656 batch 1 Loaded 85 chid ids of type : 4855 Number RLEs to save : 53793 TO DO : save crop sub photo not yet done ! save time : 3.2757458686828613 nb_obj : 80 nb_hashtags : 8 time to prepare the origin masks : 58.03487539291382 time for calcul the mask position with numpy : 0.4184131622314453 nb_pixel_total : 5513145 time to create 1 rle with new method : 1.2846968173980713 time for calcul the mask position with numpy : 0.05110812187194824 nb_pixel_total : 45137 time to create 1 rle with old method : 0.046298980712890625 time for calcul the mask position with numpy : 0.051967620849609375 nb_pixel_total : 26391 time to create 1 rle with old method : 0.0282745361328125 time for calcul the mask position with numpy : 0.052533626556396484 nb_pixel_total : 117388 time to create 1 rle with old method : 0.1289963722229004 time for calcul the mask position with numpy : 0.06307315826416016 nb_pixel_total : 263857 time to create 1 rle with new method : 1.0788071155548096 time for calcul the mask position with numpy : 0.05355119705200195 nb_pixel_total : 26905 time to create 1 rle with old method : 0.03091287612915039 time for calcul the mask position with numpy : 0.0685122013092041 nb_pixel_total : 64465 time to create 1 rle with old method : 0.12076067924499512 time for calcul the mask position with numpy : 0.07185745239257812 nb_pixel_total : 18855 time to create 1 rle with old method : 0.02852153778076172 time for calcul the mask position with numpy : 0.05872511863708496 nb_pixel_total : 113362 time to create 1 rle with old method : 0.14163589477539062 time for calcul the mask position with numpy : 0.05869269371032715 nb_pixel_total : 219795 time to create 1 rle with new method : 1.5832087993621826 time for calcul the mask position with numpy : 0.053678035736083984 nb_pixel_total : 29382 time to create 1 rle with old method : 0.033258676528930664 time for calcul the mask position with numpy : 0.05385017395019531 nb_pixel_total : 22643 time to create 1 rle with old method : 0.025656461715698242 time for calcul the mask position with numpy : 0.05350327491760254 nb_pixel_total : 47683 time to create 1 rle with old method : 0.05605363845825195 time for calcul the mask position with numpy : 0.053427696228027344 nb_pixel_total : 43806 time to create 1 rle with old method : 0.048947811126708984 time for calcul the mask position with numpy : 0.053552865982055664 nb_pixel_total : 41963 time to create 1 rle with old method : 0.04690265655517578 time for calcul the mask position with numpy : 0.05485248565673828 nb_pixel_total : 38967 time to create 1 rle with old method : 0.062043190002441406 time for calcul the mask position with numpy : 0.05473661422729492 nb_pixel_total : 92781 time to create 1 rle with old method : 0.10400605201721191 time for calcul the mask position with numpy : 0.05860543251037598 nb_pixel_total : 88122 time to create 1 rle with old method : 0.0985267162322998 time for calcul the mask position with numpy : 0.05505871772766113 nb_pixel_total : 136774 time to create 1 rle with old method : 0.15210247039794922 time for calcul the mask position with numpy : 0.05325722694396973 nb_pixel_total : 50328 time to create 1 rle with old method : 0.05617642402648926 time for calcul the mask position with numpy : 0.05394887924194336 nb_pixel_total : 156 time to create 1 rle with old method : 0.0004131793975830078 time for calcul the mask position with numpy : 0.054097890853881836 nb_pixel_total : 57879 time to create 1 rle with old method : 0.06444334983825684 time for calcul the mask position with numpy : 0.053377389907836914 nb_pixel_total : 33247 time to create 1 rle with old method : 0.037357330322265625 time for calcul the mask position with numpy : 0.05391359329223633 nb_pixel_total : 58997 time to create 1 rle with old method : 0.07130002975463867 time for calcul the mask position with numpy : 0.0531163215637207 nb_pixel_total : 52676 time to create 1 rle with old method : 0.05866742134094238 time for calcul the mask position with numpy : 0.053527116775512695 nb_pixel_total : 18111 time to create 1 rle with old method : 0.020601272583007812 time for calcul the mask position with numpy : 0.05553889274597168 nb_pixel_total : 82364 time to create 1 rle with old method : 0.09145426750183105 time for calcul the mask position with numpy : 0.05242156982421875 nb_pixel_total : 59893 time to create 1 rle with old method : 0.06604623794555664 time for calcul the mask position with numpy : 0.05440688133239746 nb_pixel_total : 297653 time to create 1 rle with new method : 1.1764779090881348 time for calcul the mask position with numpy : 0.07532644271850586 nb_pixel_total : 240829 time to create 1 rle with new method : 0.9601020812988281 time for calcul the mask position with numpy : 0.05294656753540039 nb_pixel_total : 167 time to create 1 rle with old method : 0.00044274330139160156 time for calcul the mask position with numpy : 0.05306291580200195 nb_pixel_total : 22821 time to create 1 rle with old method : 0.02555084228515625 time for calcul the mask position with numpy : 0.05295968055725098 nb_pixel_total : 582 time to create 1 rle with old method : 0.000766754150390625 time for calcul the mask position with numpy : 0.053809165954589844 nb_pixel_total : 101957 time to create 1 rle with old method : 0.11190962791442871 time for calcul the mask position with numpy : 0.054906368255615234 nb_pixel_total : 386534 time to create 1 rle with new method : 1.179671049118042 time for calcul the mask position with numpy : 0.052327632904052734 nb_pixel_total : 46440 time to create 1 rle with old method : 0.05065298080444336 time for calcul the mask position with numpy : 0.05329418182373047 nb_pixel_total : 4723 time to create 1 rle with old method : 0.005611419677734375 time for calcul the mask position with numpy : 0.052947044372558594 nb_pixel_total : 12340 time to create 1 rle with old method : 0.013962507247924805 time for calcul the mask position with numpy : 0.05385160446166992 nb_pixel_total : 93818 time to create 1 rle with old method : 0.10259771347045898 time for calcul the mask position with numpy : 0.05128121376037598 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005078315734863281 time for calcul the mask position with numpy : 0.05153489112854004 nb_pixel_total : 9375 time to create 1 rle with old method : 0.010218381881713867 time for calcul the mask position with numpy : 0.05338406562805176 nb_pixel_total : 291379 time to create 1 rle with new method : 2.045771837234497 time for calcul the mask position with numpy : 0.05143928527832031 nb_pixel_total : 33818 time to create 1 rle with old method : 0.036412715911865234 time for calcul the mask position with numpy : 0.05120849609375 nb_pixel_total : 130 time to create 1 rle with old method : 0.0003609657287597656 time for calcul the mask position with numpy : 0.05249905586242676 nb_pixel_total : 26920 time to create 1 rle with old method : 0.0298159122467041 time for calcul the mask position with numpy : 0.053804874420166016 nb_pixel_total : 79775 time to create 1 rle with old method : 0.08569741249084473 time for calcul the mask position with numpy : 0.0521087646484375 nb_pixel_total : 37013 time to create 1 rle with old method : 0.04023098945617676 time for calcul the mask position with numpy : 0.05982637405395508 nb_pixel_total : 631936 time to create 1 rle with new method : 1.2807097434997559 time for calcul the mask position with numpy : 0.05169200897216797 nb_pixel_total : 2160 time to create 1 rle with old method : 0.003484010696411133 time for calcul the mask position with numpy : 0.052214622497558594 nb_pixel_total : 71268 time to create 1 rle with old method : 0.07809138298034668 time for calcul the mask position with numpy : 0.05254840850830078 nb_pixel_total : 61127 time to create 1 rle with old method : 0.06654477119445801 time for calcul the mask position with numpy : 0.051392316818237305 nb_pixel_total : 16397 time to create 1 rle with old method : 0.017904281616210938 time for calcul the mask position with numpy : 0.052121639251708984 nb_pixel_total : 80383 time to create 1 rle with old method : 0.08714699745178223 time for calcul the mask position with numpy : 0.05326485633850098 nb_pixel_total : 87680 time to create 1 rle with old method : 0.09936165809631348 time for calcul the mask position with numpy : 0.05258011817932129 nb_pixel_total : 77392 time to create 1 rle with old method : 0.08488845825195312 time for calcul the mask position with numpy : 0.053774118423461914 nb_pixel_total : 175777 time to create 1 rle with new method : 1.270890474319458 time for calcul the mask position with numpy : 0.052215576171875 nb_pixel_total : 67332 time to create 1 rle with old method : 0.07259130477905273 time for calcul the mask position with numpy : 0.053334712982177734 nb_pixel_total : 97751 time to create 1 rle with old method : 0.10607194900512695 time for calcul the mask position with numpy : 0.05437183380126953 nb_pixel_total : 525997 time to create 1 rle with new method : 0.9911458492279053 time for calcul the mask position with numpy : 0.051526546478271484 nb_pixel_total : 906 time to create 1 rle with old method : 0.001172780990600586 time for calcul the mask position with numpy : 0.0521550178527832 nb_pixel_total : 325235 time to create 1 rle with new method : 1.1336674690246582 time for calcul the mask position with numpy : 0.05394124984741211 nb_pixel_total : 34035 time to create 1 rle with old method : 0.054261207580566406 time for calcul the mask position with numpy : 0.05281400680541992 nb_pixel_total : 644 time to create 1 rle with old method : 0.0012195110321044922 time for calcul the mask position with numpy : 0.05212068557739258 nb_pixel_total : 176241 time to create 1 rle with new method : 1.1234066486358643 time for calcul the mask position with numpy : 0.052651166915893555 nb_pixel_total : 74698 time to create 1 rle with old method : 0.08345365524291992 time for calcul the mask position with numpy : 0.05234122276306152 nb_pixel_total : 504 time to create 1 rle with old method : 0.0009913444519042969 time for calcul the mask position with numpy : 0.050199031829833984 nb_pixel_total : 21050 time to create 1 rle with old method : 0.022530317306518555 time for calcul the mask position with numpy : 0.05579185485839844 nb_pixel_total : 689339 time to create 1 rle with new method : 0.9651553630828857 time for calcul the mask position with numpy : 0.052741289138793945 nb_pixel_total : 240919 time to create 1 rle with new method : 1.0590229034423828 time for calcul the mask position with numpy : 0.05260729789733887 nb_pixel_total : 83335 time to create 1 rle with old method : 0.09125232696533203 time for calcul the mask position with numpy : 0.052539825439453125 nb_pixel_total : 81601 time to create 1 rle with old method : 0.08747529983520508 time for calcul the mask position with numpy : 0.05361461639404297 nb_pixel_total : 7307 time to create 1 rle with old method : 0.012336015701293945 time for calcul the mask position with numpy : 0.06024599075317383 nb_pixel_total : 36689 time to create 1 rle with old method : 0.040592193603515625 time for calcul the mask position with numpy : 0.053405046463012695 nb_pixel_total : 2340 time to create 1 rle with old method : 0.0027017593383789062 time for calcul the mask position with numpy : 0.05304980278015137 nb_pixel_total : 73850 time to create 1 rle with old method : 0.08105301856994629 time for calcul the mask position with numpy : 0.052318572998046875 nb_pixel_total : 32858 time to create 1 rle with old method : 0.0372774600982666 time for calcul the mask position with numpy : 0.05483222007751465 nb_pixel_total : 57425 time to create 1 rle with old method : 0.0639805793762207 time for calcul the mask position with numpy : 0.053109169006347656 nb_pixel_total : 1793 time to create 1 rle with old method : 0.0023331642150878906 time for calcul the mask position with numpy : 0.053011417388916016 nb_pixel_total : 18258 time to create 1 rle with old method : 0.020434856414794922 time for calcul the mask position with numpy : 0.0532224178314209 nb_pixel_total : 51399 time to create 1 rle with old method : 0.06279850006103516 time for calcul the mask position with numpy : 0.053565263748168945 nb_pixel_total : 21827 time to create 1 rle with old method : 0.024275779724121094 create new chi : 25.94080662727356 time to delete rle : 0.0056781768798828125 batch 1 Loaded 84 chid ids of type : 4855 Number RLEs to save : 54923 TO DO : save crop sub photo not yet done ! save time : 3.328270435333252 nb_obj : 78 nb_hashtags : 10 time to prepare the origin masks : 61.61755394935608 time for calcul the mask position with numpy : 0.6817536354064941 nb_pixel_total : 6006860 time to create 1 rle with new method : 1.8411431312561035 time for calcul the mask position with numpy : 0.05237102508544922 nb_pixel_total : 34076 time to create 1 rle with old method : 0.036704301834106445 time for calcul the mask position with numpy : 0.05230379104614258 nb_pixel_total : 25497 time to create 1 rle with old method : 0.02857518196105957 time for calcul the mask position with numpy : 0.052095651626586914 nb_pixel_total : 11615 time to create 1 rle with old method : 0.012433290481567383 time for calcul the mask position with numpy : 0.05088233947753906 nb_pixel_total : 8103 time to create 1 rle with old method : 0.017416715621948242 time for calcul the mask position with numpy : 0.05264616012573242 nb_pixel_total : 25498 time to create 1 rle with old method : 0.02863335609436035 time for calcul the mask position with numpy : 0.052831411361694336 nb_pixel_total : 34157 time to create 1 rle with old method : 0.03713822364807129 time for calcul the mask position with numpy : 0.05208110809326172 nb_pixel_total : 6600 time to create 1 rle with old method : 0.007271528244018555 time for calcul the mask position with numpy : 0.052483558654785156 nb_pixel_total : 84460 time to create 1 rle with old method : 0.08987903594970703 time for calcul the mask position with numpy : 0.05159735679626465 nb_pixel_total : 6811 time to create 1 rle with old method : 0.008776426315307617 time for calcul the mask position with numpy : 0.06071877479553223 nb_pixel_total : 123869 time to create 1 rle with old method : 0.1352062225341797 time for calcul the mask position with numpy : 0.054415225982666016 nb_pixel_total : 23634 time to create 1 rle with old method : 0.026991605758666992 time for calcul the mask position with numpy : 0.05510735511779785 nb_pixel_total : 182562 time to create 1 rle with new method : 1.5714960098266602 time for calcul the mask position with numpy : 0.052184104919433594 nb_pixel_total : 50900 time to create 1 rle with old method : 0.053459882736206055 time for calcul the mask position with numpy : 0.05637717247009277 nb_pixel_total : 7056 time to create 1 rle with old method : 0.008110761642456055 time for calcul the mask position with numpy : 0.052918195724487305 nb_pixel_total : 28297 time to create 1 rle with old method : 0.031690359115600586 time for calcul the mask position with numpy : 0.05357766151428223 nb_pixel_total : 44383 time to create 1 rle with old method : 0.04930710792541504 time for calcul the mask position with numpy : 0.05434107780456543 nb_pixel_total : 48752 time to create 1 rle with old method : 0.05277299880981445 time for calcul the mask position with numpy : 0.052701711654663086 nb_pixel_total : 6228 time to create 1 rle with old method : 0.006767749786376953 time for calcul the mask position with numpy : 0.14915776252746582 nb_pixel_total : 765493 time to create 1 rle with new method : 1.7295184135437012 time for calcul the mask position with numpy : 0.06293678283691406 nb_pixel_total : 628600 time to create 1 rle with new method : 2.305584669113159 time for calcul the mask position with numpy : 0.0544886589050293 nb_pixel_total : 36318 time to create 1 rle with old method : 0.039311885833740234 time for calcul the mask position with numpy : 0.05224275588989258 nb_pixel_total : 13844 time to create 1 rle with old method : 0.014864921569824219 time for calcul the mask position with numpy : 0.05327749252319336 nb_pixel_total : 45757 time to create 1 rle with old method : 0.04867291450500488 time for calcul the mask position with numpy : 0.05639386177062988 nb_pixel_total : 155068 time to create 1 rle with new method : 2.429582357406616 time for calcul the mask position with numpy : 0.06223702430725098 nb_pixel_total : 46257 time to create 1 rle with old method : 0.05260515213012695 time for calcul the mask position with numpy : 0.06213212013244629 nb_pixel_total : 457674 time to create 1 rle with new method : 1.2994673252105713 time for calcul the mask position with numpy : 0.05186915397644043 nb_pixel_total : 27400 time to create 1 rle with old method : 0.030464887619018555 time for calcul the mask position with numpy : 0.053739070892333984 nb_pixel_total : 93708 time to create 1 rle with old method : 0.09983682632446289 time for calcul the mask position with numpy : 0.052947282791137695 nb_pixel_total : 83732 time to create 1 rle with old method : 0.10159754753112793 time for calcul the mask position with numpy : 0.05310225486755371 nb_pixel_total : 61809 time to create 1 rle with old method : 0.06805610656738281 time for calcul the mask position with numpy : 0.058129072189331055 nb_pixel_total : 499681 time to create 1 rle with new method : 1.5360493659973145 time for calcul the mask position with numpy : 0.05426502227783203 nb_pixel_total : 71488 time to create 1 rle with old method : 0.08203983306884766 time for calcul the mask position with numpy : 0.05256390571594238 nb_pixel_total : 17566 time to create 1 rle with old method : 0.019170045852661133 time for calcul the mask position with numpy : 0.05577874183654785 nb_pixel_total : 961 time to create 1 rle with old method : 0.0012574195861816406 time for calcul the mask position with numpy : 0.0517725944519043 nb_pixel_total : 3236 time to create 1 rle with old method : 0.0036497116088867188 time for calcul the mask position with numpy : 0.051590681076049805 nb_pixel_total : 32197 time to create 1 rle with old method : 0.0352938175201416 time for calcul the mask position with numpy : 0.05429267883300781 nb_pixel_total : 85508 time to create 1 rle with old method : 0.1001579761505127 time for calcul the mask position with numpy : 0.05458569526672363 nb_pixel_total : 21683 time to create 1 rle with old method : 0.024141550064086914 time for calcul the mask position with numpy : 0.05394554138183594 nb_pixel_total : 170020 time to create 1 rle with new method : 1.395256757736206 time for calcul the mask position with numpy : 0.052933454513549805 nb_pixel_total : 122756 time to create 1 rle with old method : 0.13889646530151367 time for calcul the mask position with numpy : 0.05285978317260742 nb_pixel_total : 20007 time to create 1 rle with old method : 0.0222318172454834 time for calcul the mask position with numpy : 0.052593231201171875 nb_pixel_total : 10611 time to create 1 rle with old method : 0.01186513900756836 time for calcul the mask position with numpy : 0.05316495895385742 nb_pixel_total : 62162 time to create 1 rle with old method : 0.06925368309020996 time for calcul the mask position with numpy : 0.05200815200805664 nb_pixel_total : 100144 time to create 1 rle with old method : 0.10696101188659668 time for calcul the mask position with numpy : 0.05163097381591797 nb_pixel_total : 166 time to create 1 rle with old method : 0.000431060791015625 time for calcul the mask position with numpy : 0.05658388137817383 nb_pixel_total : 410063 time to create 1 rle with new method : 1.3089368343353271 time for calcul the mask position with numpy : 0.05209970474243164 nb_pixel_total : 1679 time to create 1 rle with old method : 0.0020301342010498047 time for calcul the mask position with numpy : 0.05078005790710449 nb_pixel_total : 11639 time to create 1 rle with old method : 0.012403249740600586 time for calcul the mask position with numpy : 0.05134701728820801 nb_pixel_total : 110642 time to create 1 rle with old method : 0.11544489860534668 time for calcul the mask position with numpy : 0.05072498321533203 nb_pixel_total : 5389 time to create 1 rle with old method : 0.006827831268310547 time for calcul the mask position with numpy : 0.05556488037109375 nb_pixel_total : 431871 time to create 1 rle with new method : 1.3353404998779297 time for calcul the mask position with numpy : 0.050757646560668945 nb_pixel_total : 22946 time to create 1 rle with old method : 0.024323225021362305 time for calcul the mask position with numpy : 0.051378726959228516 nb_pixel_total : 147 time to create 1 rle with old method : 0.00039768218994140625 time for calcul the mask position with numpy : 0.05093979835510254 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005385875701904297 time for calcul the mask position with numpy : 0.05210280418395996 nb_pixel_total : 180681 time to create 1 rle with new method : 1.519578456878662 time for calcul the mask position with numpy : 0.052101850509643555 nb_pixel_total : 188799 time to create 1 rle with new method : 0.9475133419036865 time for calcul the mask position with numpy : 0.05496573448181152 nb_pixel_total : 37706 time to create 1 rle with old method : 0.0426177978515625 time for calcul the mask position with numpy : 0.05515718460083008 nb_pixel_total : 7650 time to create 1 rle with old method : 0.009370803833007812 time for calcul the mask position with numpy : 0.05863022804260254 nb_pixel_total : 34416 time to create 1 rle with old method : 0.03874015808105469 time for calcul the mask position with numpy : 0.05520820617675781 nb_pixel_total : 48008 time to create 1 rle with old method : 0.05467057228088379 time for calcul the mask position with numpy : 0.056328773498535156 nb_pixel_total : 13285 time to create 1 rle with old method : 0.020824193954467773 time for calcul the mask position with numpy : 0.06458926200866699 nb_pixel_total : 106980 time to create 1 rle with old method : 0.1760082244873047 time for calcul the mask position with numpy : 0.05720686912536621 nb_pixel_total : 200001 time to create 1 rle with new method : 1.167203664779663 time for calcul the mask position with numpy : 0.05470395088195801 nb_pixel_total : 12168 time to create 1 rle with old method : 0.013757944107055664 time for calcul the mask position with numpy : 0.053121089935302734 nb_pixel_total : 36803 time to create 1 rle with old method : 0.0392758846282959 time for calcul the mask position with numpy : 0.055521249771118164 nb_pixel_total : 304654 time to create 1 rle with new method : 1.116290807723999 time for calcul the mask position with numpy : 0.05096626281738281 nb_pixel_total : 3595 time to create 1 rle with old method : 0.004472494125366211 time for calcul the mask position with numpy : 0.05272960662841797 nb_pixel_total : 410 time to create 1 rle with old method : 0.001115560531616211 time for calcul the mask position with numpy : 0.05315756797790527 nb_pixel_total : 100105 time to create 1 rle with old method : 0.10501527786254883 time for calcul the mask position with numpy : 0.05258750915527344 nb_pixel_total : 36858 time to create 1 rle with old method : 0.03888130187988281 time for calcul the mask position with numpy : 0.052170515060424805 nb_pixel_total : 12659 time to create 1 rle with old method : 0.01473093032836914 time for calcul the mask position with numpy : 0.05376458168029785 nb_pixel_total : 134136 time to create 1 rle with old method : 0.14186859130859375 time for calcul the mask position with numpy : 0.052384138107299805 nb_pixel_total : 1541 time to create 1 rle with old method : 0.0021054744720458984 time for calcul the mask position with numpy : 0.05301070213317871 nb_pixel_total : 27753 time to create 1 rle with old method : 0.029558658599853516 time for calcul the mask position with numpy : 0.053811073303222656 nb_pixel_total : 62167 time to create 1 rle with old method : 0.06646990776062012 time for calcul the mask position with numpy : 0.052176475524902344 nb_pixel_total : 1090 time to create 1 rle with old method : 0.001959085464477539 time for calcul the mask position with numpy : 0.05152082443237305 nb_pixel_total : 39725 time to create 1 rle with old method : 0.04300332069396973 time for calcul the mask position with numpy : 0.05093050003051758 nb_pixel_total : 77 time to create 1 rle with old method : 0.00011992454528808594 create new chi : 29.90979027748108 time to delete rle : 0.005762815475463867 batch 1 Loaded 81 chid ids of type : 4855 Number RLEs to save : 47427 TO DO : save crop sub photo not yet done ! save time : 2.821734666824341 nb_obj : 47 nb_hashtags : 8 time to prepare the origin masks : 40.05006003379822 time for calcul the mask position with numpy : 0.43161988258361816 nb_pixel_total : 7246987 time to create 1 rle with new method : 2.849165916442871 time for calcul the mask position with numpy : 0.05015683174133301 nb_pixel_total : 22219 time to create 1 rle with old method : 0.02550983428955078 time for calcul the mask position with numpy : 0.21591401100158691 nb_pixel_total : 2031622 time to create 1 rle with new method : 1.9746496677398682 time for calcul the mask position with numpy : 0.05177140235900879 nb_pixel_total : 45476 time to create 1 rle with old method : 0.04674100875854492 time for calcul the mask position with numpy : 0.054785966873168945 nb_pixel_total : 248942 time to create 1 rle with new method : 1.8185062408447266 time for calcul the mask position with numpy : 0.06924104690551758 nb_pixel_total : 415731 time to create 1 rle with new method : 1.7023696899414062 time for calcul the mask position with numpy : 0.05076766014099121 nb_pixel_total : 2555 time to create 1 rle with old method : 0.0029091835021972656 time for calcul the mask position with numpy : 0.05084633827209473 nb_pixel_total : 16 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.05053400993347168 nb_pixel_total : 19588 time to create 1 rle with old method : 0.020490646362304688 time for calcul the mask position with numpy : 0.052469730377197266 nb_pixel_total : 4014 time to create 1 rle with old method : 0.004407644271850586 time for calcul the mask position with numpy : 0.05223369598388672 nb_pixel_total : 68290 time to create 1 rle with old method : 0.07156205177307129 time for calcul the mask position with numpy : 0.05095195770263672 nb_pixel_total : 28020 time to create 1 rle with old method : 0.029584407806396484 time for calcul the mask position with numpy : 0.05172872543334961 nb_pixel_total : 12508 time to create 1 rle with old method : 0.013416528701782227 time for calcul the mask position with numpy : 0.05118298530578613 nb_pixel_total : 28746 time to create 1 rle with old method : 0.02996349334716797 time for calcul the mask position with numpy : 0.0508570671081543 nb_pixel_total : 29421 time to create 1 rle with old method : 0.03078174591064453 time for calcul the mask position with numpy : 0.05095314979553223 nb_pixel_total : 42725 time to create 1 rle with old method : 0.04561924934387207 time for calcul the mask position with numpy : 0.051136016845703125 nb_pixel_total : 500 time to create 1 rle with old method : 0.0008699893951416016 time for calcul the mask position with numpy : 0.051148414611816406 nb_pixel_total : 21836 time to create 1 rle with old method : 0.022917985916137695 time for calcul the mask position with numpy : 0.05308198928833008 nb_pixel_total : 330058 time to create 1 rle with new method : 2.4705440998077393 time for calcul the mask position with numpy : 0.05206298828125 nb_pixel_total : 12408 time to create 1 rle with old method : 0.01292276382446289 time for calcul the mask position with numpy : 0.05421900749206543 nb_pixel_total : 212643 time to create 1 rle with new method : 2.0750722885131836 time for calcul the mask position with numpy : 0.051903724670410156 nb_pixel_total : 36569 time to create 1 rle with old method : 0.0389094352722168 time for calcul the mask position with numpy : 0.053183794021606445 nb_pixel_total : 78260 time to create 1 rle with old method : 0.08596014976501465 time for calcul the mask position with numpy : 0.05499100685119629 nb_pixel_total : 5935 time to create 1 rle with old method : 0.006562709808349609 time for calcul the mask position with numpy : 0.05131721496582031 nb_pixel_total : 65396 time to create 1 rle with old method : 0.06977987289428711 time for calcul the mask position with numpy : 0.054559946060180664 nb_pixel_total : 41992 time to create 1 rle with old method : 0.046999216079711914 time for calcul the mask position with numpy : 0.05484461784362793 nb_pixel_total : 75764 time to create 1 rle with old method : 0.0848689079284668 time for calcul the mask position with numpy : 0.05469155311584473 nb_pixel_total : 21457 time to create 1 rle with old method : 0.024010181427001953 time for calcul the mask position with numpy : 0.06060218811035156 nb_pixel_total : 1881 time to create 1 rle with old method : 0.003679513931274414 time for calcul the mask position with numpy : 0.05522465705871582 nb_pixel_total : 77046 time to create 1 rle with old method : 0.10166406631469727 time for calcul the mask position with numpy : 0.07062745094299316 nb_pixel_total : 598433 time to create 1 rle with new method : 2.5496273040771484 time for calcul the mask position with numpy : 0.05266070365905762 nb_pixel_total : 22538 time to create 1 rle with old method : 0.024686336517333984 time for calcul the mask position with numpy : 0.05204439163208008 nb_pixel_total : 103679 time to create 1 rle with old method : 0.11108016967773438 time for calcul the mask position with numpy : 0.054711341857910156 nb_pixel_total : 208502 time to create 1 rle with new method : 1.6285746097564697 time for calcul the mask position with numpy : 0.06481409072875977 nb_pixel_total : 56221 time to create 1 rle with old method : 0.06419849395751953 time for calcul the mask position with numpy : 0.05483198165893555 nb_pixel_total : 49169 time to create 1 rle with old method : 0.0635833740234375 time for calcul the mask position with numpy : 0.059722185134887695 nb_pixel_total : 8 time to create 1 rle with old method : 5.173683166503906e-05 time for calcul the mask position with numpy : 0.05410289764404297 nb_pixel_total : 49584 time to create 1 rle with old method : 0.05463814735412598 time for calcul the mask position with numpy : 0.05569624900817871 nb_pixel_total : 242130 time to create 1 rle with new method : 1.9236958026885986 time for calcul the mask position with numpy : 0.05553150177001953 nb_pixel_total : 53424 time to create 1 rle with old method : 0.05939626693725586 time for calcul the mask position with numpy : 0.054198265075683594 nb_pixel_total : 37831 time to create 1 rle with old method : 0.042122602462768555 time for calcul the mask position with numpy : 0.05518031120300293 nb_pixel_total : 51882 time to create 1 rle with old method : 0.057096242904663086 time for calcul the mask position with numpy : 0.053664445877075195 nb_pixel_total : 201 time to create 1 rle with old method : 0.00043702125549316406 time for calcul the mask position with numpy : 0.05381202697753906 nb_pixel_total : 124469 time to create 1 rle with old method : 0.1353466510772705 time for calcul the mask position with numpy : 0.052855491638183594 nb_pixel_total : 735 time to create 1 rle with old method : 0.0012822151184082031 time for calcul the mask position with numpy : 0.05449390411376953 nb_pixel_total : 7076 time to create 1 rle with old method : 0.008392810821533203 time for calcul the mask position with numpy : 0.056313276290893555 nb_pixel_total : 127017 time to create 1 rle with old method : 0.1339423656463623 time for calcul the mask position with numpy : 0.051232337951660156 nb_pixel_total : 17696 time to create 1 rle with old method : 0.0185699462890625 create new chi : 24.21987795829773 time to delete rle : 0.003567934036254883 batch 1 Loaded 49 chid ids of type : 4855 Number RLEs to save : 29677 TO DO : save crop sub photo not yet done ! save time : 1.7482538223266602 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 30.135200023651123 time for calcul the mask position with numpy : 0.45171070098876953 nb_pixel_total : 1633937 time to create 1 rle with new method : 1.5251827239990234 time for calcul the mask position with numpy : 0.06944680213928223 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0012764930725097656 time for calcul the mask position with numpy : 0.07064652442932129 nb_pixel_total : 17200 time to create 1 rle with old method : 0.019515037536621094 time for calcul the mask position with numpy : 0.07174992561340332 nb_pixel_total : 3888 time to create 1 rle with old method : 0.007915973663330078 time for calcul the mask position with numpy : 0.04377555847167969 nb_pixel_total : 365859 time to create 1 rle with new method : 1.6388373374938965 time for calcul the mask position with numpy : 0.07965445518493652 nb_pixel_total : 1529179 time to create 1 rle with new method : 2.0782241821289062 time for calcul the mask position with numpy : 0.07206869125366211 nb_pixel_total : 5268 time to create 1 rle with old method : 0.0071828365325927734 time for calcul the mask position with numpy : 0.07869887351989746 nb_pixel_total : 670213 time to create 1 rle with new method : 1.7278265953063965 time for calcul the mask position with numpy : 0.0921022891998291 nb_pixel_total : 247676 time to create 1 rle with new method : 2.115035057067871 time for calcul the mask position with numpy : 0.07318997383117676 nb_pixel_total : 416337 time to create 1 rle with new method : 1.3672351837158203 time for calcul the mask position with numpy : 0.07265853881835938 nb_pixel_total : 130300 time to create 1 rle with old method : 0.14450621604919434 time for calcul the mask position with numpy : 0.9297318458557129 nb_pixel_total : 7958334 time to create 1 rle with new method : 1.5830912590026855 create new chi : 14.69157600402832 time to delete rle : 0.0028095245361328125 batch 1 Loaded 12 chid ids of type : 4855 Number RLEs to save : 23227 TO DO : save crop sub photo not yet done ! save time : 1.4155693054199219 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 39.18211913108826 time for calcul the mask position with numpy : 0.13564848899841309 nb_pixel_total : 2326917 time to create 1 rle with new method : 1.7111561298370361 time for calcul the mask position with numpy : 0.06603860855102539 nb_pixel_total : 23563 time to create 1 rle with old method : 0.030843257904052734 time for calcul the mask position with numpy : 0.06490945816040039 nb_pixel_total : 41997 time to create 1 rle with old method : 0.04780459403991699 time for calcul the mask position with numpy : 0.1304488182067871 nb_pixel_total : 1653443 time to create 1 rle with new method : 1.891559362411499 time for calcul the mask position with numpy : 0.06856298446655273 nb_pixel_total : 139810 time to create 1 rle with old method : 0.1584632396697998 time for calcul the mask position with numpy : 0.06405162811279297 nb_pixel_total : 5704 time to create 1 rle with old method : 0.006526947021484375 time for calcul the mask position with numpy : 0.07494974136352539 nb_pixel_total : 507019 time to create 1 rle with new method : 1.8697264194488525 time for calcul the mask position with numpy : 0.07354974746704102 nb_pixel_total : 642859 time to create 1 rle with new method : 2.186323881149292 time for calcul the mask position with numpy : 0.07226371765136719 nb_pixel_total : 118532 time to create 1 rle with old method : 0.1475372314453125 time for calcul the mask position with numpy : 0.07967305183410645 nb_pixel_total : 488 time to create 1 rle with old method : 0.0020933151245117188 time for calcul the mask position with numpy : 0.09163641929626465 nb_pixel_total : 991294 time to create 1 rle with new method : 2.820457696914673 time for calcul the mask position with numpy : 0.0716249942779541 nb_pixel_total : 107280 time to create 1 rle with old method : 0.12823820114135742 time for calcul the mask position with numpy : 0.0725550651550293 nb_pixel_total : 49482 time to create 1 rle with old method : 0.060109615325927734 time for calcul the mask position with numpy : 0.6561193466186523 nb_pixel_total : 6370812 time to create 1 rle with new method : 1.9617791175842285 create new chi : 15.063167333602905 time to delete rle : 0.003961086273193359 batch 1 Loaded 18 chid ids of type : 4855 Number RLEs to save : 27460 TO DO : save crop sub photo not yet done ! save time : 1.6487820148468018 map_output_result : {1356361583: (0.643985878067511, 'Should be the crop_list due to order', 0.9357400763800485), 1356361548: (0.643985878067511, 'Should be the crop_list due to order', 0.6592915898057392), 1356361543: (0.643985878067511, 'Should be the crop_list due to order', 0.5172327845655517), 1356361537: (0.643985878067511, 'Should be the crop_list due to order', 0.5244871022182259), 1356361530: (0.643985878067511, 'Should be the crop_list due to order', 0.6452382869751485), 1356361523: (0.643985878067511, 'Should be the crop_list due to order', 0.8275410909065589), 1356361517: (0.643985878067511, 'Should be the crop_list due to order', 0.3983702156213034)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 7 /1356361583.Didn't retrieve data . /1356361548.Didn't retrieve data . /1356361543.Didn't retrieve data . /1356361537.Didn't retrieve data . /1356361530.Didn't retrieve data . /1356361523.Didn't retrieve data . /1356361517.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361583', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361548', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361543', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361537', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361530', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361523', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361517', None, None, None, None, None, '2799185') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.019083261489868164 save_final save missing photos in datou_result : time spend for datou_step_exec : 513.3959050178528 time spend to save output : 0.026987791061401367 total time spend for step 5 : 513.4228928089142 step6:crop_condition Tue May 6 23:14:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 357 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3015255 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566122_2414188 we have uploaded 25 photos in the portfolio 3015255 time of upload the photos Elapsed time : 13.221556425094604 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3015255 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566151_2414188 we have uploaded 40 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.954076051712036 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3015255 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566171_2414188 we have uploaded 24 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.65748143196106 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3015255 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566182_2414188 we have uploaded 5 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.6529207229614258 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 3015255 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566204_2414188 we have uploaded 51 photos in the portfolio 3015255 time of upload the photos Elapsed time : 18.57375955581665 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566226_2414188 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5894637107849121 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 41 About to insert : list_path_to_insert length 41 new photo from crops ! About to upload 41 photos upload in portfolio : 3015255 init cache_photo without model_param we have 41 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566281_2414188 we have uploaded 41 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.684631824493408 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566295_2414188 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.8242542743682861 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3015255 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566302_2414188 we have uploaded 12 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.7403297424316406 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3015255 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746566547_2414188 we have uploaded 40 photos in the portfolio 3015255 time of upload the photos Elapsed time : 19.980145931243896 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 240 /1356497040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356497501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356499982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361583', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361548', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361543', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361537', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361530', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361523', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361517', None, None, None, None, None, '2799185') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 727 time used for this insertion : 0.06801652908325195 save_final save missing photos in datou_result : time spend for datou_step_exec : 478.4980435371399 time spend to save output : 1.043733835220337 total time spend for step 6 : 479.54177737236023 step7:ventilate_hashtags_in_portfolio Tue May 6 23:22:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22731300 get user id for portfolio 22731300 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731300 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731300 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731300 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731300 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/22738510,22738511,22738512,22738513,22738514,22738519,22738521,22738522,22738524,22738530,22738535,22738538,22738540,22738541,22738542,22738543,22738544,22738545,22738546,22738548?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22731300 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 1 /22731300. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361583', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361548', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361543', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361537', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361530', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361523', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361517', None, None, None, None, None, '2799185') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013377666473388672 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.086959362030029 time spend to save output : 0.013965606689453125 total time spend for step 7 : 4.100924968719482 step8:final Tue May 6 23:22:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356361583: ('0.5970367361592006',), 1356361548: ('0.5970367361592006',), 1356361543: ('0.5970367361592006',), 1356361537: ('0.5970367361592006',), 1356361530: ('0.5970367361592006',), 1356361523: ('0.5970367361592006',), 1356361517: ('0.5970367361592006',)} new output for save of step final : {1356361583: ('0.5970367361592006',), 1356361548: ('0.5970367361592006',), 1356361543: ('0.5970367361592006',), 1356361537: ('0.5970367361592006',), 1356361530: ('0.5970367361592006',), 1356361523: ('0.5970367361592006',), 1356361517: ('0.5970367361592006',)} [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 7 /1356361583.Didn't retrieve data . /1356361548.Didn't retrieve data . /1356361543.Didn't retrieve data . /1356361537.Didn't retrieve data . /1356361530.Didn't retrieve data . /1356361523.Didn't retrieve data . /1356361517.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361583', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361548', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361543', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361537', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361530', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361523', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361517', None, None, None, None, None, '2799185') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.012723445892333984 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10475778579711914 time spend to save output : 0.013192892074584961 total time spend for step 8 : 0.1179506778717041 step9:velours_tree Tue May 6 23:22:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.6145796775817871 time spend to save output : 3.695487976074219e-05 total time spend for step 9 : 0.6146166324615479 step10:send_mail_cod Tue May 6 23:22:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22731300_06-05-2025_23_22_56.pdf 22738477 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227384771746566576 22738478 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227384781746566578 22738480 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227384801746566579 22738481 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227384811746566581 22738482 imagette227384821746566582 22738483 imagette227384831746566582 22738485 imagette227384851746566582 22738486 imagette227384861746566582 22738487 imagette227384871746566582 22738489 imagette227384891746566582 22738490 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227384901746566582 22738491 change filename to text .imagette227384911746566584 22738492 imagette227384921746566584 22738494 imagette227384941746566584 22738495 imagette227384951746566584 22738496 imagette227384961746566584 22738498 imagette227384981746566584 22738499 change filename to text .imagette227384991746566584 22738500 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227385001746566584 22738503 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227385031746566585 22738504 imagette227385041746566587 22738505 imagette227385051746566587 22738507 imagette227385071746566587 22738508 imagette227385081746566587 22738509 imagette227385091746566587 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22731300 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22738510,22738511,22738512,22738513,22738514,22738519,22738521,22738522,22738524,22738530,22738535,22738538,22738540,22738541,22738542,22738543,22738544,22738545,22738546,22738548?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22731300 your option no_mail is active, we will not send the real mail to your client args[1356361583] : ((1356361583, 995.6443410907566, 2107751945), (1356361583, -0.22533855902404604, 496442774), '0.5970367361592006') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361548] : ((1356361548, 4662.018021972973, 492609224), (1356361548, -0.3648077506476149, 496442774), '0.5970367361592006') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361543] : ((1356361543, 4208.3290057896575, 492609224), (1356361543, -0.16905383703216303, 496442774), '0.5970367361592006') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361537] : ((1356361537, 3034.2725583232705, 492609224), (1356361537, -0.3339108909735234, 496442774), '0.5970367361592006') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361530] : ((1356361530, 3071.399476237449, 492609224), (1356361530, -0.40043610117869666, 496442774), '0.5970367361592006') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361523] : ((1356361523, 127.61887722167494, 492688767), (1356361523, -1.3618691818971234, 501862349), '0.5970367361592006') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361517] : ((1356361517, 913.5448104385467, 2107751945), (1356361517, -0.7327232120173187, 501862349), '0.5970367361592006') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.5970367361592006 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731300_06-05-2025_23_22_56.pdf results_Auto_P22731300_06-05-2025_23_22_56.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731300_06-05-2025_23_22_56.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','22731300','results_Auto_P22731300_06-05-2025_23_22_56.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731300_06-05-2025_23_22_56.pdf','pdf','','2.24','0.5970367361592006') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361583', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361548', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361543', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361537', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361530', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361523', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361517', None, None, None, None, None, '2799185') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.012764453887939453 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.537256717681885 time spend to save output : 0.013110876083374023 total time spend for step 10 : 14.550367593765259 step11:split_time_score Tue May 6 23:23:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('33', 2), ('34', 2), ('35', 2), ('40', 1)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06052025 22731300 Nombre de photos uploadées : 7 / 23040 (0%) 06052025 22731300 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 06052025 22731300 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.1444091796875e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0006248950958251953 elapsed_time : insert_dashboard_record_day_entry 0.022159099578857422 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.5970367361592006 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731300_06-05-2025_23_22_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731300 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731300 AND mptpi.`type`=4855 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731301 order by id desc limit 1 Qualite : 0.5070817592326927 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731302_06-05-2025_22_55_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731302 AND mptpi.`type`=4855 To do Qualite : 0.6386387749089113 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731303_06-05-2025_22_14_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731303 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731303 AND mptpi.`type`=4855 To do Qualite : 0.5753207720446533 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731304_06-05-2025_21_53_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731304 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731304 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06052025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 1 /22731300Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361583', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361548', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361543', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361537', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361530', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361523', None, None, None, None, None, '2799185') ('4741', None, None, None, None, None, None, None, '2799185') ('4741', '22731300', '1356361517', None, None, None, None, None, '2799185') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01339864730834961 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3152778148651123 time spend to save output : 0.013641119003295898 total time spend for step 11 : 1.3289189338684082 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 780.95user 454.09system 21:47.03elapsed 94%CPU (0avgtext+0avgdata 6592924maxresident)k 3189760inputs+839064outputs (27672major+63257815minor)pagefaults 0swaps