python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 835981 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['3628597'] with mtr_portfolio_ids : ['26307203'] and first list_photo_ids : [] new path : /proc/835981/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.7935459613800049 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Thu Aug 28 23:01:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10379 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-28 23:01:33.120263: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-28 23:01:33.148495: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-28 23:01:33.150917: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9cb8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-28 23:01:33.150974: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-28 23:01:33.154869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-28 23:01:33.334435: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x42951fe0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-28 23:01:33.334496: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-28 23:01:33.335883: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 23:01:33.336294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 23:01:33.339474: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 23:01:33.342476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 23:01:33.342983: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 23:01:33.346134: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 23:01:33.347198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 23:01:33.351747: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 23:01:33.353202: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 23:01:33.353276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 23:01:33.354026: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 23:01:33.354041: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 23:01:33.354049: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 23:01:33.355313: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9821 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-28 23:01:33.625531: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 23:01:33.625650: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 23:01:33.625679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 23:01:33.625705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 23:01:33.625729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 23:01:33.625753: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 23:01:33.625777: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 23:01:33.625801: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 23:01:33.627176: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 23:01:33.628587: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 23:01:33.628671: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 23:01:33.628686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 23:01:33.628700: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 23:01:33.628727: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 23:01:33.628742: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 23:01:33.628756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 23:01:33.628771: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 23:01:33.630082: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 23:01:33.630116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 23:01:33.630126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 23:01:33.630134: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 23:01:33.631498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9821 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-28 23:01:44.291336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 23:01:44.471969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (2448, 2448, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 2448.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2448, 2448, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.67734 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 2448.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2448, 2448, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 2448.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.70000 max: 143.97500 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 836207 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1534 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6823 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.001493215560913086 nb_pixel_total : 52251 time to create 1 rle with old method : 0.05439162254333496 length of segment : 285 time for calcul the mask position with numpy : 0.00024628639221191406 nb_pixel_total : 12886 time to create 1 rle with old method : 0.013852596282958984 length of segment : 111 time for calcul the mask position with numpy : 0.00028395652770996094 nb_pixel_total : 16565 time to create 1 rle with old method : 0.018452882766723633 length of segment : 156 time for calcul the mask position with numpy : 0.0022118091583251953 nb_pixel_total : 117859 time to create 1 rle with old method : 0.12252449989318848 length of segment : 348 time for calcul the mask position with numpy : 0.0002849102020263672 nb_pixel_total : 9582 time to create 1 rle with old method : 0.01608419418334961 length of segment : 129 time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 13061 time to create 1 rle with old method : 0.019986629486083984 length of segment : 140 time for calcul the mask position with numpy : 0.00019311904907226562 nb_pixel_total : 7856 time to create 1 rle with old method : 0.009548425674438477 length of segment : 91 time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 18402 time to create 1 rle with old method : 0.021561384201049805 length of segment : 148 time for calcul the mask position with numpy : 0.000499725341796875 nb_pixel_total : 28590 time to create 1 rle with old method : 0.030388832092285156 length of segment : 197 time for calcul the mask position with numpy : 0.0002770423889160156 nb_pixel_total : 10793 time to create 1 rle with old method : 0.011997461318969727 length of segment : 162 time for calcul the mask position with numpy : 0.0002722740173339844 nb_pixel_total : 12412 time to create 1 rle with old method : 0.013896465301513672 length of segment : 219 time for calcul the mask position with numpy : 0.0012183189392089844 nb_pixel_total : 44465 time to create 1 rle with old method : 0.07381749153137207 length of segment : 302 time for calcul the mask position with numpy : 0.0013747215270996094 nb_pixel_total : 11525 time to create 1 rle with old method : 0.022791385650634766 length of segment : 310 time for calcul the mask position with numpy : 0.0002186298370361328 nb_pixel_total : 6228 time to create 1 rle with old method : 0.007790565490722656 length of segment : 52 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 11383 time to create 1 rle with old method : 0.013699531555175781 length of segment : 76 time for calcul the mask position with numpy : 0.0005939006805419922 nb_pixel_total : 11444 time to create 1 rle with old method : 0.013247966766357422 length of segment : 228 time for calcul the mask position with numpy : 0.00019478797912597656 nb_pixel_total : 5745 time to create 1 rle with old method : 0.0066165924072265625 length of segment : 60 time for calcul the mask position with numpy : 0.0003044605255126953 nb_pixel_total : 14769 time to create 1 rle with old method : 0.015894651412963867 length of segment : 149 time for calcul the mask position with numpy : 0.6356871128082275 nb_pixel_total : 640628 time to create 1 rle with new method : 0.1122586727142334 length of segment : 781 time for calcul the mask position with numpy : 0.0003879070281982422 nb_pixel_total : 4148 time to create 1 rle with old method : 0.004742860794067383 length of segment : 78 time for calcul the mask position with numpy : 0.00041937828063964844 nb_pixel_total : 8390 time to create 1 rle with old method : 0.009217262268066406 length of segment : 136 time for calcul the mask position with numpy : 0.00044918060302734375 nb_pixel_total : 11960 time to create 1 rle with old method : 0.013169050216674805 length of segment : 138 time for calcul the mask position with numpy : 0.000423431396484375 nb_pixel_total : 8902 time to create 1 rle with old method : 0.009869575500488281 length of segment : 101 time for calcul the mask position with numpy : 0.0005848407745361328 nb_pixel_total : 10009 time to create 1 rle with old method : 0.011192083358764648 length of segment : 126 time for calcul the mask position with numpy : 0.00128173828125 nb_pixel_total : 40281 time to create 1 rle with old method : 0.04525399208068848 length of segment : 306 time for calcul the mask position with numpy : 0.0037279129028320312 nb_pixel_total : 99047 time to create 1 rle with old method : 0.11438202857971191 length of segment : 451 time for calcul the mask position with numpy : 0.0009722709655761719 nb_pixel_total : 28366 time to create 1 rle with old method : 0.03229880332946777 length of segment : 341 time for calcul the mask position with numpy : 0.0007407665252685547 nb_pixel_total : 27431 time to create 1 rle with old method : 0.03112626075744629 length of segment : 190 time for calcul the mask position with numpy : 0.0002067089080810547 nb_pixel_total : 4253 time to create 1 rle with old method : 0.005108356475830078 length of segment : 69 time for calcul the mask position with numpy : 0.0009915828704833984 nb_pixel_total : 33662 time to create 1 rle with old method : 0.03759336471557617 length of segment : 270 time for calcul the mask position with numpy : 0.0019843578338623047 nb_pixel_total : 61787 time to create 1 rle with old method : 0.06916213035583496 length of segment : 261 time for calcul the mask position with numpy : 0.0006799697875976562 nb_pixel_total : 15018 time to create 1 rle with old method : 0.017035961151123047 length of segment : 185 time for calcul the mask position with numpy : 0.0010898113250732422 nb_pixel_total : 38387 time to create 1 rle with old method : 0.044655799865722656 length of segment : 208 time for calcul the mask position with numpy : 0.00046324729919433594 nb_pixel_total : 11076 time to create 1 rle with old method : 0.012478828430175781 length of segment : 121 time for calcul the mask position with numpy : 0.0003376007080078125 nb_pixel_total : 14357 time to create 1 rle with old method : 0.016901731491088867 length of segment : 202 time for calcul the mask position with numpy : 0.00028204917907714844 nb_pixel_total : 5952 time to create 1 rle with old method : 0.007074832916259766 length of segment : 112 time for calcul the mask position with numpy : 0.0004799365997314453 nb_pixel_total : 15869 time to create 1 rle with old method : 0.018596887588500977 length of segment : 135 time for calcul the mask position with numpy : 0.0005505084991455078 nb_pixel_total : 12128 time to create 1 rle with old method : 0.013766288757324219 length of segment : 156 time for calcul the mask position with numpy : 0.0007729530334472656 nb_pixel_total : 26567 time to create 1 rle with old method : 0.031449317932128906 length of segment : 150 time for calcul the mask position with numpy : 0.0005626678466796875 nb_pixel_total : 19574 time to create 1 rle with old method : 0.022172927856445312 length of segment : 176 time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 12127 time to create 1 rle with old method : 0.014193058013916016 length of segment : 109 time for calcul the mask position with numpy : 0.00026535987854003906 nb_pixel_total : 6081 time to create 1 rle with old method : 0.007041215896606445 length of segment : 102 time for calcul the mask position with numpy : 0.0040280818939208984 nb_pixel_total : 98860 time to create 1 rle with old method : 0.11106753349304199 length of segment : 439 time for calcul the mask position with numpy : 0.0007255077362060547 nb_pixel_total : 29743 time to create 1 rle with old method : 0.03409409523010254 length of segment : 206 time for calcul the mask position with numpy : 0.0028371810913085938 nb_pixel_total : 115063 time to create 1 rle with old method : 0.12815213203430176 length of segment : 378 time for calcul the mask position with numpy : 0.0004971027374267578 nb_pixel_total : 17129 time to create 1 rle with old method : 0.019745826721191406 length of segment : 194 time for calcul the mask position with numpy : 0.0007784366607666016 nb_pixel_total : 30167 time to create 1 rle with old method : 0.036301374435424805 length of segment : 189 time for calcul the mask position with numpy : 0.0002498626708984375 nb_pixel_total : 11309 time to create 1 rle with old method : 0.013260364532470703 length of segment : 192 time for calcul the mask position with numpy : 0.00019240379333496094 nb_pixel_total : 3337 time to create 1 rle with old method : 0.004021167755126953 length of segment : 64 time for calcul the mask position with numpy : 0.0004131793975830078 nb_pixel_total : 14605 time to create 1 rle with old method : 0.01698613166809082 length of segment : 161 time for calcul the mask position with numpy : 0.00046253204345703125 nb_pixel_total : 9812 time to create 1 rle with old method : 0.011684417724609375 length of segment : 157 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 7256 time to create 1 rle with old method : 0.00855875015258789 length of segment : 82 time for calcul the mask position with numpy : 0.00023245811462402344 nb_pixel_total : 7265 time to create 1 rle with old method : 0.008472919464111328 length of segment : 64 time for calcul the mask position with numpy : 0.0007643699645996094 nb_pixel_total : 26282 time to create 1 rle with old method : 0.029331684112548828 length of segment : 204 time for calcul the mask position with numpy : 0.0002906322479248047 nb_pixel_total : 9027 time to create 1 rle with old method : 0.010566949844360352 length of segment : 160 time for calcul the mask position with numpy : 0.00020599365234375 nb_pixel_total : 5076 time to create 1 rle with old method : 0.005967140197753906 length of segment : 69 time for calcul the mask position with numpy : 0.024584054946899414 nb_pixel_total : 1236048 time to create 1 rle with new method : 0.07724761962890625 length of segment : 1166 time for calcul the mask position with numpy : 0.0028853416442871094 nb_pixel_total : 22028 time to create 1 rle with old method : 0.027526140213012695 length of segment : 336 time for calcul the mask position with numpy : 0.0006270408630371094 nb_pixel_total : 28921 time to create 1 rle with old method : 0.03305697441101074 length of segment : 184 time for calcul the mask position with numpy : 0.9479436874389648 nb_pixel_total : 6532748 time to create 1 rle with new method : 1.1460344791412354 length of segment : 4543 time for calcul the mask position with numpy : 0.00021123886108398438 nb_pixel_total : 8175 time to create 1 rle with old method : 0.009035587310791016 length of segment : 173 time for calcul the mask position with numpy : 0.0002951622009277344 nb_pixel_total : 8727 time to create 1 rle with old method : 0.01006007194519043 length of segment : 195 time for calcul the mask position with numpy : 0.44216132164001465 nb_pixel_total : 2978078 time to create 1 rle with new method : 0.40811920166015625 length of segment : 1847 time for calcul the mask position with numpy : 0.000995635986328125 nb_pixel_total : 81861 time to create 1 rle with old method : 0.09091925621032715 length of segment : 599 time spent for convertir_results : 13.17126989364624 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 64 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 42.85673999786377 time spend to save output : 0.09759092330932617 total time spend for step 1 : 42.954330921173096 step2:mask_detect Thu Aug 28 23:02:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6823 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-28 23:02:16.043476: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-28 23:02:16.068744: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-28 23:02:16.070940: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9cb4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-28 23:02:16.071009: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-28 23:02:16.075405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-28 23:02:16.207703: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x43a5ed40 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-28 23:02:16.207775: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-28 23:02:16.209186: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 23:02:16.209672: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 23:02:16.212780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 23:02:16.215814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 23:02:16.216328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 23:02:16.218836: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 23:02:16.219912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 23:02:16.224381: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 23:02:16.225693: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 23:02:16.225783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 23:02:16.226461: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 23:02:16.226477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 23:02:16.226486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 23:02:16.227578: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6271 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-28 23:02:16.342970: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 23:02:16.343060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 23:02:16.343082: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 23:02:16.343103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 23:02:16.343123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 23:02:16.343143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 23:02:16.343162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 23:02:16.343182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 23:02:16.344639: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 23:02:16.345847: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 23:02:16.345901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 23:02:16.345926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 23:02:16.345949: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 23:02:16.345971: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 23:02:16.346005: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 23:02:16.346028: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 23:02:16.346050: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 23:02:16.347340: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 23:02:16.347374: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 23:02:16.347385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 23:02:16.347394: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 23:02:16.348782: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6271 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-28 23:02:25.931971: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 23:02:26.154560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (2448, 2448, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 2448.00000 nb d'objets trouves : 90 NEW PHOTO Processing 1 images image shape: (2448, 2448, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.67734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 2448.00000 nb d'objets trouves : 98 NEW PHOTO Processing 1 images image shape: (2448, 2448, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 2448.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.70000 max: 143.97500 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 12 Detection mask done ! Trying to reset tf kernel 838483 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5311 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10603 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0012078285217285156 nb_pixel_total : 13565 time to create 1 rle with old method : 0.024812936782836914 length of segment : 200 time for calcul the mask position with numpy : 0.0026793479919433594 nb_pixel_total : 55667 time to create 1 rle with old method : 0.07921743392944336 length of segment : 343 time for calcul the mask position with numpy : 0.0008714199066162109 nb_pixel_total : 18706 time to create 1 rle with old method : 0.027328968048095703 length of segment : 157 time for calcul the mask position with numpy : 0.00039458274841308594 nb_pixel_total : 8898 time to create 1 rle with old method : 0.013090372085571289 length of segment : 98 time for calcul the mask position with numpy : 0.002480745315551758 nb_pixel_total : 78431 time to create 1 rle with old method : 0.10999679565429688 length of segment : 300 time for calcul the mask position with numpy : 0.005642890930175781 nb_pixel_total : 191395 time to create 1 rle with new method : 0.016470909118652344 length of segment : 584 time for calcul the mask position with numpy : 0.0005941390991210938 nb_pixel_total : 14048 time to create 1 rle with old method : 0.016776084899902344 length of segment : 138 time for calcul the mask position with numpy : 0.0003952980041503906 nb_pixel_total : 12126 time to create 1 rle with old method : 0.014217376708984375 length of segment : 131 time for calcul the mask position with numpy : 0.00030803680419921875 nb_pixel_total : 14568 time to create 1 rle with old method : 0.01598668098449707 length of segment : 119 time for calcul the mask position with numpy : 0.001039266586303711 nb_pixel_total : 29945 time to create 1 rle with old method : 0.03281688690185547 length of segment : 239 time for calcul the mask position with numpy : 0.0002961158752441406 nb_pixel_total : 7541 time to create 1 rle with old method : 0.008495569229125977 length of segment : 142 time for calcul the mask position with numpy : 0.0007536411285400391 nb_pixel_total : 25465 time to create 1 rle with old method : 0.028192520141601562 length of segment : 203 time for calcul the mask position with numpy : 0.001142740249633789 nb_pixel_total : 55945 time to create 1 rle with old method : 0.06145977973937988 length of segment : 194 time for calcul the mask position with numpy : 0.00026607513427734375 nb_pixel_total : 9463 time to create 1 rle with old method : 0.010375022888183594 length of segment : 143 time for calcul the mask position with numpy : 0.0003409385681152344 nb_pixel_total : 11593 time to create 1 rle with old method : 0.01309967041015625 length of segment : 133 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 19452 time to create 1 rle with old method : 0.021840810775756836 length of segment : 144 time for calcul the mask position with numpy : 0.011845827102661133 nb_pixel_total : 538796 time to create 1 rle with new method : 0.045723676681518555 length of segment : 942 time for calcul the mask position with numpy : 0.0008590221405029297 nb_pixel_total : 32673 time to create 1 rle with old method : 0.03520798683166504 length of segment : 263 time for calcul the mask position with numpy : 0.0016188621520996094 nb_pixel_total : 71396 time to create 1 rle with old method : 0.07759284973144531 length of segment : 383 time for calcul the mask position with numpy : 0.0003275871276855469 nb_pixel_total : 12462 time to create 1 rle with old method : 0.014795780181884766 length of segment : 104 time for calcul the mask position with numpy : 0.00044345855712890625 nb_pixel_total : 14431 time to create 1 rle with old method : 0.016985654830932617 length of segment : 136 time for calcul the mask position with numpy : 0.0007762908935546875 nb_pixel_total : 23491 time to create 1 rle with old method : 0.02690887451171875 length of segment : 140 time for calcul the mask position with numpy : 0.0015523433685302734 nb_pixel_total : 72244 time to create 1 rle with old method : 0.07954978942871094 length of segment : 368 time for calcul the mask position with numpy : 0.0009377002716064453 nb_pixel_total : 26296 time to create 1 rle with old method : 0.0287322998046875 length of segment : 254 time for calcul the mask position with numpy : 0.0007834434509277344 nb_pixel_total : 24534 time to create 1 rle with old method : 0.027430057525634766 length of segment : 179 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 13058 time to create 1 rle with old method : 0.014713525772094727 length of segment : 145 time for calcul the mask position with numpy : 0.0005600452423095703 nb_pixel_total : 21940 time to create 1 rle with old method : 0.02500128746032715 length of segment : 127 time for calcul the mask position with numpy : 0.00029468536376953125 nb_pixel_total : 10585 time to create 1 rle with old method : 0.011933326721191406 length of segment : 120 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 8776 time to create 1 rle with old method : 0.009901762008666992 length of segment : 113 time for calcul the mask position with numpy : 0.00029397010803222656 nb_pixel_total : 9714 time to create 1 rle with old method : 0.011263370513916016 length of segment : 101 time for calcul the mask position with numpy : 0.00025200843811035156 nb_pixel_total : 10914 time to create 1 rle with old method : 0.01646113395690918 length of segment : 107 time for calcul the mask position with numpy : 0.001813650131225586 nb_pixel_total : 65931 time to create 1 rle with old method : 0.07248806953430176 length of segment : 566 time for calcul the mask position with numpy : 0.0005955696105957031 nb_pixel_total : 23113 time to create 1 rle with old method : 0.024870872497558594 length of segment : 156 time for calcul the mask position with numpy : 0.0017480850219726562 nb_pixel_total : 48435 time to create 1 rle with old method : 0.052036285400390625 length of segment : 315 time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 14808 time to create 1 rle with old method : 0.016510486602783203 length of segment : 89 time for calcul the mask position with numpy : 0.0003154277801513672 nb_pixel_total : 9051 time to create 1 rle with old method : 0.010109186172485352 length of segment : 151 time for calcul the mask position with numpy : 0.029828548431396484 nb_pixel_total : 819088 time to create 1 rle with new method : 0.261127233505249 length of segment : 791 time for calcul the mask position with numpy : 0.0003247261047363281 nb_pixel_total : 9691 time to create 1 rle with old method : 0.01106715202331543 length of segment : 140 time for calcul the mask position with numpy : 0.0004436969757080078 nb_pixel_total : 21070 time to create 1 rle with old method : 0.023787260055541992 length of segment : 143 time for calcul the mask position with numpy : 0.0004858970642089844 nb_pixel_total : 15083 time to create 1 rle with old method : 0.016321182250976562 length of segment : 154 time for calcul the mask position with numpy : 0.00018596649169921875 nb_pixel_total : 8822 time to create 1 rle with old method : 0.00980687141418457 length of segment : 64 time for calcul the mask position with numpy : 0.00033473968505859375 nb_pixel_total : 14807 time to create 1 rle with old method : 0.016330480575561523 length of segment : 152 time for calcul the mask position with numpy : 0.0013480186462402344 nb_pixel_total : 68088 time to create 1 rle with old method : 0.0728464126586914 length of segment : 316 time for calcul the mask position with numpy : 0.0007026195526123047 nb_pixel_total : 25000 time to create 1 rle with old method : 0.027080535888671875 length of segment : 230 time for calcul the mask position with numpy : 0.00020575523376464844 nb_pixel_total : 7075 time to create 1 rle with old method : 0.008139371871948242 length of segment : 129 time for calcul the mask position with numpy : 0.0009002685546875 nb_pixel_total : 11515 time to create 1 rle with old method : 0.012861013412475586 length of segment : 149 time for calcul the mask position with numpy : 0.0012052059173583984 nb_pixel_total : 57230 time to create 1 rle with old method : 0.062218427658081055 length of segment : 324 time for calcul the mask position with numpy : 0.0002913475036621094 nb_pixel_total : 7999 time to create 1 rle with old method : 0.008985757827758789 length of segment : 118 time for calcul the mask position with numpy : 0.0003581047058105469 nb_pixel_total : 9897 time to create 1 rle with old method : 0.011135578155517578 length of segment : 151 time for calcul the mask position with numpy : 0.00542140007019043 nb_pixel_total : 137980 time to create 1 rle with old method : 0.14909958839416504 length of segment : 641 time for calcul the mask position with numpy : 0.0008370876312255859 nb_pixel_total : 19822 time to create 1 rle with old method : 0.023432254791259766 length of segment : 232 time for calcul the mask position with numpy : 0.0002846717834472656 nb_pixel_total : 5893 time to create 1 rle with old method : 0.007177829742431641 length of segment : 123 time for calcul the mask position with numpy : 0.007007122039794922 nb_pixel_total : 261727 time to create 1 rle with new method : 0.020721435546875 length of segment : 638 time for calcul the mask position with numpy : 0.0014226436614990234 nb_pixel_total : 57820 time to create 1 rle with old method : 0.06358838081359863 length of segment : 389 time for calcul the mask position with numpy : 0.00014591217041015625 nb_pixel_total : 1081 time to create 1 rle with old method : 0.0012814998626708984 length of segment : 99 time for calcul the mask position with numpy : 0.0026044845581054688 nb_pixel_total : 137147 time to create 1 rle with old method : 0.1485762596130371 length of segment : 554 time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 2517 time to create 1 rle with old method : 0.0029549598693847656 length of segment : 73 time for calcul the mask position with numpy : 0.00030875205993652344 nb_pixel_total : 8942 time to create 1 rle with old method : 0.009970664978027344 length of segment : 191 time for calcul the mask position with numpy : 0.0005290508270263672 nb_pixel_total : 24631 time to create 1 rle with old method : 0.027791976928710938 length of segment : 216 time for calcul the mask position with numpy : 0.0004258155822753906 nb_pixel_total : 16625 time to create 1 rle with old method : 0.01918339729309082 length of segment : 167 time for calcul the mask position with numpy : 0.000492095947265625 nb_pixel_total : 21338 time to create 1 rle with old method : 0.023976802825927734 length of segment : 162 time for calcul the mask position with numpy : 0.003060579299926758 nb_pixel_total : 74134 time to create 1 rle with old method : 0.09554100036621094 length of segment : 384 time for calcul the mask position with numpy : 0.0005052089691162109 nb_pixel_total : 23670 time to create 1 rle with old method : 0.025274038314819336 length of segment : 146 time for calcul the mask position with numpy : 0.0020432472229003906 nb_pixel_total : 109843 time to create 1 rle with old method : 0.11940956115722656 length of segment : 341 time for calcul the mask position with numpy : 0.0009317398071289062 nb_pixel_total : 33584 time to create 1 rle with old method : 0.03673720359802246 length of segment : 176 time for calcul the mask position with numpy : 0.0026254653930664062 nb_pixel_total : 76031 time to create 1 rle with old method : 0.08332157135009766 length of segment : 452 time for calcul the mask position with numpy : 0.002846956253051758 nb_pixel_total : 93659 time to create 1 rle with old method : 0.10008573532104492 length of segment : 382 time for calcul the mask position with numpy : 0.0009253025054931641 nb_pixel_total : 32174 time to create 1 rle with old method : 0.03549337387084961 length of segment : 205 time for calcul the mask position with numpy : 0.00037479400634765625 nb_pixel_total : 14439 time to create 1 rle with old method : 0.01637578010559082 length of segment : 163 time for calcul the mask position with numpy : 0.00254058837890625 nb_pixel_total : 129587 time to create 1 rle with old method : 0.13705229759216309 length of segment : 522 time for calcul the mask position with numpy : 0.0002777576446533203 nb_pixel_total : 9110 time to create 1 rle with old method : 0.010265588760375977 length of segment : 116 time for calcul the mask position with numpy : 0.00042057037353515625 nb_pixel_total : 15008 time to create 1 rle with old method : 0.017059326171875 length of segment : 151 time for calcul the mask position with numpy : 0.00021576881408691406 nb_pixel_total : 10130 time to create 1 rle with old method : 0.011003255844116211 length of segment : 94 time for calcul the mask position with numpy : 0.0006315708160400391 nb_pixel_total : 24183 time to create 1 rle with old method : 0.027264833450317383 length of segment : 190 time for calcul the mask position with numpy : 0.0003807544708251953 nb_pixel_total : 16152 time to create 1 rle with old method : 0.017310619354248047 length of segment : 149 time for calcul the mask position with numpy : 0.0025479793548583984 nb_pixel_total : 123034 time to create 1 rle with old method : 0.12918686866760254 length of segment : 472 time for calcul the mask position with numpy : 0.0024514198303222656 nb_pixel_total : 87663 time to create 1 rle with old method : 0.09617304801940918 length of segment : 400 time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 24028 time to create 1 rle with old method : 0.026559829711914062 length of segment : 205 time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 20361 time to create 1 rle with old method : 0.021969318389892578 length of segment : 156 time for calcul the mask position with numpy : 0.0011963844299316406 nb_pixel_total : 40392 time to create 1 rle with old method : 0.044005632400512695 length of segment : 204 time for calcul the mask position with numpy : 0.0038957595825195312 nb_pixel_total : 168230 time to create 1 rle with new method : 0.011884450912475586 length of segment : 545 time for calcul the mask position with numpy : 0.0003845691680908203 nb_pixel_total : 13579 time to create 1 rle with old method : 0.014711856842041016 length of segment : 149 time for calcul the mask position with numpy : 0.001463174819946289 nb_pixel_total : 62772 time to create 1 rle with old method : 0.06560921669006348 length of segment : 391 time for calcul the mask position with numpy : 0.0020813941955566406 nb_pixel_total : 84649 time to create 1 rle with old method : 0.09164834022521973 length of segment : 277 time for calcul the mask position with numpy : 0.0007045269012451172 nb_pixel_total : 21229 time to create 1 rle with old method : 0.02311420440673828 length of segment : 219 time for calcul the mask position with numpy : 0.00034809112548828125 nb_pixel_total : 17913 time to create 1 rle with old method : 0.01936626434326172 length of segment : 191 time for calcul the mask position with numpy : 0.002996683120727539 nb_pixel_total : 130397 time to create 1 rle with old method : 0.13792896270751953 length of segment : 539 time for calcul the mask position with numpy : 0.0006225109100341797 nb_pixel_total : 27841 time to create 1 rle with old method : 0.030046939849853516 length of segment : 195 time for calcul the mask position with numpy : 0.0005772113800048828 nb_pixel_total : 33564 time to create 1 rle with old method : 0.03640127182006836 length of segment : 200 time for calcul the mask position with numpy : 0.002264261245727539 nb_pixel_total : 107543 time to create 1 rle with old method : 0.11274909973144531 length of segment : 326 time for calcul the mask position with numpy : 0.0012011528015136719 nb_pixel_total : 49886 time to create 1 rle with old method : 0.05444145202636719 length of segment : 272 time for calcul the mask position with numpy : 0.0011258125305175781 nb_pixel_total : 38187 time to create 1 rle with old method : 0.040994882583618164 length of segment : 303 time for calcul the mask position with numpy : 0.0005092620849609375 nb_pixel_total : 21150 time to create 1 rle with old method : 0.022726774215698242 length of segment : 167 time for calcul the mask position with numpy : 0.002330780029296875 nb_pixel_total : 75625 time to create 1 rle with old method : 0.08130931854248047 length of segment : 304 time for calcul the mask position with numpy : 0.001615762710571289 nb_pixel_total : 61555 time to create 1 rle with old method : 0.06604647636413574 length of segment : 303 time for calcul the mask position with numpy : 0.0003867149353027344 nb_pixel_total : 8540 time to create 1 rle with old method : 0.009630441665649414 length of segment : 143 time for calcul the mask position with numpy : 0.0004553794860839844 nb_pixel_total : 14319 time to create 1 rle with old method : 0.016622304916381836 length of segment : 131 time for calcul the mask position with numpy : 0.00026702880859375 nb_pixel_total : 8439 time to create 1 rle with old method : 0.010023832321166992 length of segment : 113 time for calcul the mask position with numpy : 0.0012989044189453125 nb_pixel_total : 43868 time to create 1 rle with old method : 0.05052995681762695 length of segment : 226 time for calcul the mask position with numpy : 0.00045371055603027344 nb_pixel_total : 15330 time to create 1 rle with old method : 0.01669764518737793 length of segment : 159 time for calcul the mask position with numpy : 0.002064228057861328 nb_pixel_total : 49091 time to create 1 rle with old method : 0.052996158599853516 length of segment : 337 time for calcul the mask position with numpy : 0.0028786659240722656 nb_pixel_total : 128704 time to create 1 rle with old method : 0.139603853225708 length of segment : 379 time for calcul the mask position with numpy : 0.0001990795135498047 nb_pixel_total : 7273 time to create 1 rle with old method : 0.00782322883605957 length of segment : 113 time for calcul the mask position with numpy : 0.0006465911865234375 nb_pixel_total : 16294 time to create 1 rle with old method : 0.017435312271118164 length of segment : 183 time for calcul the mask position with numpy : 0.0022568702697753906 nb_pixel_total : 84621 time to create 1 rle with old method : 0.09366869926452637 length of segment : 428 time for calcul the mask position with numpy : 0.0006997585296630859 nb_pixel_total : 28520 time to create 1 rle with old method : 0.031372785568237305 length of segment : 232 time for calcul the mask position with numpy : 0.001210927963256836 nb_pixel_total : 47767 time to create 1 rle with old method : 0.051812171936035156 length of segment : 293 time for calcul the mask position with numpy : 0.0006911754608154297 nb_pixel_total : 18285 time to create 1 rle with old method : 0.020282506942749023 length of segment : 185 time for calcul the mask position with numpy : 0.0008950233459472656 nb_pixel_total : 38486 time to create 1 rle with old method : 0.04171347618103027 length of segment : 250 time for calcul the mask position with numpy : 0.00021028518676757812 nb_pixel_total : 6386 time to create 1 rle with old method : 0.007488250732421875 length of segment : 102 time for calcul the mask position with numpy : 0.00039458274841308594 nb_pixel_total : 16466 time to create 1 rle with old method : 0.018936634063720703 length of segment : 120 time for calcul the mask position with numpy : 0.0013685226440429688 nb_pixel_total : 60663 time to create 1 rle with old method : 0.06689071655273438 length of segment : 398 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 12041 time to create 1 rle with old method : 0.013578653335571289 length of segment : 180 time for calcul the mask position with numpy : 0.0008068084716796875 nb_pixel_total : 29127 time to create 1 rle with old method : 0.03186297416687012 length of segment : 217 time for calcul the mask position with numpy : 0.0008895397186279297 nb_pixel_total : 23882 time to create 1 rle with old method : 0.026137590408325195 length of segment : 298 time for calcul the mask position with numpy : 0.0011603832244873047 nb_pixel_total : 41995 time to create 1 rle with old method : 0.046714067459106445 length of segment : 193 time for calcul the mask position with numpy : 0.0006260871887207031 nb_pixel_total : 24352 time to create 1 rle with old method : 0.02728581428527832 length of segment : 148 time for calcul the mask position with numpy : 0.0011324882507324219 nb_pixel_total : 38894 time to create 1 rle with old method : 0.04200387001037598 length of segment : 251 time for calcul the mask position with numpy : 0.002683877944946289 nb_pixel_total : 80045 time to create 1 rle with old method : 0.08824300765991211 length of segment : 403 time for calcul the mask position with numpy : 0.0006999969482421875 nb_pixel_total : 27091 time to create 1 rle with old method : 0.030918121337890625 length of segment : 144 time for calcul the mask position with numpy : 0.0004954338073730469 nb_pixel_total : 21323 time to create 1 rle with old method : 0.023762226104736328 length of segment : 137 time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 13534 time to create 1 rle with old method : 0.01500844955444336 length of segment : 153 time for calcul the mask position with numpy : 0.0022563934326171875 nb_pixel_total : 88852 time to create 1 rle with old method : 0.09423685073852539 length of segment : 381 time for calcul the mask position with numpy : 0.0014777183532714844 nb_pixel_total : 52833 time to create 1 rle with old method : 0.05761575698852539 length of segment : 247 time for calcul the mask position with numpy : 0.0009720325469970703 nb_pixel_total : 30697 time to create 1 rle with old method : 0.03393816947937012 length of segment : 304 time for calcul the mask position with numpy : 0.0005135536193847656 nb_pixel_total : 20494 time to create 1 rle with old method : 0.022670984268188477 length of segment : 185 time for calcul the mask position with numpy : 0.0005004405975341797 nb_pixel_total : 16741 time to create 1 rle with old method : 0.019526004791259766 length of segment : 138 time for calcul the mask position with numpy : 0.0004754066467285156 nb_pixel_total : 7046 time to create 1 rle with old method : 0.008159875869750977 length of segment : 202 time for calcul the mask position with numpy : 0.0006041526794433594 nb_pixel_total : 29033 time to create 1 rle with old method : 0.03158760070800781 length of segment : 206 time for calcul the mask position with numpy : 0.004525661468505859 nb_pixel_total : 226740 time to create 1 rle with new method : 0.011381387710571289 length of segment : 541 time for calcul the mask position with numpy : 0.0008118152618408203 nb_pixel_total : 23792 time to create 1 rle with old method : 0.026120424270629883 length of segment : 281 time for calcul the mask position with numpy : 0.0013175010681152344 nb_pixel_total : 44148 time to create 1 rle with old method : 0.046973228454589844 length of segment : 277 time for calcul the mask position with numpy : 0.00020813941955566406 nb_pixel_total : 7648 time to create 1 rle with old method : 0.008340835571289062 length of segment : 121 time for calcul the mask position with numpy : 0.0011000633239746094 nb_pixel_total : 43425 time to create 1 rle with old method : 0.04757380485534668 length of segment : 307 time for calcul the mask position with numpy : 0.00692296028137207 nb_pixel_total : 363563 time to create 1 rle with new method : 0.019499778747558594 length of segment : 669 time for calcul the mask position with numpy : 0.0007436275482177734 nb_pixel_total : 30040 time to create 1 rle with old method : 0.032384634017944336 length of segment : 169 time for calcul the mask position with numpy : 0.0004911422729492188 nb_pixel_total : 16476 time to create 1 rle with old method : 0.01848602294921875 length of segment : 156 time for calcul the mask position with numpy : 0.000316619873046875 nb_pixel_total : 6006 time to create 1 rle with old method : 0.006778717041015625 length of segment : 139 time for calcul the mask position with numpy : 0.0009288787841796875 nb_pixel_total : 43497 time to create 1 rle with old method : 0.046864986419677734 length of segment : 287 time for calcul the mask position with numpy : 0.001367330551147461 nb_pixel_total : 48547 time to create 1 rle with old method : 0.05190610885620117 length of segment : 396 time for calcul the mask position with numpy : 0.0005891323089599609 nb_pixel_total : 21044 time to create 1 rle with old method : 0.023263931274414062 length of segment : 168 time for calcul the mask position with numpy : 0.0005280971527099609 nb_pixel_total : 21794 time to create 1 rle with old method : 0.024201154708862305 length of segment : 121 time for calcul the mask position with numpy : 0.0003504753112792969 nb_pixel_total : 13885 time to create 1 rle with old method : 0.015158653259277344 length of segment : 154 time for calcul the mask position with numpy : 0.0012695789337158203 nb_pixel_total : 34696 time to create 1 rle with old method : 0.03701949119567871 length of segment : 226 time for calcul the mask position with numpy : 0.0005009174346923828 nb_pixel_total : 19452 time to create 1 rle with old method : 0.021151304244995117 length of segment : 193 time for calcul the mask position with numpy : 0.0028052330017089844 nb_pixel_total : 106976 time to create 1 rle with old method : 0.11517953872680664 length of segment : 525 time for calcul the mask position with numpy : 0.0009167194366455078 nb_pixel_total : 33502 time to create 1 rle with old method : 0.036459922790527344 length of segment : 254 time for calcul the mask position with numpy : 0.0005173683166503906 nb_pixel_total : 19904 time to create 1 rle with old method : 0.022200822830200195 length of segment : 181 time for calcul the mask position with numpy : 0.00023293495178222656 nb_pixel_total : 5200 time to create 1 rle with old method : 0.006061077117919922 length of segment : 84 time for calcul the mask position with numpy : 0.005780458450317383 nb_pixel_total : 156790 time to create 1 rle with new method : 0.019051074981689453 length of segment : 642 time for calcul the mask position with numpy : 0.0006151199340820312 nb_pixel_total : 23796 time to create 1 rle with old method : 0.025290966033935547 length of segment : 168 time for calcul the mask position with numpy : 0.002323150634765625 nb_pixel_total : 46689 time to create 1 rle with old method : 0.049018144607543945 length of segment : 433 time for calcul the mask position with numpy : 0.0007913112640380859 nb_pixel_total : 32294 time to create 1 rle with old method : 0.035414934158325195 length of segment : 209 time for calcul the mask position with numpy : 0.00036025047302246094 nb_pixel_total : 11576 time to create 1 rle with old method : 0.01302194595336914 length of segment : 149 time for calcul the mask position with numpy : 0.0003955364227294922 nb_pixel_total : 18053 time to create 1 rle with old method : 0.01898932456970215 length of segment : 208 time for calcul the mask position with numpy : 0.004003047943115234 nb_pixel_total : 114226 time to create 1 rle with old method : 0.11976861953735352 length of segment : 483 time for calcul the mask position with numpy : 0.0006177425384521484 nb_pixel_total : 19394 time to create 1 rle with old method : 0.02142167091369629 length of segment : 152 time for calcul the mask position with numpy : 0.0025568008422851562 nb_pixel_total : 33059 time to create 1 rle with old method : 0.03541922569274902 length of segment : 368 time for calcul the mask position with numpy : 0.0001952648162841797 nb_pixel_total : 6778 time to create 1 rle with old method : 0.007215023040771484 length of segment : 151 time for calcul the mask position with numpy : 0.003298044204711914 nb_pixel_total : 75313 time to create 1 rle with old method : 0.07965230941772461 length of segment : 458 time for calcul the mask position with numpy : 0.0008704662322998047 nb_pixel_total : 38348 time to create 1 rle with old method : 0.04163813591003418 length of segment : 255 time for calcul the mask position with numpy : 0.00037407875061035156 nb_pixel_total : 15052 time to create 1 rle with old method : 0.016755342483520508 length of segment : 152 time for calcul the mask position with numpy : 0.001039743423461914 nb_pixel_total : 38222 time to create 1 rle with old method : 0.04060530662536621 length of segment : 190 time for calcul the mask position with numpy : 0.0007314682006835938 nb_pixel_total : 25405 time to create 1 rle with old method : 0.027528762817382812 length of segment : 294 time for calcul the mask position with numpy : 0.0010929107666015625 nb_pixel_total : 27862 time to create 1 rle with old method : 0.030654430389404297 length of segment : 242 time for calcul the mask position with numpy : 0.0005490779876708984 nb_pixel_total : 23711 time to create 1 rle with old method : 0.02582383155822754 length of segment : 246 time for calcul the mask position with numpy : 0.0002880096435546875 nb_pixel_total : 12100 time to create 1 rle with old method : 0.013171911239624023 length of segment : 123 time for calcul the mask position with numpy : 0.0005595684051513672 nb_pixel_total : 10558 time to create 1 rle with old method : 0.011493921279907227 length of segment : 323 time for calcul the mask position with numpy : 0.0011336803436279297 nb_pixel_total : 34721 time to create 1 rle with old method : 0.03725099563598633 length of segment : 273 time for calcul the mask position with numpy : 0.0004668235778808594 nb_pixel_total : 17281 time to create 1 rle with old method : 0.019030094146728516 length of segment : 154 time for calcul the mask position with numpy : 0.0004181861877441406 nb_pixel_total : 13314 time to create 1 rle with old method : 0.01538395881652832 length of segment : 168 time for calcul the mask position with numpy : 0.0007104873657226562 nb_pixel_total : 25416 time to create 1 rle with old method : 0.02789020538330078 length of segment : 215 time for calcul the mask position with numpy : 0.0008032321929931641 nb_pixel_total : 34713 time to create 1 rle with old method : 0.037741661071777344 length of segment : 197 time for calcul the mask position with numpy : 0.0009047985076904297 nb_pixel_total : 42974 time to create 1 rle with old method : 0.04650092124938965 length of segment : 268 time for calcul the mask position with numpy : 0.0008876323699951172 nb_pixel_total : 43343 time to create 1 rle with old method : 0.04671525955200195 length of segment : 337 time for calcul the mask position with numpy : 0.00032258033752441406 nb_pixel_total : 12715 time to create 1 rle with old method : 0.01392817497253418 length of segment : 154 time for calcul the mask position with numpy : 0.009156942367553711 nb_pixel_total : 243324 time to create 1 rle with new method : 0.04343247413635254 length of segment : 911 time for calcul the mask position with numpy : 0.008323907852172852 nb_pixel_total : 281802 time to create 1 rle with new method : 0.0391542911529541 length of segment : 1008 time for calcul the mask position with numpy : 0.0011897087097167969 nb_pixel_total : 30154 time to create 1 rle with old method : 0.03184676170349121 length of segment : 249 time for calcul the mask position with numpy : 0.0006885528564453125 nb_pixel_total : 32992 time to create 1 rle with old method : 0.0359807014465332 length of segment : 193 time for calcul the mask position with numpy : 0.0004127025604248047 nb_pixel_total : 16062 time to create 1 rle with old method : 0.016965389251708984 length of segment : 180 time for calcul the mask position with numpy : 0.0006101131439208984 nb_pixel_total : 14373 time to create 1 rle with old method : 0.015208005905151367 length of segment : 232 time for calcul the mask position with numpy : 0.0028944015502929688 nb_pixel_total : 100523 time to create 1 rle with old method : 0.10624575614929199 length of segment : 512 time for calcul the mask position with numpy : 0.0002779960632324219 nb_pixel_total : 5322 time to create 1 rle with old method : 0.00630950927734375 length of segment : 86 time for calcul the mask position with numpy : 0.0006237030029296875 nb_pixel_total : 25576 time to create 1 rle with old method : 0.028323650360107422 length of segment : 223 time for calcul the mask position with numpy : 0.0012726783752441406 nb_pixel_total : 52801 time to create 1 rle with old method : 0.05664467811584473 length of segment : 321 time for calcul the mask position with numpy : 0.003492593765258789 nb_pixel_total : 120349 time to create 1 rle with old method : 0.12876486778259277 length of segment : 439 time for calcul the mask position with numpy : 0.004190921783447266 nb_pixel_total : 142696 time to create 1 rle with old method : 0.15163087844848633 length of segment : 549 time for calcul the mask position with numpy : 0.0006949901580810547 nb_pixel_total : 30466 time to create 1 rle with old method : 0.03374767303466797 length of segment : 188 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 12296 time to create 1 rle with old method : 0.013944625854492188 length of segment : 85 time for calcul the mask position with numpy : 0.012171745300292969 nb_pixel_total : 717071 time to create 1 rle with new method : 0.0363612174987793 length of segment : 800 time for calcul the mask position with numpy : 0.003518342971801758 nb_pixel_total : 198003 time to create 1 rle with new method : 0.008911371231079102 length of segment : 727 time for calcul the mask position with numpy : 0.001020193099975586 nb_pixel_total : 44198 time to create 1 rle with old method : 0.04817056655883789 length of segment : 188 time for calcul the mask position with numpy : 0.013097047805786133 nb_pixel_total : 529733 time to create 1 rle with new method : 0.15658068656921387 length of segment : 874 time for calcul the mask position with numpy : 0.0019221305847167969 nb_pixel_total : 87805 time to create 1 rle with old method : 0.09243631362915039 length of segment : 343 time for calcul the mask position with numpy : 0.0024073123931884766 nb_pixel_total : 133896 time to create 1 rle with old method : 0.14609479904174805 length of segment : 565 time for calcul the mask position with numpy : 0.0005776882171630859 nb_pixel_total : 22663 time to create 1 rle with old method : 0.02416086196899414 length of segment : 241 time for calcul the mask position with numpy : 0.00023698806762695312 nb_pixel_total : 7718 time to create 1 rle with old method : 0.008803844451904297 length of segment : 150 time for calcul the mask position with numpy : 0.0014417171478271484 nb_pixel_total : 63236 time to create 1 rle with old method : 0.06945252418518066 length of segment : 308 time for calcul the mask position with numpy : 0.0007121562957763672 nb_pixel_total : 28111 time to create 1 rle with old method : 0.030870676040649414 length of segment : 182 time for calcul the mask position with numpy : 0.0008976459503173828 nb_pixel_total : 8090 time to create 1 rle with old method : 0.009023666381835938 length of segment : 261 time for calcul the mask position with numpy : 0.0002617835998535156 nb_pixel_total : 11046 time to create 1 rle with old method : 0.012357950210571289 length of segment : 121 time for calcul the mask position with numpy : 0.0013017654418945312 nb_pixel_total : 75684 time to create 1 rle with old method : 0.08288764953613281 length of segment : 325 time for calcul the mask position with numpy : 0.0020966529846191406 nb_pixel_total : 78526 time to create 1 rle with old method : 0.08428359031677246 length of segment : 276 time for calcul the mask position with numpy : 0.00022482872009277344 nb_pixel_total : 7319 time to create 1 rle with old method : 0.008076667785644531 length of segment : 95 time for calcul the mask position with numpy : 0.0015070438385009766 nb_pixel_total : 76491 time to create 1 rle with old method : 0.08260631561279297 length of segment : 278 time for calcul the mask position with numpy : 0.00021266937255859375 nb_pixel_total : 8471 time to create 1 rle with old method : 0.009342193603515625 length of segment : 105 time for calcul the mask position with numpy : 0.0016355514526367188 nb_pixel_total : 58590 time to create 1 rle with old method : 0.06440043449401855 length of segment : 649 time for calcul the mask position with numpy : 0.0004723072052001953 nb_pixel_total : 17106 time to create 1 rle with old method : 0.018954992294311523 length of segment : 156 time for calcul the mask position with numpy : 0.0003094673156738281 nb_pixel_total : 11586 time to create 1 rle with old method : 0.012995243072509766 length of segment : 128 time for calcul the mask position with numpy : 0.0005986690521240234 nb_pixel_total : 27956 time to create 1 rle with old method : 0.030833959579467773 length of segment : 168 time for calcul the mask position with numpy : 0.0010211467742919922 nb_pixel_total : 42515 time to create 1 rle with old method : 0.04670405387878418 length of segment : 250 time for calcul the mask position with numpy : 0.00046563148498535156 nb_pixel_total : 22916 time to create 1 rle with old method : 0.025571584701538086 length of segment : 99 time for calcul the mask position with numpy : 0.0003807544708251953 nb_pixel_total : 11956 time to create 1 rle with old method : 0.013516426086425781 length of segment : 119 time for calcul the mask position with numpy : 0.0002522468566894531 nb_pixel_total : 7927 time to create 1 rle with old method : 0.008855104446411133 length of segment : 202 time for calcul the mask position with numpy : 0.0005509853363037109 nb_pixel_total : 19417 time to create 1 rle with old method : 0.02199268341064453 length of segment : 162 time for calcul the mask position with numpy : 0.0006022453308105469 nb_pixel_total : 24615 time to create 1 rle with old method : 0.029593229293823242 length of segment : 202 time for calcul the mask position with numpy : 0.0007257461547851562 nb_pixel_total : 35725 time to create 1 rle with old method : 0.038840293884277344 length of segment : 198 time for calcul the mask position with numpy : 0.0015437602996826172 nb_pixel_total : 56671 time to create 1 rle with old method : 0.060982465744018555 length of segment : 323 time for calcul the mask position with numpy : 0.0011172294616699219 nb_pixel_total : 66429 time to create 1 rle with old method : 0.07079100608825684 length of segment : 342 time for calcul the mask position with numpy : 0.0012307167053222656 nb_pixel_total : 55444 time to create 1 rle with old method : 0.059886932373046875 length of segment : 281 time for calcul the mask position with numpy : 0.0003151893615722656 nb_pixel_total : 12511 time to create 1 rle with old method : 0.0134124755859375 length of segment : 149 time for calcul the mask position with numpy : 0.0018529891967773438 nb_pixel_total : 91006 time to create 1 rle with old method : 0.09711718559265137 length of segment : 592 time for calcul the mask position with numpy : 0.0008783340454101562 nb_pixel_total : 34016 time to create 1 rle with old method : 0.03655648231506348 length of segment : 304 time for calcul the mask position with numpy : 0.0006947517395019531 nb_pixel_total : 29492 time to create 1 rle with old method : 0.03325533866882324 length of segment : 232 time for calcul the mask position with numpy : 0.0014789104461669922 nb_pixel_total : 64315 time to create 1 rle with old method : 0.07509255409240723 length of segment : 336 time for calcul the mask position with numpy : 0.0016016960144042969 nb_pixel_total : 93148 time to create 1 rle with old method : 0.10033416748046875 length of segment : 345 time for calcul the mask position with numpy : 0.0024213790893554688 nb_pixel_total : 93572 time to create 1 rle with old method : 0.10251426696777344 length of segment : 356 time for calcul the mask position with numpy : 0.00045943260192871094 nb_pixel_total : 17503 time to create 1 rle with old method : 0.020956754684448242 length of segment : 220 time for calcul the mask position with numpy : 0.0011098384857177734 nb_pixel_total : 43766 time to create 1 rle with old method : 0.05025362968444824 length of segment : 379 time for calcul the mask position with numpy : 0.0008001327514648438 nb_pixel_total : 33537 time to create 1 rle with old method : 0.039389848709106445 length of segment : 198 time for calcul the mask position with numpy : 0.000347137451171875 nb_pixel_total : 11918 time to create 1 rle with old method : 0.014126300811767578 length of segment : 147 time for calcul the mask position with numpy : 0.003319263458251953 nb_pixel_total : 122536 time to create 1 rle with old method : 0.1358945369720459 length of segment : 489 time for calcul the mask position with numpy : 0.0004391670227050781 nb_pixel_total : 23619 time to create 1 rle with old method : 0.026192665100097656 length of segment : 145 time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 9306 time to create 1 rle with old method : 0.010928630828857422 length of segment : 174 time for calcul the mask position with numpy : 0.0021975040435791016 nb_pixel_total : 112658 time to create 1 rle with old method : 0.11902308464050293 length of segment : 574 time for calcul the mask position with numpy : 0.0003337860107421875 nb_pixel_total : 15627 time to create 1 rle with old method : 0.01754474639892578 length of segment : 112 time for calcul the mask position with numpy : 0.0010478496551513672 nb_pixel_total : 48237 time to create 1 rle with old method : 0.05321621894836426 length of segment : 344 time for calcul the mask position with numpy : 0.00027370452880859375 nb_pixel_total : 7347 time to create 1 rle with old method : 0.008188247680664062 length of segment : 283 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 18542 time to create 1 rle with old method : 0.02016758918762207 length of segment : 138 time for calcul the mask position with numpy : 0.0006592273712158203 nb_pixel_total : 33412 time to create 1 rle with old method : 0.0359492301940918 length of segment : 143 time for calcul the mask position with numpy : 0.0003070831298828125 nb_pixel_total : 11731 time to create 1 rle with old method : 0.012547016143798828 length of segment : 189 time for calcul the mask position with numpy : 0.00036334991455078125 nb_pixel_total : 18592 time to create 1 rle with old method : 0.019855260848999023 length of segment : 172 time for calcul the mask position with numpy : 0.0008647441864013672 nb_pixel_total : 34247 time to create 1 rle with old method : 0.03833913803100586 length of segment : 403 time for calcul the mask position with numpy : 0.001519918441772461 nb_pixel_total : 75553 time to create 1 rle with old method : 0.08146548271179199 length of segment : 310 time for calcul the mask position with numpy : 0.0023298263549804688 nb_pixel_total : 103717 time to create 1 rle with old method : 0.1114664077758789 length of segment : 473 time for calcul the mask position with numpy : 0.001482248306274414 nb_pixel_total : 56422 time to create 1 rle with old method : 0.06095385551452637 length of segment : 334 time for calcul the mask position with numpy : 0.000644683837890625 nb_pixel_total : 24698 time to create 1 rle with old method : 0.02674126625061035 length of segment : 195 time for calcul the mask position with numpy : 0.0013167858123779297 nb_pixel_total : 66066 time to create 1 rle with old method : 0.07616424560546875 length of segment : 326 time for calcul the mask position with numpy : 0.00070953369140625 nb_pixel_total : 33461 time to create 1 rle with old method : 0.037940025329589844 length of segment : 206 time for calcul the mask position with numpy : 0.00029659271240234375 nb_pixel_total : 13346 time to create 1 rle with old method : 0.01539921760559082 length of segment : 120 time for calcul the mask position with numpy : 0.0005300045013427734 nb_pixel_total : 27123 time to create 1 rle with old method : 0.029378414154052734 length of segment : 224 time for calcul the mask position with numpy : 0.0005702972412109375 nb_pixel_total : 29560 time to create 1 rle with old method : 0.03248238563537598 length of segment : 156 time for calcul the mask position with numpy : 0.0004394054412841797 nb_pixel_total : 28335 time to create 1 rle with old method : 0.03124523162841797 length of segment : 144 time for calcul the mask position with numpy : 0.0010466575622558594 nb_pixel_total : 50621 time to create 1 rle with old method : 0.05561661720275879 length of segment : 292 time for calcul the mask position with numpy : 0.0002551078796386719 nb_pixel_total : 13312 time to create 1 rle with old method : 0.015099525451660156 length of segment : 116 time for calcul the mask position with numpy : 0.23257780075073242 nb_pixel_total : 4080107 time to create 1 rle with new method : 0.743558406829834 length of segment : 5721 time for calcul the mask position with numpy : 0.0015938282012939453 nb_pixel_total : 110816 time to create 1 rle with old method : 0.12033748626708984 length of segment : 605 time for calcul the mask position with numpy : 0.024192094802856445 nb_pixel_total : 1028987 time to create 1 rle with new method : 0.23941826820373535 length of segment : 1489 time for calcul the mask position with numpy : 0.0004992485046386719 nb_pixel_total : 36620 time to create 1 rle with old method : 0.04035210609436035 length of segment : 297 time for calcul the mask position with numpy : 0.0035309791564941406 nb_pixel_total : 289828 time to create 1 rle with new method : 0.008921384811401367 length of segment : 1162 time for calcul the mask position with numpy : 0.13825082778930664 nb_pixel_total : 2354830 time to create 1 rle with new method : 0.2118549346923828 length of segment : 1923 time for calcul the mask position with numpy : 0.0010352134704589844 nb_pixel_total : 57561 time to create 1 rle with old method : 0.08120250701904297 length of segment : 826 time for calcul the mask position with numpy : 0.0005383491516113281 nb_pixel_total : 25193 time to create 1 rle with old method : 0.027947664260864258 length of segment : 365 time for calcul the mask position with numpy : 0.0011141300201416016 nb_pixel_total : 54961 time to create 1 rle with old method : 0.06078004837036133 length of segment : 747 time for calcul the mask position with numpy : 0.00028133392333984375 nb_pixel_total : 17228 time to create 1 rle with old method : 0.019355058670043945 length of segment : 199 time for calcul the mask position with numpy : 0.0007574558258056641 nb_pixel_total : 54584 time to create 1 rle with old method : 0.06114602088928223 length of segment : 626 time for calcul the mask position with numpy : 0.000545501708984375 nb_pixel_total : 29334 time to create 1 rle with old method : 0.032927751541137695 length of segment : 460 time spent for convertir_results : 29.621535778045654 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 332 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 78.22914481163025 time spend to save output : 0.18938755989074707 total time spend for step 2 : 78.418532371521 step3:blur_detection Thu Aug 28 23:03:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (2448, 2448) 1426.4929216994701 (2448, 2448) 791.9150299046787 (2448, 2448) 1506.3588605871525 (3120, 3120) 192.290533888585 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.031122207641601562 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 1.856372594833374 save missing photos in datou_result : time spend for datou_step_exec : 0.41025376319885254 time spend to save output : 1.8921597003936768 total time spend for step 3 : 2.3024134635925293 step4:brightness Thu Aug 28 23:03:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756414889_835981_1379966997_29416458570cd660df2300b4f18e657b.jpg treat image : temp/1756414889_835981_1379966995_bfcce4fa62d17de455ed26decc791df1.jpg treat image : temp/1756414889_835981_1379966990_152ac8fffe5cc4cede1b8c3b6f057b54.jpg treat image : temp/1756414889_835981_1379966986_cdca2f70309ee0594131b7eaffe0dfca.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.01257634162902832 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 2.6637532711029053 save missing photos in datou_result : time spend for datou_step_exec : 3.066894292831421 time spend to save output : 2.681178331375122 total time spend for step 4 : 5.748072624206543 step5:rle_unique_nms_with_priority Thu Aug 28 23:03:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 332 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 107 nb_hashtags : 10 time to prepare the origin masks : 24.756256103515625 time for calcul the mask position with numpy : 0.05426144599914551 nb_pixel_total : 1802681 time to create 1 rle with new method : 0.8044357299804688 time for calcul the mask position with numpy : 0.023621082305908203 nb_pixel_total : 12855 time to create 1 rle with old method : 0.013982534408569336 time for calcul the mask position with numpy : 0.023434877395629883 nb_pixel_total : 33 time to create 1 rle with old method : 6.771087646484375e-05 time for calcul the mask position with numpy : 0.023713350296020508 nb_pixel_total : 23058 time to create 1 rle with old method : 0.025092601776123047 time for calcul the mask position with numpy : 0.02391362190246582 nb_pixel_total : 6263 time to create 1 rle with old method : 0.0072367191314697266 time for calcul the mask position with numpy : 0.024353981018066406 nb_pixel_total : 6190 time to create 1 rle with old method : 0.008858203887939453 time for calcul the mask position with numpy : 0.024615049362182617 nb_pixel_total : 117235 time to create 1 rle with old method : 0.12441635131835938 time for calcul the mask position with numpy : 0.02343297004699707 nb_pixel_total : 20997 time to create 1 rle with old method : 0.02286815643310547 time for calcul the mask position with numpy : 0.025962114334106445 nb_pixel_total : 532573 time to create 1 rle with new method : 0.49401259422302246 time for calcul the mask position with numpy : 0.024517297744750977 nb_pixel_total : 261184 time to create 1 rle with new method : 0.5037248134613037 time for calcul the mask position with numpy : 0.023954391479492188 nb_pixel_total : 48414 time to create 1 rle with old method : 0.05234074592590332 time for calcul the mask position with numpy : 0.023397445678710938 nb_pixel_total : 215 time to create 1 rle with old method : 0.0002732276916503906 time for calcul the mask position with numpy : 0.022895097732543945 nb_pixel_total : 13466 time to create 1 rle with old method : 0.013860225677490234 time for calcul the mask position with numpy : 0.023090839385986328 nb_pixel_total : 15040 time to create 1 rle with old method : 0.015473604202270508 time for calcul the mask position with numpy : 0.02349066734313965 nb_pixel_total : 11942 time to create 1 rle with old method : 0.012406349182128906 time for calcul the mask position with numpy : 0.023050785064697266 nb_pixel_total : 25960 time to create 1 rle with old method : 0.026923418045043945 time for calcul the mask position with numpy : 0.022742033004760742 nb_pixel_total : 10053 time to create 1 rle with old method : 0.010234594345092773 time for calcul the mask position with numpy : 0.022825241088867188 nb_pixel_total : 7505 time to create 1 rle with old method : 0.007718563079833984 time for calcul the mask position with numpy : 0.02310466766357422 nb_pixel_total : 12405 time to create 1 rle with old method : 0.012782096862792969 time for calcul the mask position with numpy : 0.02333688735961914 nb_pixel_total : 62 time to create 1 rle with old method : 0.00012731552124023438 time for calcul the mask position with numpy : 0.02320694923400879 nb_pixel_total : 7061 time to create 1 rle with old method : 0.007421731948852539 time for calcul the mask position with numpy : 0.023485898971557617 nb_pixel_total : 1026 time to create 1 rle with old method : 0.001384735107421875 time for calcul the mask position with numpy : 0.02270793914794922 nb_pixel_total : 16522 time to create 1 rle with old method : 0.017391443252563477 time for calcul the mask position with numpy : 0.023452043533325195 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0014286041259765625 time for calcul the mask position with numpy : 0.02267765998840332 nb_pixel_total : 9564 time to create 1 rle with old method : 0.009773492813110352 time for calcul the mask position with numpy : 0.02361893653869629 nb_pixel_total : 2494 time to create 1 rle with old method : 0.0027675628662109375 time for calcul the mask position with numpy : 0.02357196807861328 nb_pixel_total : 47824 time to create 1 rle with old method : 0.04956340789794922 time for calcul the mask position with numpy : 0.023139476776123047 nb_pixel_total : 29856 time to create 1 rle with old method : 0.030394554138183594 time for calcul the mask position with numpy : 0.022545576095581055 nb_pixel_total : 28501 time to create 1 rle with old method : 0.029087066650390625 time for calcul the mask position with numpy : 0.02341151237487793 nb_pixel_total : 60160 time to create 1 rle with old method : 0.06151533126831055 time for calcul the mask position with numpy : 0.022417068481445312 nb_pixel_total : 2339 time to create 1 rle with old method : 0.002417325973510742 time for calcul the mask position with numpy : 0.022344112396240234 nb_pixel_total : 8850 time to create 1 rle with old method : 0.009226799011230469 time for calcul the mask position with numpy : 0.022454023361206055 nb_pixel_total : 4876 time to create 1 rle with old method : 0.005182027816772461 time for calcul the mask position with numpy : 0.0222625732421875 nb_pixel_total : 8 time to create 1 rle with old method : 5.555152893066406e-05 time for calcul the mask position with numpy : 0.022087574005126953 nb_pixel_total : 9678 time to create 1 rle with old method : 0.009847164154052734 time for calcul the mask position with numpy : 0.022776126861572266 nb_pixel_total : 24045 time to create 1 rle with old method : 0.026381969451904297 time for calcul the mask position with numpy : 0.022741317749023438 nb_pixel_total : 75670 time to create 1 rle with old method : 0.07695960998535156 time for calcul the mask position with numpy : 0.022533416748046875 nb_pixel_total : 20502 time to create 1 rle with old method : 0.02136087417602539 time for calcul the mask position with numpy : 0.022470951080322266 nb_pixel_total : 19341 time to create 1 rle with old method : 0.01963639259338379 time for calcul the mask position with numpy : 0.022442102432250977 nb_pixel_total : 9793 time to create 1 rle with old method : 0.010002851486206055 time for calcul the mask position with numpy : 0.023020505905151367 nb_pixel_total : 8880 time to create 1 rle with old method : 0.00945901870727539 time for calcul the mask position with numpy : 0.022838830947875977 nb_pixel_total : 7982 time to create 1 rle with old method : 0.008456230163574219 time for calcul the mask position with numpy : 0.023366212844848633 nb_pixel_total : 23909 time to create 1 rle with old method : 0.025602102279663086 time for calcul the mask position with numpy : 0.02362990379333496 nb_pixel_total : 71141 time to create 1 rle with old method : 0.07421088218688965 time for calcul the mask position with numpy : 0.022367238998413086 nb_pixel_total : 55810 time to create 1 rle with old method : 0.05816769599914551 time for calcul the mask position with numpy : 0.023747682571411133 nb_pixel_total : 13003 time to create 1 rle with old method : 0.014952659606933594 time for calcul the mask position with numpy : 0.02586960792541504 nb_pixel_total : 25421 time to create 1 rle with old method : 0.030318498611450195 time for calcul the mask position with numpy : 0.02882862091064453 nb_pixel_total : 78194 time to create 1 rle with old method : 0.09077024459838867 time for calcul the mask position with numpy : 0.02275705337524414 nb_pixel_total : 9017 time to create 1 rle with old method : 0.009372949600219727 time for calcul the mask position with numpy : 0.022397279739379883 nb_pixel_total : 48613 time to create 1 rle with old method : 0.04951047897338867 time for calcul the mask position with numpy : 0.0226132869720459 nb_pixel_total : 19733 time to create 1 rle with old method : 0.02135014533996582 time for calcul the mask position with numpy : 0.024810791015625 nb_pixel_total : 17960 time to create 1 rle with old method : 0.02003192901611328 time for calcul the mask position with numpy : 0.02829766273498535 nb_pixel_total : 27787 time to create 1 rle with old method : 0.030708789825439453 time for calcul the mask position with numpy : 0.02511906623840332 nb_pixel_total : 23398 time to create 1 rle with old method : 0.02798008918762207 time for calcul the mask position with numpy : 0.02470993995666504 nb_pixel_total : 9337 time to create 1 rle with old method : 0.010444164276123047 time for calcul the mask position with numpy : 0.023781299591064453 nb_pixel_total : 24739 time to create 1 rle with old method : 0.02632927894592285 time for calcul the mask position with numpy : 0.023333311080932617 nb_pixel_total : 18584 time to create 1 rle with old method : 0.01898479461669922 time for calcul the mask position with numpy : 0.023215532302856445 nb_pixel_total : 190779 time to create 1 rle with new method : 0.44788527488708496 time for calcul the mask position with numpy : 0.02248406410217285 nb_pixel_total : 16105 time to create 1 rle with old method : 0.016542911529541016 time for calcul the mask position with numpy : 0.02222299575805664 nb_pixel_total : 14771 time to create 1 rle with old method : 0.0160982608795166 time for calcul the mask position with numpy : 0.02284979820251465 nb_pixel_total : 24408 time to create 1 rle with old method : 0.025475502014160156 time for calcul the mask position with numpy : 0.022663354873657227 nb_pixel_total : 72922 time to create 1 rle with old method : 0.0754542350769043 time for calcul the mask position with numpy : 0.022541284561157227 nb_pixel_total : 13956 time to create 1 rle with old method : 0.014893531799316406 time for calcul the mask position with numpy : 0.023608684539794922 nb_pixel_total : 5582 time to create 1 rle with old method : 0.006493806838989258 time for calcul the mask position with numpy : 0.023507356643676758 nb_pixel_total : 57779 time to create 1 rle with old method : 0.06126761436462402 time for calcul the mask position with numpy : 0.023932933807373047 nb_pixel_total : 84223 time to create 1 rle with old method : 0.09118032455444336 time for calcul the mask position with numpy : 0.02460193634033203 nb_pixel_total : 52142 time to create 1 rle with old method : 0.05545783042907715 time for calcul the mask position with numpy : 0.023165464401245117 nb_pixel_total : 57164 time to create 1 rle with old method : 0.06012845039367676 time for calcul the mask position with numpy : 0.02366018295288086 nb_pixel_total : 866 time to create 1 rle with old method : 0.0009462833404541016 time for calcul the mask position with numpy : 0.02329230308532715 nb_pixel_total : 4218 time to create 1 rle with old method : 0.0048635005950927734 time for calcul the mask position with numpy : 0.023307085037231445 nb_pixel_total : 115182 time to create 1 rle with old method : 0.11986279487609863 time for calcul the mask position with numpy : 0.022681713104248047 nb_pixel_total : 13036 time to create 1 rle with old method : 0.013180971145629883 time for calcul the mask position with numpy : 0.022410869598388672 nb_pixel_total : 2593 time to create 1 rle with old method : 0.002801656723022461 time for calcul the mask position with numpy : 0.023013830184936523 nb_pixel_total : 11476 time to create 1 rle with old method : 0.011651754379272461 time for calcul the mask position with numpy : 0.02225947380065918 nb_pixel_total : 5842 time to create 1 rle with old method : 0.00626683235168457 time for calcul the mask position with numpy : 0.022952556610107422 nb_pixel_total : 21800 time to create 1 rle with old method : 0.023221731185913086 time for calcul the mask position with numpy : 0.023038864135742188 nb_pixel_total : 17558 time to create 1 rle with old method : 0.018047332763671875 time for calcul the mask position with numpy : 0.02280426025390625 nb_pixel_total : 33404 time to create 1 rle with old method : 0.03499603271484375 time for calcul the mask position with numpy : 0.022849559783935547 nb_pixel_total : 2457 time to create 1 rle with old method : 0.002785921096801758 time for calcul the mask position with numpy : 0.02345108985900879 nb_pixel_total : 9046 time to create 1 rle with old method : 0.009769678115844727 time for calcul the mask position with numpy : 0.023329973220825195 nb_pixel_total : 11560 time to create 1 rle with old method : 0.012318611145019531 time for calcul the mask position with numpy : 0.02359747886657715 nb_pixel_total : 57823 time to create 1 rle with old method : 0.059442996978759766 time for calcul the mask position with numpy : 0.02239060401916504 nb_pixel_total : 11450 time to create 1 rle with old method : 0.012100696563720703 time for calcul the mask position with numpy : 0.02349376678466797 nb_pixel_total : 1148 time to create 1 rle with old method : 0.0013887882232666016 time for calcul the mask position with numpy : 0.023804664611816406 nb_pixel_total : 14717 time to create 1 rle with old method : 0.015617609024047852 time for calcul the mask position with numpy : 0.023648738861083984 nb_pixel_total : 14379 time to create 1 rle with old method : 0.015308380126953125 time for calcul the mask position with numpy : 0.022869586944580078 nb_pixel_total : 3 time to create 1 rle with old method : 2.0265579223632812e-05 time for calcul the mask position with numpy : 0.02230238914489746 nb_pixel_total : 454 time to create 1 rle with old method : 0.0008571147918701172 time for calcul the mask position with numpy : 0.02246856689453125 nb_pixel_total : 10476 time to create 1 rle with old method : 0.011018037796020508 time for calcul the mask position with numpy : 0.022228240966796875 nb_pixel_total : 14751 time to create 1 rle with old method : 0.015092134475708008 time for calcul the mask position with numpy : 0.02211928367614746 nb_pixel_total : 8763 time to create 1 rle with old method : 0.00902104377746582 time for calcul the mask position with numpy : 0.022808313369750977 nb_pixel_total : 55643 time to create 1 rle with old method : 0.05868029594421387 time for calcul the mask position with numpy : 0.023905277252197266 nb_pixel_total : 117628 time to create 1 rle with old method : 0.12958073616027832 time for calcul the mask position with numpy : 0.025771379470825195 nb_pixel_total : 80759 time to create 1 rle with old method : 0.08772826194763184 time for calcul the mask position with numpy : 0.023112058639526367 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007467269897460938 time for calcul the mask position with numpy : 0.022610187530517578 nb_pixel_total : 12400 time to create 1 rle with old method : 0.013188600540161133 time for calcul the mask position with numpy : 0.022958040237426758 nb_pixel_total : 12107 time to create 1 rle with old method : 0.012623786926269531 time for calcul the mask position with numpy : 0.023135662078857422 nb_pixel_total : 10564 time to create 1 rle with old method : 0.011561393737792969 time for calcul the mask position with numpy : 0.02321600914001465 nb_pixel_total : 21242 time to create 1 rle with old method : 0.02238178253173828 time for calcul the mask position with numpy : 0.02780318260192871 nb_pixel_total : 757989 time to create 1 rle with new method : 0.48375988006591797 time for calcul the mask position with numpy : 0.023694992065429688 nb_pixel_total : 32543 time to create 1 rle with old method : 0.03466343879699707 time for calcul the mask position with numpy : 0.02373790740966797 nb_pixel_total : 14506 time to create 1 rle with old method : 0.01512765884399414 time for calcul the mask position with numpy : 0.023930788040161133 nb_pixel_total : 44705 time to create 1 rle with old method : 0.04843449592590332 time for calcul the mask position with numpy : 0.023880481719970703 nb_pixel_total : 1080 time to create 1 rle with old method : 0.0011687278747558594 time for calcul the mask position with numpy : 0.023252487182617188 nb_pixel_total : 14353 time to create 1 rle with old method : 0.015267133712768555 time for calcul the mask position with numpy : 0.02291560173034668 nb_pixel_total : 44420 time to create 1 rle with old method : 0.045404911041259766 time for calcul the mask position with numpy : 0.023473501205444336 nb_pixel_total : 8249 time to create 1 rle with old method : 0.008511066436767578 time for calcul the mask position with numpy : 0.02287888526916504 nb_pixel_total : 27 time to create 1 rle with old method : 4.3392181396484375e-05 create new chi : 7.987964153289795 time to delete rle : 0.024981260299682617 batch 1 Loaded 108 chid ids of type : 4855 Number RLEs to save : 43125 TO DO : save crop sub photo not yet done ! save time : 2.4623117446899414 nb_obj : 118 nb_hashtags : 11 time to prepare the origin masks : 25.369101524353027 time for calcul the mask position with numpy : 0.4985017776489258 nb_pixel_total : 2586139 time to create 1 rle with new method : 0.8054044246673584 time for calcul the mask position with numpy : 0.02353835105895996 nb_pixel_total : 5038 time to create 1 rle with old method : 0.0053043365478515625 time for calcul the mask position with numpy : 0.023563146591186523 nb_pixel_total : 44054 time to create 1 rle with old method : 0.04590749740600586 time for calcul the mask position with numpy : 0.02375960350036621 nb_pixel_total : 4141 time to create 1 rle with old method : 0.004505634307861328 time for calcul the mask position with numpy : 0.024104595184326172 nb_pixel_total : 38268 time to create 1 rle with old method : 0.04256916046142578 time for calcul the mask position with numpy : 0.024902820587158203 nb_pixel_total : 27217 time to create 1 rle with old method : 0.030558109283447266 time for calcul the mask position with numpy : 0.024920225143432617 nb_pixel_total : 14990 time to create 1 rle with old method : 0.01675891876220703 time for calcul the mask position with numpy : 0.02468132972717285 nb_pixel_total : 665 time to create 1 rle with old method : 0.0008764266967773438 time for calcul the mask position with numpy : 0.025532960891723633 nb_pixel_total : 94883 time to create 1 rle with old method : 0.10488009452819824 time for calcul the mask position with numpy : 0.0232851505279541 nb_pixel_total : 4205 time to create 1 rle with old method : 0.00460362434387207 time for calcul the mask position with numpy : 0.022991657257080078 nb_pixel_total : 16341 time to create 1 rle with old method : 0.01769256591796875 time for calcul the mask position with numpy : 0.022545814514160156 nb_pixel_total : 5131 time to create 1 rle with old method : 0.0058765411376953125 time for calcul the mask position with numpy : 0.02314305305480957 nb_pixel_total : 31031 time to create 1 rle with old method : 0.03398251533508301 time for calcul the mask position with numpy : 0.024143695831298828 nb_pixel_total : 49094 time to create 1 rle with old method : 0.05335235595703125 time for calcul the mask position with numpy : 0.024563312530517578 nb_pixel_total : 215257 time to create 1 rle with new method : 0.5706286430358887 time for calcul the mask position with numpy : 0.02368903160095215 nb_pixel_total : 25247 time to create 1 rle with old method : 0.027420997619628906 time for calcul the mask position with numpy : 0.023001909255981445 nb_pixel_total : 17900 time to create 1 rle with old method : 0.01995992660522461 time for calcul the mask position with numpy : 0.024235248565673828 nb_pixel_total : 106538 time to create 1 rle with old method : 0.11308407783508301 time for calcul the mask position with numpy : 0.023025989532470703 nb_pixel_total : 5415 time to create 1 rle with old method : 0.0061032772064208984 time for calcul the mask position with numpy : 0.02293229103088379 nb_pixel_total : 5932 time to create 1 rle with old method : 0.006197690963745117 time for calcul the mask position with numpy : 0.02307724952697754 nb_pixel_total : 28266 time to create 1 rle with old method : 0.030130863189697266 time for calcul the mask position with numpy : 0.023406028747558594 nb_pixel_total : 11540 time to create 1 rle with old method : 0.011987924575805664 time for calcul the mask position with numpy : 0.02330327033996582 nb_pixel_total : 9980 time to create 1 rle with old method : 0.010285615921020508 time for calcul the mask position with numpy : 0.023887157440185547 nb_pixel_total : 23887 time to create 1 rle with old method : 0.026702404022216797 time for calcul the mask position with numpy : 0.023836135864257812 nb_pixel_total : 7836 time to create 1 rle with old method : 0.00848078727722168 time for calcul the mask position with numpy : 0.023749589920043945 nb_pixel_total : 28998 time to create 1 rle with old method : 0.03068685531616211 time for calcul the mask position with numpy : 0.023718833923339844 nb_pixel_total : 23754 time to create 1 rle with old method : 0.02556633949279785 time for calcul the mask position with numpy : 0.02431511878967285 nb_pixel_total : 5947 time to create 1 rle with old method : 0.006478786468505859 time for calcul the mask position with numpy : 0.023415327072143555 nb_pixel_total : 11053 time to create 1 rle with old method : 0.012163400650024414 time for calcul the mask position with numpy : 0.02313065528869629 nb_pixel_total : 38213 time to create 1 rle with old method : 0.04170060157775879 time for calcul the mask position with numpy : 0.02305912971496582 nb_pixel_total : 4866 time to create 1 rle with old method : 0.005479097366333008 time for calcul the mask position with numpy : 0.02361607551574707 nb_pixel_total : 6846 time to create 1 rle with old method : 0.007749319076538086 time for calcul the mask position with numpy : 0.023879528045654297 nb_pixel_total : 16420 time to create 1 rle with old method : 0.01776576042175293 time for calcul the mask position with numpy : 0.02359485626220703 nb_pixel_total : 18179 time to create 1 rle with old method : 0.019685745239257812 time for calcul the mask position with numpy : 0.024005889892578125 nb_pixel_total : 128232 time to create 1 rle with old method : 0.13828825950622559 time for calcul the mask position with numpy : 0.023616313934326172 nb_pixel_total : 21686 time to create 1 rle with old method : 0.02320098876953125 time for calcul the mask position with numpy : 0.024195194244384766 nb_pixel_total : 29961 time to create 1 rle with old method : 0.03233027458190918 time for calcul the mask position with numpy : 0.024067401885986328 nb_pixel_total : 29943 time to create 1 rle with old method : 0.03158926963806152 time for calcul the mask position with numpy : 0.02375626564025879 nb_pixel_total : 38019 time to create 1 rle with old method : 0.03979778289794922 time for calcul the mask position with numpy : 0.02346491813659668 nb_pixel_total : 32241 time to create 1 rle with old method : 0.03417325019836426 time for calcul the mask position with numpy : 0.02279520034790039 nb_pixel_total : 8408 time to create 1 rle with old method : 0.008600234985351562 time for calcul the mask position with numpy : 0.022989273071289062 nb_pixel_total : 21074 time to create 1 rle with old method : 0.0223236083984375 time for calcul the mask position with numpy : 0.022920608520507812 nb_pixel_total : 84499 time to create 1 rle with old method : 0.0870203971862793 time for calcul the mask position with numpy : 0.022867918014526367 nb_pixel_total : 25099 time to create 1 rle with old method : 0.026246070861816406 time for calcul the mask position with numpy : 0.023029088973999023 nb_pixel_total : 27323 time to create 1 rle with old method : 0.02874279022216797 time for calcul the mask position with numpy : 0.022603750228881836 nb_pixel_total : 22277 time to create 1 rle with old method : 0.02252936363220215 time for calcul the mask position with numpy : 0.022684335708618164 nb_pixel_total : 21119 time to create 1 rle with old method : 0.021651506423950195 time for calcul the mask position with numpy : 0.022969722747802734 nb_pixel_total : 47523 time to create 1 rle with old method : 0.0488741397857666 time for calcul the mask position with numpy : 0.022739887237548828 nb_pixel_total : 32151 time to create 1 rle with old method : 0.03391289710998535 time for calcul the mask position with numpy : 0.023085594177246094 nb_pixel_total : 12079 time to create 1 rle with old method : 0.012433052062988281 time for calcul the mask position with numpy : 0.022974729537963867 nb_pixel_total : 13463 time to create 1 rle with old method : 0.013907909393310547 time for calcul the mask position with numpy : 0.022540807723999023 nb_pixel_total : 2396 time to create 1 rle with old method : 0.003040313720703125 time for calcul the mask position with numpy : 0.023245811462402344 nb_pixel_total : 98813 time to create 1 rle with old method : 0.1015625 time for calcul the mask position with numpy : 0.022979736328125 nb_pixel_total : 75476 time to create 1 rle with old method : 0.08312034606933594 time for calcul the mask position with numpy : 0.02270221710205078 nb_pixel_total : 7041 time to create 1 rle with old method : 0.007614612579345703 time for calcul the mask position with numpy : 0.022791147232055664 nb_pixel_total : 13853 time to create 1 rle with old method : 0.014190435409545898 time for calcul the mask position with numpy : 0.022472143173217773 nb_pixel_total : 60251 time to create 1 rle with old method : 0.06296300888061523 time for calcul the mask position with numpy : 0.023440122604370117 nb_pixel_total : 12070 time to create 1 rle with old method : 0.012616157531738281 time for calcul the mask position with numpy : 0.023079395294189453 nb_pixel_total : 19321 time to create 1 rle with old method : 0.02095937728881836 time for calcul the mask position with numpy : 0.023474693298339844 nb_pixel_total : 2244 time to create 1 rle with old method : 0.0026264190673828125 time for calcul the mask position with numpy : 0.024236440658569336 nb_pixel_total : 6601 time to create 1 rle with old method : 0.007221698760986328 time for calcul the mask position with numpy : 0.023410558700561523 nb_pixel_total : 15262 time to create 1 rle with old method : 0.01574254035949707 time for calcul the mask position with numpy : 0.02362513542175293 nb_pixel_total : 4788 time to create 1 rle with old method : 0.0052301883697509766 time for calcul the mask position with numpy : 0.023703813552856445 nb_pixel_total : 25601 time to create 1 rle with old method : 0.027723073959350586 time for calcul the mask position with numpy : 0.023148775100708008 nb_pixel_total : 8478 time to create 1 rle with old method : 0.008970260620117188 time for calcul the mask position with numpy : 0.02370429039001465 nb_pixel_total : 30624 time to create 1 rle with old method : 0.03382611274719238 time for calcul the mask position with numpy : 0.02412867546081543 nb_pixel_total : 20978 time to create 1 rle with old method : 0.02202582359313965 time for calcul the mask position with numpy : 0.023339271545410156 nb_pixel_total : 7629 time to create 1 rle with old method : 0.008129119873046875 time for calcul the mask position with numpy : 0.025254011154174805 nb_pixel_total : 226222 time to create 1 rle with new method : 1.6615126132965088 time for calcul the mask position with numpy : 0.022923707962036133 nb_pixel_total : 16413 time to create 1 rle with old method : 0.01663041114807129 time for calcul the mask position with numpy : 0.023566007614135742 nb_pixel_total : 141600 time to create 1 rle with old method : 0.14684534072875977 time for calcul the mask position with numpy : 0.022908687591552734 nb_pixel_total : 3010 time to create 1 rle with old method : 0.0031709671020507812 time for calcul the mask position with numpy : 0.022416114807128906 nb_pixel_total : 17220 time to create 1 rle with old method : 0.01758885383605957 time for calcul the mask position with numpy : 0.022670984268188477 nb_pixel_total : 44871 time to create 1 rle with old method : 0.045415639877319336 time for calcul the mask position with numpy : 0.022889137268066406 nb_pixel_total : 19490 time to create 1 rle with old method : 0.020049095153808594 time for calcul the mask position with numpy : 0.022267580032348633 nb_pixel_total : 5161 time to create 1 rle with old method : 0.005240201950073242 time for calcul the mask position with numpy : 0.02351069450378418 nb_pixel_total : 52636 time to create 1 rle with old method : 0.054839134216308594 time for calcul the mask position with numpy : 0.023434162139892578 nb_pixel_total : 18027 time to create 1 rle with old method : 0.018635272979736328 time for calcul the mask position with numpy : 0.02254939079284668 nb_pixel_total : 33594 time to create 1 rle with old method : 0.034143686294555664 time for calcul the mask position with numpy : 0.02288055419921875 nb_pixel_total : 21159 time to create 1 rle with old method : 0.021759986877441406 time for calcul the mask position with numpy : 0.022395610809326172 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005233287811279297 time for calcul the mask position with numpy : 0.023325443267822266 nb_pixel_total : 6329 time to create 1 rle with old method : 0.006484031677246094 time for calcul the mask position with numpy : 0.02375626564025879 nb_pixel_total : 21209 time to create 1 rle with old method : 0.02227950096130371 time for calcul the mask position with numpy : 0.022523164749145508 nb_pixel_total : 40353 time to create 1 rle with old method : 0.0412907600402832 time for calcul the mask position with numpy : 0.022702932357788086 nb_pixel_total : 16249 time to create 1 rle with old method : 0.01752305030822754 time for calcul the mask position with numpy : 0.022484779357910156 nb_pixel_total : 41843 time to create 1 rle with old method : 0.0422673225402832 time for calcul the mask position with numpy : 0.022607803344726562 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002872943878173828 time for calcul the mask position with numpy : 0.022716760635375977 nb_pixel_total : 20465 time to create 1 rle with old method : 0.020774126052856445 time for calcul the mask position with numpy : 0.02336597442626953 nb_pixel_total : 12110 time to create 1 rle with old method : 0.012436151504516602 time for calcul the mask position with numpy : 0.023153066635131836 nb_pixel_total : 49744 time to create 1 rle with old method : 0.04992532730102539 time for calcul the mask position with numpy : 0.023224830627441406 nb_pixel_total : 43745 time to create 1 rle with old method : 0.04609537124633789 time for calcul the mask position with numpy : 0.022657394409179688 nb_pixel_total : 41832 time to create 1 rle with old method : 0.04416799545288086 time for calcul the mask position with numpy : 0.022954940795898438 nb_pixel_total : 19958 time to create 1 rle with old method : 0.020555734634399414 time for calcul the mask position with numpy : 0.023052692413330078 nb_pixel_total : 14269 time to create 1 rle with old method : 0.015431404113769531 time for calcul the mask position with numpy : 0.02371048927307129 nb_pixel_total : 54605 time to create 1 rle with old method : 0.058341026306152344 time for calcul the mask position with numpy : 0.023133277893066406 nb_pixel_total : 28395 time to create 1 rle with old method : 0.0300290584564209 time for calcul the mask position with numpy : 0.023804903030395508 nb_pixel_total : 12012 time to create 1 rle with old method : 0.012844085693359375 time for calcul the mask position with numpy : 0.02330470085144043 nb_pixel_total : 769 time to create 1 rle with old method : 0.0010004043579101562 time for calcul the mask position with numpy : 0.024891138076782227 nb_pixel_total : 19778 time to create 1 rle with old method : 0.021055221557617188 time for calcul the mask position with numpy : 0.022927522659301758 nb_pixel_total : 4688 time to create 1 rle with old method : 0.005405902862548828 time for calcul the mask position with numpy : 0.022957324981689453 nb_pixel_total : 34588 time to create 1 rle with old method : 0.03585648536682129 time for calcul the mask position with numpy : 0.023000717163085938 nb_pixel_total : 22611 time to create 1 rle with old method : 0.02411961555480957 time for calcul the mask position with numpy : 0.023729801177978516 nb_pixel_total : 29058 time to create 1 rle with old method : 0.030705690383911133 time for calcul the mask position with numpy : 0.02327442169189453 nb_pixel_total : 9984 time to create 1 rle with old method : 0.010493278503417969 time for calcul the mask position with numpy : 0.023381948471069336 nb_pixel_total : 43178 time to create 1 rle with old method : 0.04513812065124512 time for calcul the mask position with numpy : 0.02301621437072754 nb_pixel_total : 14230 time to create 1 rle with old method : 0.014796733856201172 time for calcul the mask position with numpy : 0.02247166633605957 nb_pixel_total : 4945 time to create 1 rle with old method : 0.0054967403411865234 time for calcul the mask position with numpy : 0.0227506160736084 nb_pixel_total : 48483 time to create 1 rle with old method : 0.05181479454040527 time for calcul the mask position with numpy : 0.024487018585205078 nb_pixel_total : 5170 time to create 1 rle with old method : 0.005937337875366211 time for calcul the mask position with numpy : 0.024503707885742188 nb_pixel_total : 8849 time to create 1 rle with old method : 0.009952783584594727 time for calcul the mask position with numpy : 0.02455878257751465 nb_pixel_total : 26058 time to create 1 rle with old method : 0.029182910919189453 time for calcul the mask position with numpy : 0.02386021614074707 nb_pixel_total : 55 time to create 1 rle with old method : 0.00012731552124023438 time for calcul the mask position with numpy : 0.023610591888427734 nb_pixel_total : 32685 time to create 1 rle with old method : 0.03656172752380371 time for calcul the mask position with numpy : 0.023786544799804688 nb_pixel_total : 4461 time to create 1 rle with old method : 0.005166053771972656 time for calcul the mask position with numpy : 0.02412247657775879 nb_pixel_total : 28334 time to create 1 rle with old method : 0.030065536499023438 time for calcul the mask position with numpy : 0.023734569549560547 nb_pixel_total : 61596 time to create 1 rle with old method : 0.06381082534790039 time for calcul the mask position with numpy : 0.02412891387939453 nb_pixel_total : 7250 time to create 1 rle with old method : 0.007858514785766602 time for calcul the mask position with numpy : 0.02349543571472168 nb_pixel_total : 21204 time to create 1 rle with old method : 0.02213001251220703 time for calcul the mask position with numpy : 0.023161888122558594 nb_pixel_total : 1891 time to create 1 rle with old method : 0.0021827220916748047 create new chi : 9.507246494293213 time to delete rle : 0.004216670989990234 batch 1 Loaded 119 chid ids of type : 4855 Number RLEs to save : 50755 TO DO : save crop sub photo not yet done ! save time : 2.7757983207702637 nb_obj : 79 nb_hashtags : 10 time to prepare the origin masks : 26.180500030517578 time for calcul the mask position with numpy : 0.3637733459472656 nb_pixel_total : 2272745 time to create 1 rle with new method : 0.6393985748291016 time for calcul the mask position with numpy : 0.029778718948364258 nb_pixel_total : 114900 time to create 1 rle with old method : 0.12386918067932129 time for calcul the mask position with numpy : 0.024605274200439453 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0015180110931396484 time for calcul the mask position with numpy : 0.02450418472290039 nb_pixel_total : 7285 time to create 1 rle with old method : 0.008189916610717773 time for calcul the mask position with numpy : 0.024982690811157227 nb_pixel_total : 122177 time to create 1 rle with old method : 0.1324920654296875 time for calcul the mask position with numpy : 0.02527642250061035 nb_pixel_total : 97838 time to create 1 rle with old method : 0.10782313346862793 time for calcul the mask position with numpy : 0.024262428283691406 nb_pixel_total : 24515 time to create 1 rle with old method : 0.027086734771728516 time for calcul the mask position with numpy : 0.023649215698242188 nb_pixel_total : 1907 time to create 1 rle with old method : 0.002120494842529297 time for calcul the mask position with numpy : 0.024008750915527344 nb_pixel_total : 97 time to create 1 rle with old method : 0.00017976760864257812 time for calcul the mask position with numpy : 0.02460312843322754 nb_pixel_total : 29454 time to create 1 rle with old method : 0.0326387882232666 time for calcul the mask position with numpy : 0.0246429443359375 nb_pixel_total : 33405 time to create 1 rle with old method : 0.03733944892883301 time for calcul the mask position with numpy : 0.02467632293701172 nb_pixel_total : 22268 time to create 1 rle with old method : 0.024821758270263672 time for calcul the mask position with numpy : 0.024013996124267578 nb_pixel_total : 15582 time to create 1 rle with old method : 0.017073392868041992 time for calcul the mask position with numpy : 0.024181127548217773 nb_pixel_total : 133783 time to create 1 rle with old method : 0.17013168334960938 time for calcul the mask position with numpy : 0.023923873901367188 nb_pixel_total : 739 time to create 1 rle with old method : 0.0009331703186035156 time for calcul the mask position with numpy : 0.023526430130004883 nb_pixel_total : 18407 time to create 1 rle with old method : 0.019159555435180664 time for calcul the mask position with numpy : 0.02326226234436035 nb_pixel_total : 7471 time to create 1 rle with old method : 0.008709430694580078 time for calcul the mask position with numpy : 0.023473024368286133 nb_pixel_total : 63472 time to create 1 rle with old method : 0.06800389289855957 time for calcul the mask position with numpy : 0.024118900299072266 nb_pixel_total : 30344 time to create 1 rle with old method : 0.03236675262451172 time for calcul the mask position with numpy : 0.023773908615112305 nb_pixel_total : 446 time to create 1 rle with old method : 0.0005483627319335938 time for calcul the mask position with numpy : 0.02402043342590332 nb_pixel_total : 7210 time to create 1 rle with old method : 0.0077970027923583984 time for calcul the mask position with numpy : 0.024070024490356445 nb_pixel_total : 72511 time to create 1 rle with old method : 0.07828021049499512 time for calcul the mask position with numpy : 0.023926973342895508 nb_pixel_total : 3322 time to create 1 rle with old method : 0.003735065460205078 time for calcul the mask position with numpy : 0.023611068725585938 nb_pixel_total : 14558 time to create 1 rle with old method : 0.015476703643798828 time for calcul the mask position with numpy : 0.02304553985595703 nb_pixel_total : 17092 time to create 1 rle with old method : 0.017523527145385742 time for calcul the mask position with numpy : 0.022766828536987305 nb_pixel_total : 19324 time to create 1 rle with old method : 0.020267963409423828 time for calcul the mask position with numpy : 0.023540735244750977 nb_pixel_total : 30010 time to create 1 rle with old method : 0.032491207122802734 time for calcul the mask position with numpy : 0.023778438568115234 nb_pixel_total : 1902 time to create 1 rle with old method : 0.002460479736328125 time for calcul the mask position with numpy : 0.023655414581298828 nb_pixel_total : 12079 time to create 1 rle with old method : 0.013046026229858398 time for calcul the mask position with numpy : 0.02378249168395996 nb_pixel_total : 33827 time to create 1 rle with old method : 0.035669803619384766 time for calcul the mask position with numpy : 0.023076295852661133 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004324913024902344 time for calcul the mask position with numpy : 0.02248859405517578 nb_pixel_total : 13307 time to create 1 rle with old method : 0.013585567474365234 time for calcul the mask position with numpy : 0.022381067276000977 nb_pixel_total : 9237 time to create 1 rle with old method : 0.009505987167358398 time for calcul the mask position with numpy : 0.023215770721435547 nb_pixel_total : 75191 time to create 1 rle with old method : 0.08000397682189941 time for calcul the mask position with numpy : 0.022858858108520508 nb_pixel_total : 29673 time to create 1 rle with old method : 0.030670642852783203 time for calcul the mask position with numpy : 0.02405381202697754 nb_pixel_total : 29588 time to create 1 rle with old method : 0.03181195259094238 time for calcul the mask position with numpy : 0.03599071502685547 nb_pixel_total : 527962 time to create 1 rle with new method : 0.874382495880127 time for calcul the mask position with numpy : 0.023512840270996094 nb_pixel_total : 11512 time to create 1 rle with old method : 0.012320518493652344 time for calcul the mask position with numpy : 0.023726940155029297 nb_pixel_total : 44031 time to create 1 rle with old method : 0.04609107971191406 time for calcul the mask position with numpy : 0.02383875846862793 nb_pixel_total : 55256 time to create 1 rle with old method : 0.05795454978942871 time for calcul the mask position with numpy : 0.023749113082885742 nb_pixel_total : 88941 time to create 1 rle with old method : 0.10114216804504395 time for calcul the mask position with numpy : 0.02852916717529297 nb_pixel_total : 78306 time to create 1 rle with old method : 0.09533214569091797 time for calcul the mask position with numpy : 0.02421092987060547 nb_pixel_total : 26409 time to create 1 rle with old method : 0.02829432487487793 time for calcul the mask position with numpy : 0.027853012084960938 nb_pixel_total : 58657 time to create 1 rle with old method : 0.08215522766113281 time for calcul the mask position with numpy : 0.024227619171142578 nb_pixel_total : 2721 time to create 1 rle with old method : 0.003103494644165039 time for calcul the mask position with numpy : 0.02401423454284668 nb_pixel_total : 92721 time to create 1 rle with old method : 0.09850001335144043 time for calcul the mask position with numpy : 0.023796796798706055 nb_pixel_total : 11692 time to create 1 rle with old method : 0.012536287307739258 time for calcul the mask position with numpy : 0.02381753921508789 nb_pixel_total : 10558 time to create 1 rle with old method : 0.011551380157470703 time for calcul the mask position with numpy : 0.023790836334228516 nb_pixel_total : 12243 time to create 1 rle with old method : 0.013284683227539062 time for calcul the mask position with numpy : 0.02431178092956543 nb_pixel_total : 90199 time to create 1 rle with old method : 0.11315536499023438 time for calcul the mask position with numpy : 0.024560928344726562 nb_pixel_total : 8575 time to create 1 rle with old method : 0.009634256362915039 time for calcul the mask position with numpy : 0.02402353286743164 nb_pixel_total : 1754 time to create 1 rle with old method : 0.0020914077758789062 time for calcul the mask position with numpy : 0.023842573165893555 nb_pixel_total : 28873 time to create 1 rle with old method : 0.03101205825805664 time for calcul the mask position with numpy : 0.02391529083251953 nb_pixel_total : 97 time to create 1 rle with old method : 0.00035190582275390625 time for calcul the mask position with numpy : 0.024204254150390625 nb_pixel_total : 38768 time to create 1 rle with old method : 0.042810678482055664 time for calcul the mask position with numpy : 0.026455163955688477 nb_pixel_total : 197240 time to create 1 rle with new method : 0.520653486251831 time for calcul the mask position with numpy : 0.03079962730407715 nb_pixel_total : 716157 time to create 1 rle with new method : 0.38314175605773926 time for calcul the mask position with numpy : 0.023349761962890625 nb_pixel_total : 12294 time to create 1 rle with old method : 0.013488054275512695 time for calcul the mask position with numpy : 0.02418804168701172 nb_pixel_total : 76402 time to create 1 rle with old method : 0.08295893669128418 time for calcul the mask position with numpy : 0.023906707763671875 nb_pixel_total : 8029 time to create 1 rle with old method : 0.008600950241088867 time for calcul the mask position with numpy : 0.02361321449279785 nb_pixel_total : 23528 time to create 1 rle with old method : 0.025884151458740234 time for calcul the mask position with numpy : 0.024942636489868164 nb_pixel_total : 11002 time to create 1 rle with old method : 0.012415170669555664 time for calcul the mask position with numpy : 0.026084423065185547 nb_pixel_total : 7068 time to create 1 rle with old method : 0.02575397491455078 time for calcul the mask position with numpy : 0.08750438690185547 nb_pixel_total : 1385 time to create 1 rle with old method : 0.0025632381439208984 time for calcul the mask position with numpy : 0.03618597984313965 nb_pixel_total : 13294 time to create 1 rle with old method : 0.017786026000976562 time for calcul the mask position with numpy : 0.02541947364807129 nb_pixel_total : 63135 time to create 1 rle with old method : 0.09299015998840332 time for calcul the mask position with numpy : 0.02506089210510254 nb_pixel_total : 4251 time to create 1 rle with old method : 0.005240440368652344 time for calcul the mask position with numpy : 0.024997711181640625 nb_pixel_total : 18485 time to create 1 rle with old method : 0.02083134651184082 time for calcul the mask position with numpy : 0.02500009536743164 nb_pixel_total : 1254 time to create 1 rle with old method : 0.0016663074493408203 time for calcul the mask position with numpy : 0.02545022964477539 nb_pixel_total : 25850 time to create 1 rle with old method : 0.028900861740112305 time for calcul the mask position with numpy : 0.024964332580566406 nb_pixel_total : 32616 time to create 1 rle with old method : 0.03628039360046387 time for calcul the mask position with numpy : 0.027605056762695312 nb_pixel_total : 20225 time to create 1 rle with old method : 0.022948026657104492 time for calcul the mask position with numpy : 0.02804088592529297 nb_pixel_total : 9062 time to create 1 rle with old method : 0.010461807250976562 time for calcul the mask position with numpy : 0.02826666831970215 nb_pixel_total : 8132 time to create 1 rle with old method : 0.00922536849975586 time for calcul the mask position with numpy : 0.024831533432006836 nb_pixel_total : 6930 time to create 1 rle with old method : 0.0077822208404541016 time for calcul the mask position with numpy : 0.025075197219848633 nb_pixel_total : 75324 time to create 1 rle with old method : 0.08720874786376953 time for calcul the mask position with numpy : 0.025109052658081055 nb_pixel_total : 42241 time to create 1 rle with old method : 0.04937887191772461 time for calcul the mask position with numpy : 0.025061368942260742 nb_pixel_total : 27855 time to create 1 rle with old method : 0.03181338310241699 time for calcul the mask position with numpy : 0.024883031845092773 nb_pixel_total : 17332 time to create 1 rle with old method : 0.019454240798950195 time for calcul the mask position with numpy : 0.02516007423400879 nb_pixel_total : 17130 time to create 1 rle with old method : 0.01916646957397461 create new chi : 7.498950481414795 time to delete rle : 0.0032863616943359375 batch 1 Loaded 80 chid ids of type : 4855 Number RLEs to save : 35788 TO DO : save crop sub photo not yet done ! save time : 2.0496134757995605 nb_obj : 17 nb_hashtags : 7 time to prepare the origin masks : 25.780377626419067 time for calcul the mask position with numpy : 0.05344104766845703 nb_pixel_total : 565518 time to create 1 rle with new method : 1.1299967765808105 time for calcul the mask position with numpy : 0.04643082618713379 nb_pixel_total : 4872 time to create 1 rle with old method : 0.005347013473510742 time for calcul the mask position with numpy : 0.028122901916503906 nb_pixel_total : 128 time to create 1 rle with old method : 0.00022602081298828125 time for calcul the mask position with numpy : 0.028929948806762695 nb_pixel_total : 54235 time to create 1 rle with old method : 0.06377458572387695 time for calcul the mask position with numpy : 0.03231549263000488 nb_pixel_total : 5721 time to create 1 rle with old method : 0.00954747200012207 time for calcul the mask position with numpy : 0.03242683410644531 nb_pixel_total : 4780 time to create 1 rle with old method : 0.005442380905151367 time for calcul the mask position with numpy : 0.029790639877319336 nb_pixel_total : 3375 time to create 1 rle with old method : 0.003762483596801758 time for calcul the mask position with numpy : 0.1413710117340088 nb_pixel_total : 3008843 time to create 1 rle with new method : 0.8599166870117188 time for calcul the mask position with numpy : 0.03070068359375 nb_pixel_total : 56086 time to create 1 rle with old method : 0.061354637145996094 time for calcul the mask position with numpy : 0.03909873962402344 nb_pixel_total : 859013 time to create 1 rle with new method : 0.7062804698944092 time for calcul the mask position with numpy : 0.029314041137695312 nb_pixel_total : 28836 time to create 1 rle with old method : 0.030759334564208984 time for calcul the mask position with numpy : 0.029986858367919922 nb_pixel_total : 222798 time to create 1 rle with new method : 0.5349280834197998 time for calcul the mask position with numpy : 0.02960801124572754 nb_pixel_total : 16554 time to create 1 rle with old method : 0.017796039581298828 time for calcul the mask position with numpy : 0.030504941940307617 nb_pixel_total : 87631 time to create 1 rle with old method : 0.09590768814086914 time for calcul the mask position with numpy : 0.030344009399414062 nb_pixel_total : 21310 time to create 1 rle with old method : 0.023830652236938477 time for calcul the mask position with numpy : 0.029722929000854492 nb_pixel_total : 102496 time to create 1 rle with old method : 0.10825872421264648 time for calcul the mask position with numpy : 0.03348231315612793 nb_pixel_total : 647958 time to create 1 rle with new method : 0.7165317535400391 time for calcul the mask position with numpy : 0.30350518226623535 nb_pixel_total : 4044246 time to create 1 rle with new method : 0.5790355205535889 create new chi : 6.142780780792236 time to delete rle : 0.002488851547241211 batch 1 Loaded 18 chid ids of type : 4855 Number RLEs to save : 29149 TO DO : save crop sub photo not yet done ! save time : 1.5645110607147217 map_output_result : {1379966997: (0.4059430784427122, 'Should be the crop_list due to order', 0.4901129426437694), 1379966995: (0.4059430784427122, 'Should be the crop_list due to order', 0.2613617724718831), 1379966990: (0.4059430784427122, 'Should be the crop_list due to order', 0.12845734419971935), 1379966986: (0.4059430784427122, 'Should be the crop_list due to order', 0.7438402544554771)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379966997, 1379966995, 1379966990, 1379966986] Looping around the photos to save general results len do output : 4 /1379966997.Didn't retrieve data . /1379966995.Didn't retrieve data . /1379966990.Didn't retrieve data . /1379966986.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966997', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966995', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966990', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966986', None, None, None, None, None, '3628597') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012081146240234375 save_final save missing photos in datou_result : time spend for datou_step_exec : 143.28333139419556 time spend to save output : 0.012463092803955078 total time spend for step 5 : 143.2957944869995 step6:crop_condition Thu Aug 28 23:06:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 325 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3015255 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415177_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 31 photos in the portfolio 3015255 time of upload the photos Elapsed time : 8.267378091812134 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 57 About to insert : list_path_to_insert length 57 new photo from crops ! About to upload 57 photos upload in portfolio : 3015255 init cache_photo without model_param we have 57 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415198_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 57 photos in the portfolio 3015255 time of upload the photos Elapsed time : 14.215939283370972 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3015255 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415216_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 36 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.932697296142578 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3015255 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415229_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.6444220542907715 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3015255 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415236_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.805894374847412 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415238_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5518069267272949 we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3015255 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415241_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.6555771827697754 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3015255 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415246_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.149383783340454 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3015255 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415261_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 22 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.7580931186676025 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3015255 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415271_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.034674644470215 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 49 About to insert : list_path_to_insert length 49 new photo from crops ! About to upload 49 photos upload in portfolio : 3015255 init cache_photo without model_param we have 49 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756415354_835981 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 49 photos in the portfolio 3015255 time of upload the photos Elapsed time : 13.359171628952026 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379966997, 1379966995, 1379966990, 1379966986] Looping around the photos to save general results len do output : 245 /1379982249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379982948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379983539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379984077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966997', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966995', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966990', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966986', None, None, None, None, None, '3628597') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 739 time used for this insertion : 0.06339788436889648 save_final save missing photos in datou_result : time spend for datou_step_exec : 205.52594542503357 time spend to save output : 0.07448482513427734 total time spend for step 6 : 205.60043025016785 step7:ventilate_hashtags_in_portfolio Thu Aug 28 23:09:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26307203 get user id for portfolio 26307203 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26307203 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26307203 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26307203 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26307203 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/26308993,26308994,26308995,26308996,26308997,26309002,26309004,26309005,26309006,26309007,26309008,26309009,26309011,26309012,26309013,26309014,26309015,26309016,26309017,26309018?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26307203 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379966997, 1379966995, 1379966990, 1379966986] Looping around the photos to save general results len do output : 1 /26307203. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966997', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966995', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966990', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966986', None, None, None, None, None, '3628597') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.014403343200683594 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.871076345443726 time spend to save output : 0.01460576057434082 total time spend for step 7 : 4.885682106018066 step8:final Thu Aug 28 23:09:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379966997: ('0.2938870389409992',), 1379966995: ('0.2938870389409992',), 1379966990: ('0.2938870389409992',), 1379966986: ('0.2938870389409992',)} new output for save of step final : {1379966997: ('0.2938870389409992',), 1379966995: ('0.2938870389409992',), 1379966990: ('0.2938870389409992',), 1379966986: ('0.2938870389409992',)} [1379966997, 1379966995, 1379966990, 1379966986] Looping around the photos to save general results len do output : 4 /1379966997.Didn't retrieve data . /1379966995.Didn't retrieve data . /1379966990.Didn't retrieve data . /1379966986.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966997', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966995', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966990', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966986', None, None, None, None, None, '3628597') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012701034545898438 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1556870937347412 time spend to save output : 0.013293027877807617 total time spend for step 8 : 0.16898012161254883 step9:velours_tree Thu Aug 28 23:09:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.24554729461669922 time spend to save output : 4.649162292480469e-05 total time spend for step 9 : 0.24559378623962402 step10:send_mail_cod Thu Aug 28 23:09:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26307203_28-08-2025_23_09_34.pdf 26308967 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263089671756415374 26308968 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263089681756415375 26308969 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263089691756415377 26308970 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263089701756415378 26308971 change filename to text .change filename to text .change filename to text .imagette263089711756415379 26308972 change filename to text .imagette263089721756415379 26308973 imagette263089731756415379 26308974 imagette263089741756415379 26308975 imagette263089751756415379 26308976 imagette263089761756415379 26308977 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263089771756415379 26308978 change filename to text .change filename to text .change filename to text .imagette263089781756415380 26308979 imagette263089791756415385 26308980 imagette263089801756415385 26308981 imagette263089811756415385 26308982 imagette263089821756415385 26308983 imagette263089831756415385 26308984 imagette263089841756415385 26308985 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263089851756415385 26308987 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263089871756415386 26308988 imagette263089881756415387 26308989 imagette263089891756415387 26308990 imagette263089901756415387 26308991 imagette263089911756415387 26308992 imagette263089921756415387 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26307203 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26308993,26308994,26308995,26308996,26308997,26309002,26309004,26309005,26309006,26309007,26309008,26309009,26309011,26309012,26309013,26309014,26309015,26309016,26309017,26309018?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26307203 your option no_mail is active, we will not send the real mail to your client args[1379966997] : ((1379966997, 1426.4929216994701, 2107751945), (1379966997, -0.4509155035878289, 496442774), '0.2938870389409992') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379966995] : ((1379966995, 791.9150299046787, 492688767), (1379966995, -0.30794528265731663, 496442774), '0.2938870389409992') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379966990] : ((1379966990, 1506.3588605871525, 2107751945), (1379966990, -0.10147682830038983, 496442774), '0.2938870389409992') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379966986] : ((1379966986, 192.290533888585, 492688767), (1379966986, -0.37412511411182126, 496442774), '0.2938870389409992') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.2938870389409992 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26307203_28-08-2025_23_09_34.pdf results_Auto_P26307203_28-08-2025_23_09_34.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26307203_28-08-2025_23_09_34.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','26307203','results_Auto_P26307203_28-08-2025_23_09_34.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26307203_28-08-2025_23_09_34.pdf','pdf','','0.97','0.2938870389409992') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379966997, 1379966995, 1379966990, 1379966986] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966997', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966995', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966990', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966986', None, None, None, None, None, '3628597') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012913703918457031 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.398804426193237 time spend to save output : 0.01314854621887207 total time spend for step 10 : 15.41195297241211 step11:split_time_score Thu Aug 28 23:09:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('59', 1), ('00', 3)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28082025 26307203 Nombre de photos uploadées : 4 / 23040 (0%) 28082025 26307203 Nombre de photos taguées (types de déchets): 0 / 4 (0%) 28082025 26307203 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.0002765655517578125 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21988320350646973 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2808311243033833 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292108_28-08-2025_13_56_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292108 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292108 AND mptpi.`type`=4855 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292109 order by id desc limit 1 Qualite : 0.3235829256287251 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292110_28-08-2025_13_18_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292110 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292110 AND mptpi.`type`=4855 To do Qualite : 0.5794230840386216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292111_28-08-2025_13_42_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292111 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292111 AND mptpi.`type`=4855 To do Qualite : 0.548860349869327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292112_28-08-2025_13_04_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292112 AND mptpi.`type`=4855 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26294096 order by id desc limit 1 Qualite : 0.2938870389409992 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26307203_28-08-2025_23_09_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26307203 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26307203 AND mptpi.`type`=4855 To do Qualite : 0.39387006977059996 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26307204_28-08-2025_22_48_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26307204 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26307204 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28082025': {'nb_upload': 4, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379966997, 1379966995, 1379966990, 1379966986] Looping around the photos to save general results len do output : 1 /26307203Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966997', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966995', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966990', None, None, None, None, None, '3628597') ('4741', None, None, None, None, None, None, None, '3628597') ('4741', '26307203', '1379966986', None, None, None, None, None, '3628597') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.01595902442932129 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.7001607418060303 time spend to save output : 0.016184568405151367 total time spend for step 11 : 2.7163453102111816 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 306.63user 118.10system 8:26.98elapsed 83%CPU (0avgtext+0avgdata 5311232maxresident)k 1154160inputs+295592outputs (11863major+18573069minor)pagefaults 0swaps