python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1976647 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4741, datou_cur_ids : ['3709895'] with mtr_portfolio_ids : ['26763392'] and first list_photo_ids : [] new path : /proc/1976647/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : {} origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 1.72855806350708 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Sep 12 10:41:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10368 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-12 10:41:34.578437: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-12 10:41:34.612475: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-12 10:41:34.614704: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3018000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-12 10:41:34.614750: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-12 10:41:34.620466: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-12 10:41:34.779872: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x28f0e6e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-12 10:41:34.779907: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-12 10:41:34.781649: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 10:41:34.781973: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 10:41:34.784054: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 10:41:34.804491: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 10:41:34.805012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 10:41:34.843790: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 10:41:34.848405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 10:41:34.907745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 10:41:34.909227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 10:41:34.909738: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 10:41:34.910506: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-12 10:41:34.910522: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-12 10:41:34.910531: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-12 10:41:34.912180: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9603 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-12 10:41:35.225216: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 10:41:35.225295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 10:41:35.225316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 10:41:35.225335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 10:41:35.225352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 10:41:35.225370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 10:41:35.225387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 10:41:35.225405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 10:41:35.226973: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 10:41:35.228373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 10:41:35.228423: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 10:41:35.228445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 10:41:35.228465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 10:41:35.228497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 10:41:35.228518: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 10:41:35.228537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 10:41:35.228557: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 10:41:35.230125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 10:41:35.230159: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-12 10:41:35.230169: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-12 10:41:35.230179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-12 10:41:35.231795: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9603 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-12 10:41:47.005224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 10:41:47.194726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 1977033 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5079 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10368 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.018914222717285156 nb_pixel_total : 419394 time to create 1 rle with new method : 0.06078815460205078 length of segment : 620 time for calcul the mask position with numpy : 0.006439685821533203 nb_pixel_total : 418520 time to create 1 rle with new method : 0.02362346649169922 length of segment : 657 time for calcul the mask position with numpy : 0.00112152099609375 nb_pixel_total : 52452 time to create 1 rle with old method : 0.0590357780456543 length of segment : 372 time for calcul the mask position with numpy : 0.0014183521270751953 nb_pixel_total : 63155 time to create 1 rle with old method : 0.07196450233459473 length of segment : 245 time for calcul the mask position with numpy : 0.0016977787017822266 nb_pixel_total : 69248 time to create 1 rle with old method : 0.07686448097229004 length of segment : 566 time for calcul the mask position with numpy : 0.007539987564086914 nb_pixel_total : 165324 time to create 1 rle with new method : 0.04729485511779785 length of segment : 1015 time for calcul the mask position with numpy : 0.0011816024780273438 nb_pixel_total : 43525 time to create 1 rle with old method : 0.05078005790710449 length of segment : 460 time for calcul the mask position with numpy : 0.008411169052124023 nb_pixel_total : 302072 time to create 1 rle with new method : 0.2692885398864746 length of segment : 896 time for calcul the mask position with numpy : 0.0009520053863525391 nb_pixel_total : 27127 time to create 1 rle with old method : 0.02960944175720215 length of segment : 215 time for calcul the mask position with numpy : 0.0014009475708007812 nb_pixel_total : 43108 time to create 1 rle with old method : 0.04646658897399902 length of segment : 354 time for calcul the mask position with numpy : 0.0012362003326416016 nb_pixel_total : 38907 time to create 1 rle with old method : 0.041515350341796875 length of segment : 361 time for calcul the mask position with numpy : 0.0008718967437744141 nb_pixel_total : 11198 time to create 1 rle with old method : 0.01259160041809082 length of segment : 106 time for calcul the mask position with numpy : 0.0006518363952636719 nb_pixel_total : 16459 time to create 1 rle with old method : 0.0182802677154541 length of segment : 134 time for calcul the mask position with numpy : 0.0008966922760009766 nb_pixel_total : 24096 time to create 1 rle with old method : 0.026732921600341797 length of segment : 187 time for calcul the mask position with numpy : 0.0008180141448974609 nb_pixel_total : 26797 time to create 1 rle with old method : 0.029516220092773438 length of segment : 150 time for calcul the mask position with numpy : 0.0007326602935791016 nb_pixel_total : 21476 time to create 1 rle with old method : 0.02461409568786621 length of segment : 133 time for calcul the mask position with numpy : 0.0026175975799560547 nb_pixel_total : 63453 time to create 1 rle with old method : 0.07166028022766113 length of segment : 383 time for calcul the mask position with numpy : 0.0013988018035888672 nb_pixel_total : 42835 time to create 1 rle with old method : 0.04559135437011719 length of segment : 206 time for calcul the mask position with numpy : 0.002429485321044922 nb_pixel_total : 96380 time to create 1 rle with old method : 0.10452914237976074 length of segment : 419 time for calcul the mask position with numpy : 0.0008807182312011719 nb_pixel_total : 18995 time to create 1 rle with old method : 0.02110147476196289 length of segment : 207 time for calcul the mask position with numpy : 0.00028204917907714844 nb_pixel_total : 6522 time to create 1 rle with old method : 0.007478952407836914 length of segment : 131 time for calcul the mask position with numpy : 0.0048940181732177734 nb_pixel_total : 145602 time to create 1 rle with old method : 0.1566905975341797 length of segment : 626 time for calcul the mask position with numpy : 0.0006263256072998047 nb_pixel_total : 20378 time to create 1 rle with old method : 0.022732019424438477 length of segment : 98 time for calcul the mask position with numpy : 0.0007901191711425781 nb_pixel_total : 14487 time to create 1 rle with old method : 0.020978689193725586 length of segment : 135 time for calcul the mask position with numpy : 0.002620220184326172 nb_pixel_total : 126990 time to create 1 rle with old method : 0.1460721492767334 length of segment : 411 time for calcul the mask position with numpy : 0.0013816356658935547 nb_pixel_total : 47079 time to create 1 rle with old method : 0.05303239822387695 length of segment : 355 time for calcul the mask position with numpy : 0.002018451690673828 nb_pixel_total : 73413 time to create 1 rle with old method : 0.08081507682800293 length of segment : 479 time for calcul the mask position with numpy : 0.0017807483673095703 nb_pixel_total : 67827 time to create 1 rle with old method : 0.07768487930297852 length of segment : 425 time for calcul the mask position with numpy : 0.0018663406372070312 nb_pixel_total : 52197 time to create 1 rle with old method : 0.056369781494140625 length of segment : 478 time for calcul the mask position with numpy : 0.0018506050109863281 nb_pixel_total : 91504 time to create 1 rle with old method : 0.09920310974121094 length of segment : 655 time for calcul the mask position with numpy : 0.001961231231689453 nb_pixel_total : 88010 time to create 1 rle with old method : 0.10170674324035645 length of segment : 399 time for calcul the mask position with numpy : 0.005644798278808594 nb_pixel_total : 248130 time to create 1 rle with new method : 0.021500587463378906 length of segment : 907 time for calcul the mask position with numpy : 0.025353670120239258 nb_pixel_total : 510650 time to create 1 rle with new method : 0.0442807674407959 length of segment : 886 time for calcul the mask position with numpy : 0.005199909210205078 nb_pixel_total : 273125 time to create 1 rle with new method : 0.010954141616821289 length of segment : 1000 time for calcul the mask position with numpy : 0.0027141571044921875 nb_pixel_total : 137806 time to create 1 rle with old method : 0.14983797073364258 length of segment : 448 time for calcul the mask position with numpy : 0.0008261203765869141 nb_pixel_total : 42967 time to create 1 rle with old method : 0.049091339111328125 length of segment : 96 time for calcul the mask position with numpy : 0.001173257827758789 nb_pixel_total : 55165 time to create 1 rle with old method : 0.061000823974609375 length of segment : 219 time for calcul the mask position with numpy : 0.029181480407714844 nb_pixel_total : 748053 time to create 1 rle with new method : 0.20987796783447266 length of segment : 1263 time for calcul the mask position with numpy : 0.00041675567626953125 nb_pixel_total : 13323 time to create 1 rle with old method : 0.014379024505615234 length of segment : 213 time for calcul the mask position with numpy : 0.0004324913024902344 nb_pixel_total : 15554 time to create 1 rle with old method : 0.01703643798828125 length of segment : 239 time for calcul the mask position with numpy : 0.020720958709716797 nb_pixel_total : 764155 time to create 1 rle with new method : 0.08189558982849121 length of segment : 1270 time for calcul the mask position with numpy : 0.006325244903564453 nb_pixel_total : 304309 time to create 1 rle with new method : 0.010027170181274414 length of segment : 913 time for calcul the mask position with numpy : 0.001538991928100586 nb_pixel_total : 73516 time to create 1 rle with old method : 0.07880759239196777 length of segment : 240 time for calcul the mask position with numpy : 0.0007905960083007812 nb_pixel_total : 27493 time to create 1 rle with old method : 0.029822111129760742 length of segment : 312 time for calcul the mask position with numpy : 0.012953758239746094 nb_pixel_total : 738462 time to create 1 rle with new method : 0.09778475761413574 length of segment : 1251 time for calcul the mask position with numpy : 0.003373384475708008 nb_pixel_total : 125862 time to create 1 rle with old method : 0.14290595054626465 length of segment : 371 time for calcul the mask position with numpy : 0.0038225650787353516 nb_pixel_total : 238910 time to create 1 rle with new method : 0.006042003631591797 length of segment : 610 time for calcul the mask position with numpy : 0.0026273727416992188 nb_pixel_total : 147606 time to create 1 rle with old method : 0.1643075942993164 length of segment : 734 time for calcul the mask position with numpy : 0.014615774154663086 nb_pixel_total : 529141 time to create 1 rle with new method : 0.2704000473022461 length of segment : 1518 time for calcul the mask position with numpy : 0.0015711784362792969 nb_pixel_total : 82130 time to create 1 rle with old method : 0.08888769149780273 length of segment : 514 time for calcul the mask position with numpy : 0.0008714199066162109 nb_pixel_total : 34196 time to create 1 rle with old method : 0.054958343505859375 length of segment : 336 time for calcul the mask position with numpy : 0.0003578662872314453 nb_pixel_total : 9367 time to create 1 rle with old method : 0.010555505752563477 length of segment : 134 time for calcul the mask position with numpy : 0.047276973724365234 nb_pixel_total : 1144414 time to create 1 rle with new method : 0.14249920845031738 length of segment : 2203 time for calcul the mask position with numpy : 0.4644947052001953 nb_pixel_total : 5694490 time to create 1 rle with new method : 0.7465248107910156 length of segment : 4967 time for calcul the mask position with numpy : 0.11330771446228027 nb_pixel_total : 2825059 time to create 1 rle with new method : 0.1650712490081787 length of segment : 1214 time for calcul the mask position with numpy : 0.01365041732788086 nb_pixel_total : 487056 time to create 1 rle with new method : 0.10758066177368164 length of segment : 1012 time for calcul the mask position with numpy : 0.01609945297241211 nb_pixel_total : 799266 time to create 1 rle with new method : 0.10310244560241699 length of segment : 620 time spent for convertir_results : 13.334978103637695 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 57 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 55.18884015083313 time spend to save output : 0.1074221134185791 total time spend for step 1 : 55.29626226425171 step2:mask_detect Fri Sep 12 10:42:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10368 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-12 10:42:28.568467: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-12 10:42:28.576152: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-12 10:42:28.577685: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f301c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-12 10:42:28.577724: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-12 10:42:28.580076: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-12 10:42:28.716723: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x29d88e60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-12 10:42:28.716769: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-12 10:42:28.717938: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 10:42:28.718785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 10:42:28.722575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 10:42:28.724845: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 10:42:28.726682: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 10:42:28.729408: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 10:42:28.730749: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 10:42:28.736153: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 10:42:28.737838: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 10:42:28.737939: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 10:42:28.738692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-12 10:42:28.738707: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-12 10:42:28.738715: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-12 10:42:28.740096: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9603 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-12 10:42:28.869605: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 10:42:28.869693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 10:42:28.869717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 10:42:28.869738: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 10:42:28.869758: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 10:42:28.869779: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 10:42:28.869799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 10:42:28.869819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 10:42:28.871386: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 10:42:28.872697: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 10:42:28.872741: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 10:42:28.872766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 10:42:28.872789: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 10:42:28.872811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 10:42:28.872833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 10:42:28.872855: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 10:42:28.872878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 10:42:28.874426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 10:42:28.874456: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-12 10:42:28.874466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-12 10:42:28.874488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-12 10:42:28.876094: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9603 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-12 10:42:42.066004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 10:42:42.238453: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 59 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 59 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1979347 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5079 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10368 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0034651756286621094 nb_pixel_total : 123666 time to create 1 rle with old method : 0.14021039009094238 length of segment : 605 time for calcul the mask position with numpy : 0.005231618881225586 nb_pixel_total : 256896 time to create 1 rle with new method : 0.015771865844726562 length of segment : 756 time for calcul the mask position with numpy : 0.0015943050384521484 nb_pixel_total : 71752 time to create 1 rle with old method : 0.08088874816894531 length of segment : 254 time for calcul the mask position with numpy : 0.0011458396911621094 nb_pixel_total : 60059 time to create 1 rle with old method : 0.07125687599182129 length of segment : 260 time for calcul the mask position with numpy : 0.011945486068725586 nb_pixel_total : 574637 time to create 1 rle with new method : 0.04952716827392578 length of segment : 737 time for calcul the mask position with numpy : 0.003142118453979492 nb_pixel_total : 139387 time to create 1 rle with old method : 0.16056370735168457 length of segment : 445 time for calcul the mask position with numpy : 0.006445407867431641 nb_pixel_total : 171280 time to create 1 rle with new method : 0.02072286605834961 length of segment : 570 time for calcul the mask position with numpy : 0.001062154769897461 nb_pixel_total : 29334 time to create 1 rle with old method : 0.03812694549560547 length of segment : 176 time for calcul the mask position with numpy : 0.0034029483795166016 nb_pixel_total : 148657 time to create 1 rle with old method : 0.17145085334777832 length of segment : 402 time for calcul the mask position with numpy : 0.0007126331329345703 nb_pixel_total : 30190 time to create 1 rle with old method : 0.035692453384399414 length of segment : 233 time for calcul the mask position with numpy : 0.0007414817810058594 nb_pixel_total : 44311 time to create 1 rle with old method : 0.0498356819152832 length of segment : 336 time for calcul the mask position with numpy : 0.0007412433624267578 nb_pixel_total : 24865 time to create 1 rle with old method : 0.027302980422973633 length of segment : 264 time for calcul the mask position with numpy : 0.0013387203216552734 nb_pixel_total : 62437 time to create 1 rle with old method : 0.07086515426635742 length of segment : 233 time for calcul the mask position with numpy : 0.0010182857513427734 nb_pixel_total : 49709 time to create 1 rle with old method : 0.056589365005493164 length of segment : 229 time for calcul the mask position with numpy : 0.0010509490966796875 nb_pixel_total : 51296 time to create 1 rle with old method : 0.05782747268676758 length of segment : 251 time for calcul the mask position with numpy : 0.0008683204650878906 nb_pixel_total : 21351 time to create 1 rle with old method : 0.024979114532470703 length of segment : 173 time for calcul the mask position with numpy : 0.0009016990661621094 nb_pixel_total : 35932 time to create 1 rle with old method : 0.04053449630737305 length of segment : 321 time for calcul the mask position with numpy : 0.0004839897155761719 nb_pixel_total : 5011 time to create 1 rle with old method : 0.006103515625 length of segment : 128 time for calcul the mask position with numpy : 0.0009508132934570312 nb_pixel_total : 32194 time to create 1 rle with old method : 0.03594541549682617 length of segment : 219 time for calcul the mask position with numpy : 0.005898237228393555 nb_pixel_total : 293898 time to create 1 rle with new method : 0.016701698303222656 length of segment : 577 time for calcul the mask position with numpy : 0.001096487045288086 nb_pixel_total : 44596 time to create 1 rle with old method : 0.04973196983337402 length of segment : 252 time for calcul the mask position with numpy : 0.0010862350463867188 nb_pixel_total : 46176 time to create 1 rle with old method : 0.051123857498168945 length of segment : 199 time for calcul the mask position with numpy : 0.0008392333984375 nb_pixel_total : 27173 time to create 1 rle with old method : 0.031038999557495117 length of segment : 183 time for calcul the mask position with numpy : 0.00118255615234375 nb_pixel_total : 47742 time to create 1 rle with old method : 0.05482316017150879 length of segment : 208 time for calcul the mask position with numpy : 0.0011115074157714844 nb_pixel_total : 55816 time to create 1 rle with old method : 0.06254196166992188 length of segment : 281 time for calcul the mask position with numpy : 0.0031409263610839844 nb_pixel_total : 124513 time to create 1 rle with old method : 0.14728927612304688 length of segment : 330 time for calcul the mask position with numpy : 0.0011723041534423828 nb_pixel_total : 37921 time to create 1 rle with old method : 0.042900800704956055 length of segment : 288 time for calcul the mask position with numpy : 0.009388208389282227 nb_pixel_total : 408031 time to create 1 rle with new method : 0.02691650390625 length of segment : 1080 time for calcul the mask position with numpy : 0.004182100296020508 nb_pixel_total : 179359 time to create 1 rle with new method : 0.013849020004272461 length of segment : 520 time for calcul the mask position with numpy : 0.030221939086914062 nb_pixel_total : 1198226 time to create 1 rle with new method : 0.13636994361877441 length of segment : 1646 time for calcul the mask position with numpy : 0.008846759796142578 nb_pixel_total : 210247 time to create 1 rle with new method : 0.02289867401123047 length of segment : 653 time for calcul the mask position with numpy : 0.00040435791015625 nb_pixel_total : 13328 time to create 1 rle with old method : 0.017275333404541016 length of segment : 118 time for calcul the mask position with numpy : 0.0026121139526367188 nb_pixel_total : 61097 time to create 1 rle with old method : 0.07958126068115234 length of segment : 224 time for calcul the mask position with numpy : 0.000881195068359375 nb_pixel_total : 23872 time to create 1 rle with old method : 0.03174853324890137 length of segment : 196 time for calcul the mask position with numpy : 0.003217458724975586 nb_pixel_total : 103659 time to create 1 rle with old method : 0.11827373504638672 length of segment : 390 time for calcul the mask position with numpy : 0.008585453033447266 nb_pixel_total : 354049 time to create 1 rle with new method : 0.022190093994140625 length of segment : 647 time for calcul the mask position with numpy : 0.001211404800415039 nb_pixel_total : 58607 time to create 1 rle with old method : 0.07121729850769043 length of segment : 226 time for calcul the mask position with numpy : 0.0018301010131835938 nb_pixel_total : 82696 time to create 1 rle with old method : 0.09079957008361816 length of segment : 401 time for calcul the mask position with numpy : 0.0002868175506591797 nb_pixel_total : 4974 time to create 1 rle with old method : 0.006159782409667969 length of segment : 98 time for calcul the mask position with numpy : 0.0006301403045654297 nb_pixel_total : 20893 time to create 1 rle with old method : 0.024093151092529297 length of segment : 202 time for calcul the mask position with numpy : 0.007530927658081055 nb_pixel_total : 372528 time to create 1 rle with new method : 0.022582054138183594 length of segment : 642 time for calcul the mask position with numpy : 0.012094259262084961 nb_pixel_total : 681106 time to create 1 rle with new method : 0.27785253524780273 length of segment : 1141 time for calcul the mask position with numpy : 0.007232189178466797 nb_pixel_total : 353307 time to create 1 rle with new method : 0.020499706268310547 length of segment : 908 time for calcul the mask position with numpy : 0.0019266605377197266 nb_pixel_total : 80999 time to create 1 rle with old method : 0.09065365791320801 length of segment : 641 time for calcul the mask position with numpy : 0.0011157989501953125 nb_pixel_total : 54910 time to create 1 rle with old method : 0.06343722343444824 length of segment : 245 time for calcul the mask position with numpy : 0.005004405975341797 nb_pixel_total : 192082 time to create 1 rle with new method : 0.014367818832397461 length of segment : 546 time for calcul the mask position with numpy : 0.0007600784301757812 nb_pixel_total : 42741 time to create 1 rle with old method : 0.04824566841125488 length of segment : 200 time for calcul the mask position with numpy : 0.001958131790161133 nb_pixel_total : 65196 time to create 1 rle with old method : 0.07331085205078125 length of segment : 357 time for calcul the mask position with numpy : 0.024163484573364258 nb_pixel_total : 1210110 time to create 1 rle with new method : 0.12409543991088867 length of segment : 1735 time for calcul the mask position with numpy : 0.0029268264770507812 nb_pixel_total : 129238 time to create 1 rle with old method : 0.1459965705871582 length of segment : 449 time for calcul the mask position with numpy : 0.0035400390625 nb_pixel_total : 158450 time to create 1 rle with new method : 0.009823322296142578 length of segment : 617 time for calcul the mask position with numpy : 0.0014891624450683594 nb_pixel_total : 66407 time to create 1 rle with old method : 0.07544565200805664 length of segment : 291 time for calcul the mask position with numpy : 0.0017778873443603516 nb_pixel_total : 76811 time to create 1 rle with old method : 0.0889732837677002 length of segment : 266 time for calcul the mask position with numpy : 0.017423629760742188 nb_pixel_total : 752540 time to create 1 rle with new method : 0.45450806617736816 length of segment : 1247 time for calcul the mask position with numpy : 0.0009257793426513672 nb_pixel_total : 44336 time to create 1 rle with old method : 0.05058598518371582 length of segment : 257 time for calcul the mask position with numpy : 0.008022546768188477 nb_pixel_total : 410540 time to create 1 rle with new method : 0.0334017276763916 length of segment : 898 time for calcul the mask position with numpy : 0.003127574920654297 nb_pixel_total : 153913 time to create 1 rle with new method : 0.008395671844482422 length of segment : 518 time for calcul the mask position with numpy : 0.009332656860351562 nb_pixel_total : 435463 time to create 1 rle with new method : 0.06036829948425293 length of segment : 845 time for calcul the mask position with numpy : 0.026127338409423828 nb_pixel_total : 805817 time to create 1 rle with new method : 0.09662842750549316 length of segment : 989 time for calcul the mask position with numpy : 0.0027098655700683594 nb_pixel_total : 110828 time to create 1 rle with old method : 0.11914753913879395 length of segment : 625 time for calcul the mask position with numpy : 0.009123802185058594 nb_pixel_total : 481739 time to create 1 rle with new method : 0.036420583724975586 length of segment : 891 time for calcul the mask position with numpy : 0.006093025207519531 nb_pixel_total : 318816 time to create 1 rle with new method : 0.016190052032470703 length of segment : 942 time for calcul the mask position with numpy : 0.00887155532836914 nb_pixel_total : 456521 time to create 1 rle with new method : 0.018227815628051758 length of segment : 696 time for calcul the mask position with numpy : 0.0009522438049316406 nb_pixel_total : 51645 time to create 1 rle with old method : 0.05600547790527344 length of segment : 296 time for calcul the mask position with numpy : 0.0036745071411132812 nb_pixel_total : 234528 time to create 1 rle with new method : 0.009801387786865234 length of segment : 727 time for calcul the mask position with numpy : 0.0008077621459960938 nb_pixel_total : 39480 time to create 1 rle with old method : 0.043241024017333984 length of segment : 223 time for calcul the mask position with numpy : 0.0030646324157714844 nb_pixel_total : 121636 time to create 1 rle with old method : 0.16024541854858398 length of segment : 404 time for calcul the mask position with numpy : 0.0011920928955078125 nb_pixel_total : 50292 time to create 1 rle with old method : 0.05801749229431152 length of segment : 179 time for calcul the mask position with numpy : 0.0035474300384521484 nb_pixel_total : 188295 time to create 1 rle with new method : 0.01040506362915039 length of segment : 871 time for calcul the mask position with numpy : 0.0008866786956787109 nb_pixel_total : 44557 time to create 1 rle with old method : 0.0522768497467041 length of segment : 184 time for calcul the mask position with numpy : 0.0026650428771972656 nb_pixel_total : 120093 time to create 1 rle with old method : 0.13840436935424805 length of segment : 387 time for calcul the mask position with numpy : 0.0035114288330078125 nb_pixel_total : 184301 time to create 1 rle with new method : 0.008632183074951172 length of segment : 348 time for calcul the mask position with numpy : 0.0015537738800048828 nb_pixel_total : 72518 time to create 1 rle with old method : 0.09209060668945312 length of segment : 429 time for calcul the mask position with numpy : 0.0012857913970947266 nb_pixel_total : 65314 time to create 1 rle with old method : 0.07337403297424316 length of segment : 265 time for calcul the mask position with numpy : 0.0016772747039794922 nb_pixel_total : 57781 time to create 1 rle with old method : 0.06422042846679688 length of segment : 407 time for calcul the mask position with numpy : 0.002733469009399414 nb_pixel_total : 108853 time to create 1 rle with old method : 0.14882230758666992 length of segment : 372 time for calcul the mask position with numpy : 0.0008516311645507812 nb_pixel_total : 33607 time to create 1 rle with old method : 0.03866100311279297 length of segment : 222 time for calcul the mask position with numpy : 0.0010001659393310547 nb_pixel_total : 41174 time to create 1 rle with old method : 0.046459197998046875 length of segment : 225 time for calcul the mask position with numpy : 0.0020143985748291016 nb_pixel_total : 74406 time to create 1 rle with old method : 0.09628868103027344 length of segment : 436 time for calcul the mask position with numpy : 0.002706289291381836 nb_pixel_total : 99078 time to create 1 rle with old method : 0.11315059661865234 length of segment : 456 time for calcul the mask position with numpy : 0.022449016571044922 nb_pixel_total : 898912 time to create 1 rle with new method : 0.4864389896392822 length of segment : 1280 time for calcul the mask position with numpy : 0.0022826194763183594 nb_pixel_total : 106121 time to create 1 rle with old method : 0.12034034729003906 length of segment : 376 time for calcul the mask position with numpy : 0.0011365413665771484 nb_pixel_total : 14306 time to create 1 rle with old method : 0.018204927444458008 length of segment : 208 time for calcul the mask position with numpy : 0.0037641525268554688 nb_pixel_total : 181575 time to create 1 rle with new method : 0.012388944625854492 length of segment : 888 time for calcul the mask position with numpy : 0.0024003982543945312 nb_pixel_total : 130840 time to create 1 rle with old method : 0.1450812816619873 length of segment : 346 time for calcul the mask position with numpy : 0.000560760498046875 nb_pixel_total : 23737 time to create 1 rle with old method : 0.027472496032714844 length of segment : 156 time for calcul the mask position with numpy : 0.000690460205078125 nb_pixel_total : 22600 time to create 1 rle with old method : 0.02640533447265625 length of segment : 236 time for calcul the mask position with numpy : 0.003625154495239258 nb_pixel_total : 123904 time to create 1 rle with old method : 0.13369393348693848 length of segment : 590 time for calcul the mask position with numpy : 0.0015897750854492188 nb_pixel_total : 50695 time to create 1 rle with old method : 0.054250478744506836 length of segment : 264 time for calcul the mask position with numpy : 0.001237630844116211 nb_pixel_total : 62492 time to create 1 rle with old method : 0.06592535972595215 length of segment : 338 time for calcul the mask position with numpy : 0.0006868839263916016 nb_pixel_total : 23230 time to create 1 rle with old method : 0.02617812156677246 length of segment : 288 time for calcul the mask position with numpy : 0.010024547576904297 nb_pixel_total : 554019 time to create 1 rle with new method : 0.8138337135314941 length of segment : 1509 time for calcul the mask position with numpy : 0.0005576610565185547 nb_pixel_total : 15381 time to create 1 rle with old method : 0.017771244049072266 length of segment : 177 time for calcul the mask position with numpy : 0.003266572952270508 nb_pixel_total : 180905 time to create 1 rle with new method : 0.011998414993286133 length of segment : 816 time for calcul the mask position with numpy : 0.023715734481811523 nb_pixel_total : 753295 time to create 1 rle with new method : 0.15505456924438477 length of segment : 1807 time for calcul the mask position with numpy : 0.007763385772705078 nb_pixel_total : 293406 time to create 1 rle with new method : 0.03673100471496582 length of segment : 998 time for calcul the mask position with numpy : 0.017232418060302734 nb_pixel_total : 659228 time to create 1 rle with new method : 0.09972143173217773 length of segment : 2023 time for calcul the mask position with numpy : 0.004490852355957031 nb_pixel_total : 184306 time to create 1 rle with new method : 0.012904644012451172 length of segment : 549 time for calcul the mask position with numpy : 0.014428853988647461 nb_pixel_total : 619474 time to create 1 rle with new method : 0.06565141677856445 length of segment : 1571 time for calcul the mask position with numpy : 0.0010340213775634766 nb_pixel_total : 41280 time to create 1 rle with old method : 0.04632925987243652 length of segment : 265 time for calcul the mask position with numpy : 0.0052204132080078125 nb_pixel_total : 203064 time to create 1 rle with new method : 0.014407634735107422 length of segment : 855 time for calcul the mask position with numpy : 0.003822803497314453 nb_pixel_total : 211314 time to create 1 rle with new method : 0.0101470947265625 length of segment : 605 time for calcul the mask position with numpy : 0.004083871841430664 nb_pixel_total : 221940 time to create 1 rle with new method : 0.011450052261352539 length of segment : 358 time for calcul the mask position with numpy : 0.0019118785858154297 nb_pixel_total : 81925 time to create 1 rle with old method : 0.09231042861938477 length of segment : 442 time for calcul the mask position with numpy : 0.000690460205078125 nb_pixel_total : 30391 time to create 1 rle with old method : 0.03690624237060547 length of segment : 167 time for calcul the mask position with numpy : 0.017181873321533203 nb_pixel_total : 627487 time to create 1 rle with new method : 0.15623211860656738 length of segment : 1467 time for calcul the mask position with numpy : 0.0009465217590332031 nb_pixel_total : 31750 time to create 1 rle with old method : 0.03604888916015625 length of segment : 278 time for calcul the mask position with numpy : 0.002142190933227539 nb_pixel_total : 81107 time to create 1 rle with old method : 0.09103178977966309 length of segment : 302 time for calcul the mask position with numpy : 0.0016677379608154297 nb_pixel_total : 75427 time to create 1 rle with old method : 0.08460688591003418 length of segment : 323 time for calcul the mask position with numpy : 0.0019099712371826172 nb_pixel_total : 115588 time to create 1 rle with old method : 0.12911415100097656 length of segment : 350 time for calcul the mask position with numpy : 0.005623340606689453 nb_pixel_total : 269234 time to create 1 rle with new method : 0.017030715942382812 length of segment : 719 time for calcul the mask position with numpy : 0.0024051666259765625 nb_pixel_total : 131556 time to create 1 rle with old method : 0.14661240577697754 length of segment : 422 time for calcul the mask position with numpy : 0.0023047924041748047 nb_pixel_total : 125232 time to create 1 rle with old method : 0.13605284690856934 length of segment : 436 time for calcul the mask position with numpy : 0.0011296272277832031 nb_pixel_total : 32200 time to create 1 rle with old method : 0.03604912757873535 length of segment : 330 time for calcul the mask position with numpy : 0.0065038204193115234 nb_pixel_total : 386758 time to create 1 rle with new method : 0.016059398651123047 length of segment : 988 time for calcul the mask position with numpy : 0.011064291000366211 nb_pixel_total : 536134 time to create 1 rle with new method : 0.05072212219238281 length of segment : 1137 time for calcul the mask position with numpy : 0.004199981689453125 nb_pixel_total : 144137 time to create 1 rle with old method : 0.15880632400512695 length of segment : 652 time for calcul the mask position with numpy : 0.027209997177124023 nb_pixel_total : 1227678 time to create 1 rle with new method : 0.1635274887084961 length of segment : 2279 time for calcul the mask position with numpy : 0.002421140670776367 nb_pixel_total : 81073 time to create 1 rle with old method : 0.09043455123901367 length of segment : 339 time for calcul the mask position with numpy : 0.0006489753723144531 nb_pixel_total : 30992 time to create 1 rle with old method : 0.034819841384887695 length of segment : 208 time for calcul the mask position with numpy : 0.00933837890625 nb_pixel_total : 547575 time to create 1 rle with new method : 0.02588343620300293 length of segment : 587 time for calcul the mask position with numpy : 0.0022470951080322266 nb_pixel_total : 133028 time to create 1 rle with old method : 0.14518070220947266 length of segment : 480 time for calcul the mask position with numpy : 0.0008761882781982422 nb_pixel_total : 38078 time to create 1 rle with old method : 0.04568076133728027 length of segment : 320 time for calcul the mask position with numpy : 0.004034519195556641 nb_pixel_total : 238199 time to create 1 rle with new method : 0.012413740158081055 length of segment : 676 time for calcul the mask position with numpy : 0.00566864013671875 nb_pixel_total : 279526 time to create 1 rle with new method : 0.013787269592285156 length of segment : 757 time for calcul the mask position with numpy : 0.0033881664276123047 nb_pixel_total : 144986 time to create 1 rle with old method : 0.1591653823852539 length of segment : 776 time for calcul the mask position with numpy : 0.0037033557891845703 nb_pixel_total : 134671 time to create 1 rle with old method : 0.19910573959350586 length of segment : 939 time for calcul the mask position with numpy : 0.004107236862182617 nb_pixel_total : 93554 time to create 1 rle with old method : 0.10550260543823242 length of segment : 335 time for calcul the mask position with numpy : 0.005987882614135742 nb_pixel_total : 226871 time to create 1 rle with new method : 0.019116640090942383 length of segment : 1047 time for calcul the mask position with numpy : 0.011007070541381836 nb_pixel_total : 555880 time to create 1 rle with new method : 0.0319674015045166 length of segment : 1168 time for calcul the mask position with numpy : 0.0029053688049316406 nb_pixel_total : 131729 time to create 1 rle with old method : 0.17055988311767578 length of segment : 485 time for calcul the mask position with numpy : 0.0009567737579345703 nb_pixel_total : 36367 time to create 1 rle with old method : 0.055161476135253906 length of segment : 194 time for calcul the mask position with numpy : 0.003115415573120117 nb_pixel_total : 146037 time to create 1 rle with old method : 0.17441797256469727 length of segment : 610 time for calcul the mask position with numpy : 0.0007107257843017578 nb_pixel_total : 21480 time to create 1 rle with old method : 0.026204824447631836 length of segment : 242 time for calcul the mask position with numpy : 0.0012705326080322266 nb_pixel_total : 65631 time to create 1 rle with old method : 0.07506847381591797 length of segment : 286 time for calcul the mask position with numpy : 0.0030777454376220703 nb_pixel_total : 150433 time to create 1 rle with new method : 0.008914709091186523 length of segment : 525 time for calcul the mask position with numpy : 0.0009555816650390625 nb_pixel_total : 58244 time to create 1 rle with old method : 0.06333494186401367 length of segment : 257 time for calcul the mask position with numpy : 0.008089303970336914 nb_pixel_total : 312471 time to create 1 rle with new method : 0.02368450164794922 length of segment : 747 time for calcul the mask position with numpy : 0.008475065231323242 nb_pixel_total : 315331 time to create 1 rle with new method : 0.024293184280395508 length of segment : 977 time for calcul the mask position with numpy : 0.0008852481842041016 nb_pixel_total : 45454 time to create 1 rle with old method : 0.0504918098449707 length of segment : 203 time for calcul the mask position with numpy : 0.003503084182739258 nb_pixel_total : 172738 time to create 1 rle with new method : 0.008932828903198242 length of segment : 1100 time for calcul the mask position with numpy : 0.0036377906799316406 nb_pixel_total : 217421 time to create 1 rle with new method : 0.010763168334960938 length of segment : 453 time for calcul the mask position with numpy : 0.0035643577575683594 nb_pixel_total : 170509 time to create 1 rle with new method : 0.009082317352294922 length of segment : 647 time for calcul the mask position with numpy : 0.002705812454223633 nb_pixel_total : 149072 time to create 1 rle with old method : 0.17252159118652344 length of segment : 415 time for calcul the mask position with numpy : 0.0025904178619384766 nb_pixel_total : 138421 time to create 1 rle with old method : 0.15061402320861816 length of segment : 368 time for calcul the mask position with numpy : 0.0022830963134765625 nb_pixel_total : 123842 time to create 1 rle with old method : 0.13568663597106934 length of segment : 501 time for calcul the mask position with numpy : 0.0008556842803955078 nb_pixel_total : 35247 time to create 1 rle with old method : 0.03997039794921875 length of segment : 355 time for calcul the mask position with numpy : 0.0007495880126953125 nb_pixel_total : 38409 time to create 1 rle with old method : 0.05897974967956543 length of segment : 127 time for calcul the mask position with numpy : 0.003988504409790039 nb_pixel_total : 202484 time to create 1 rle with new method : 0.011674880981445312 length of segment : 702 time for calcul the mask position with numpy : 0.002079486846923828 nb_pixel_total : 101636 time to create 1 rle with old method : 0.11399078369140625 length of segment : 544 time for calcul the mask position with numpy : 0.020745515823364258 nb_pixel_total : 556905 time to create 1 rle with new method : 0.1437232494354248 length of segment : 1217 time for calcul the mask position with numpy : 0.0008337497711181641 nb_pixel_total : 31821 time to create 1 rle with old method : 0.0447239875793457 length of segment : 250 time for calcul the mask position with numpy : 0.0007529258728027344 nb_pixel_total : 27045 time to create 1 rle with old method : 0.03151559829711914 length of segment : 116 time for calcul the mask position with numpy : 0.0009253025054931641 nb_pixel_total : 36150 time to create 1 rle with old method : 0.042287588119506836 length of segment : 187 time for calcul the mask position with numpy : 0.0007538795471191406 nb_pixel_total : 35229 time to create 1 rle with old method : 0.03939986228942871 length of segment : 224 time for calcul the mask position with numpy : 0.0027883052825927734 nb_pixel_total : 124501 time to create 1 rle with old method : 0.13927507400512695 length of segment : 608 time for calcul the mask position with numpy : 0.0012524127960205078 nb_pixel_total : 53849 time to create 1 rle with old method : 0.059694528579711914 length of segment : 289 time for calcul the mask position with numpy : 0.0032339096069335938 nb_pixel_total : 186304 time to create 1 rle with new method : 0.008066892623901367 length of segment : 863 time for calcul the mask position with numpy : 0.0010447502136230469 nb_pixel_total : 55598 time to create 1 rle with old method : 0.06139707565307617 length of segment : 282 time for calcul the mask position with numpy : 0.0008349418640136719 nb_pixel_total : 29508 time to create 1 rle with old method : 0.033039093017578125 length of segment : 277 time for calcul the mask position with numpy : 0.0010221004486083984 nb_pixel_total : 64866 time to create 1 rle with old method : 0.0733480453491211 length of segment : 324 time for calcul the mask position with numpy : 0.0013554096221923828 nb_pixel_total : 72657 time to create 1 rle with old method : 0.08169817924499512 length of segment : 361 time for calcul the mask position with numpy : 0.006577730178833008 nb_pixel_total : 6610 time to create 1 rle with old method : 0.007900476455688477 length of segment : 84 time for calcul the mask position with numpy : 0.002599954605102539 nb_pixel_total : 98795 time to create 1 rle with old method : 0.1108098030090332 length of segment : 436 time for calcul the mask position with numpy : 0.0014748573303222656 nb_pixel_total : 70470 time to create 1 rle with old method : 0.09153437614440918 length of segment : 289 time for calcul the mask position with numpy : 0.002490997314453125 nb_pixel_total : 134892 time to create 1 rle with old method : 0.1480727195739746 length of segment : 494 time for calcul the mask position with numpy : 0.002262115478515625 nb_pixel_total : 89812 time to create 1 rle with old method : 0.09869146347045898 length of segment : 433 time for calcul the mask position with numpy : 0.0013051033020019531 nb_pixel_total : 66264 time to create 1 rle with old method : 0.07273483276367188 length of segment : 333 time for calcul the mask position with numpy : 0.004174232482910156 nb_pixel_total : 206929 time to create 1 rle with new method : 0.012676000595092773 length of segment : 812 time for calcul the mask position with numpy : 0.0044324398040771484 nb_pixel_total : 227509 time to create 1 rle with new method : 0.012084484100341797 length of segment : 663 time for calcul the mask position with numpy : 0.004591226577758789 nb_pixel_total : 244974 time to create 1 rle with new method : 0.012603282928466797 length of segment : 662 time for calcul the mask position with numpy : 0.003964424133300781 nb_pixel_total : 203090 time to create 1 rle with new method : 0.011031150817871094 length of segment : 570 time for calcul the mask position with numpy : 0.0017547607421875 nb_pixel_total : 93090 time to create 1 rle with old method : 0.11949682235717773 length of segment : 336 time for calcul the mask position with numpy : 0.01842951774597168 nb_pixel_total : 1019094 time to create 1 rle with new method : 0.2955501079559326 length of segment : 1681 time for calcul the mask position with numpy : 0.007533073425292969 nb_pixel_total : 367026 time to create 1 rle with new method : 0.03848004341125488 length of segment : 946 time for calcul the mask position with numpy : 0.013553857803344727 nb_pixel_total : 621377 time to create 1 rle with new method : 0.0670919418334961 length of segment : 1561 time for calcul the mask position with numpy : 0.0029687881469726562 nb_pixel_total : 154139 time to create 1 rle with new method : 0.007016897201538086 length of segment : 449 time for calcul the mask position with numpy : 0.009476184844970703 nb_pixel_total : 452711 time to create 1 rle with new method : 0.02254199981689453 length of segment : 867 time for calcul the mask position with numpy : 0.0006105899810791016 nb_pixel_total : 19420 time to create 1 rle with old method : 0.022185087203979492 length of segment : 245 time for calcul the mask position with numpy : 0.003583669662475586 nb_pixel_total : 181607 time to create 1 rle with new method : 0.01143503189086914 length of segment : 814 time for calcul the mask position with numpy : 0.0017285346984863281 nb_pixel_total : 111074 time to create 1 rle with old method : 0.1227867603302002 length of segment : 426 time for calcul the mask position with numpy : 0.0017409324645996094 nb_pixel_total : 79808 time to create 1 rle with old method : 0.0898141860961914 length of segment : 462 time for calcul the mask position with numpy : 0.0052449703216552734 nb_pixel_total : 301524 time to create 1 rle with new method : 0.015555620193481445 length of segment : 858 time for calcul the mask position with numpy : 0.004140138626098633 nb_pixel_total : 242766 time to create 1 rle with new method : 0.011497735977172852 length of segment : 810 time for calcul the mask position with numpy : 0.0015537738800048828 nb_pixel_total : 80626 time to create 1 rle with old method : 0.09042477607727051 length of segment : 291 time for calcul the mask position with numpy : 0.0005004405975341797 nb_pixel_total : 18151 time to create 1 rle with old method : 0.02069091796875 length of segment : 206 time for calcul the mask position with numpy : 0.0009541511535644531 nb_pixel_total : 50154 time to create 1 rle with old method : 0.05776858329772949 length of segment : 276 time for calcul the mask position with numpy : 0.001155853271484375 nb_pixel_total : 64751 time to create 1 rle with old method : 0.07288384437561035 length of segment : 310 time for calcul the mask position with numpy : 0.0014026165008544922 nb_pixel_total : 80431 time to create 1 rle with old method : 0.08918333053588867 length of segment : 377 time for calcul the mask position with numpy : 0.0024805068969726562 nb_pixel_total : 138074 time to create 1 rle with old method : 0.1542372703552246 length of segment : 497 time for calcul the mask position with numpy : 0.0011792182922363281 nb_pixel_total : 74530 time to create 1 rle with old method : 0.0836496353149414 length of segment : 244 time for calcul the mask position with numpy : 0.019660234451293945 nb_pixel_total : 952759 time to create 1 rle with new method : 0.08983325958251953 length of segment : 1156 time for calcul the mask position with numpy : 0.028924226760864258 nb_pixel_total : 1116785 time to create 1 rle with new method : 0.14042997360229492 length of segment : 1917 time for calcul the mask position with numpy : 0.001531839370727539 nb_pixel_total : 58684 time to create 1 rle with old method : 0.07174229621887207 length of segment : 318 time for calcul the mask position with numpy : 0.001688241958618164 nb_pixel_total : 102921 time to create 1 rle with old method : 0.11389875411987305 length of segment : 300 time for calcul the mask position with numpy : 0.0013511180877685547 nb_pixel_total : 87306 time to create 1 rle with old method : 0.1000664234161377 length of segment : 350 time for calcul the mask position with numpy : 0.002962350845336914 nb_pixel_total : 139334 time to create 1 rle with old method : 0.16174077987670898 length of segment : 380 time for calcul the mask position with numpy : 0.0021805763244628906 nb_pixel_total : 96780 time to create 1 rle with old method : 0.12511420249938965 length of segment : 416 time for calcul the mask position with numpy : 0.02712726593017578 nb_pixel_total : 1590214 time to create 1 rle with new method : 0.33156752586364746 length of segment : 1924 time for calcul the mask position with numpy : 0.0057523250579833984 nb_pixel_total : 293370 time to create 1 rle with new method : 0.016617536544799805 length of segment : 595 time for calcul the mask position with numpy : 0.001577615737915039 nb_pixel_total : 68808 time to create 1 rle with old method : 0.07624149322509766 length of segment : 271 time for calcul the mask position with numpy : 0.0013213157653808594 nb_pixel_total : 64457 time to create 1 rle with old method : 0.073089599609375 length of segment : 213 time for calcul the mask position with numpy : 0.0004436969757080078 nb_pixel_total : 16882 time to create 1 rle with old method : 0.019592761993408203 length of segment : 179 time for calcul the mask position with numpy : 0.0008327960968017578 nb_pixel_total : 37541 time to create 1 rle with old method : 0.041991472244262695 length of segment : 455 time for calcul the mask position with numpy : 0.0007202625274658203 nb_pixel_total : 29598 time to create 1 rle with old method : 0.0329592227935791 length of segment : 221 time for calcul the mask position with numpy : 0.0029954910278320312 nb_pixel_total : 142052 time to create 1 rle with old method : 0.1768321990966797 length of segment : 377 time for calcul the mask position with numpy : 0.00048804283142089844 nb_pixel_total : 23429 time to create 1 rle with old method : 0.026677608489990234 length of segment : 194 time for calcul the mask position with numpy : 0.002108335494995117 nb_pixel_total : 70382 time to create 1 rle with old method : 0.07600951194763184 length of segment : 537 time for calcul the mask position with numpy : 0.004681110382080078 nb_pixel_total : 218177 time to create 1 rle with new method : 0.01396489143371582 length of segment : 671 time for calcul the mask position with numpy : 0.00024080276489257812 nb_pixel_total : 11484 time to create 1 rle with old method : 0.01289987564086914 length of segment : 152 time for calcul the mask position with numpy : 0.020112991333007812 nb_pixel_total : 946025 time to create 1 rle with new method : 0.24613499641418457 length of segment : 2602 time for calcul the mask position with numpy : 0.004368782043457031 nb_pixel_total : 293800 time to create 1 rle with new method : 0.011186361312866211 length of segment : 425 time for calcul the mask position with numpy : 0.004200458526611328 nb_pixel_total : 219561 time to create 1 rle with new method : 0.012619256973266602 length of segment : 648 time for calcul the mask position with numpy : 0.0009419918060302734 nb_pixel_total : 36897 time to create 1 rle with old method : 0.0423736572265625 length of segment : 256 time for calcul the mask position with numpy : 0.0014317035675048828 nb_pixel_total : 63644 time to create 1 rle with old method : 0.07096171379089355 length of segment : 377 time for calcul the mask position with numpy : 0.006041288375854492 nb_pixel_total : 301589 time to create 1 rle with new method : 0.017505407333374023 length of segment : 440 time for calcul the mask position with numpy : 0.0013718605041503906 nb_pixel_total : 59403 time to create 1 rle with old method : 0.06596636772155762 length of segment : 370 time for calcul the mask position with numpy : 0.002231121063232422 nb_pixel_total : 116742 time to create 1 rle with old method : 0.13545632362365723 length of segment : 435 time for calcul the mask position with numpy : 0.5332708358764648 nb_pixel_total : 5044521 time to create 1 rle with new method : 1.4356045722961426 length of segment : 6762 time for calcul the mask position with numpy : 0.21457576751708984 nb_pixel_total : 1713004 time to create 1 rle with new method : 0.20274138450622559 length of segment : 1208 time for calcul the mask position with numpy : 0.7033112049102783 nb_pixel_total : 2874849 time to create 1 rle with new method : 0.6121454238891602 length of segment : 1624 time for calcul the mask position with numpy : 0.027314186096191406 nb_pixel_total : 1319014 time to create 1 rle with new method : 0.1166832447052002 length of segment : 658 time for calcul the mask position with numpy : 0.025309085845947266 nb_pixel_total : 1515614 time to create 1 rle with new method : 0.43883347511291504 length of segment : 1415 time for calcul the mask position with numpy : 0.008303165435791016 nb_pixel_total : 585179 time to create 1 rle with new method : 0.03767800331115723 length of segment : 632 time spent for convertir_results : 52.402756690979004 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 281 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 124.44107627868652 time spend to save output : 0.17698979377746582 total time spend for step 2 : 124.61806607246399 step3:blur_detection Fri Sep 12 10:44:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 2349.590516629589 (4160, 3120) 523.4247357305761 (4160, 3120) 1238.0179919147288 (4160, 3120) 659.9934889091328 (4160, 3120) 461.9269740094865 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.011616706848144531 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.013010263442993164 save missing photos in datou_result : time spend for datou_step_exec : 2.647200345993042 time spend to save output : 0.029195070266723633 total time spend for step 3 : 2.6763954162597656 step4:brightness Fri Sep 12 10:44:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757666488_1976647_1383289817_a08f025a3dd0060df6366a65cd808a23.jpg treat image : temp/1757666488_1976647_1383289813_42b118a04a1bcae97eecc8652c66394a.jpg treat image : temp/1757666488_1976647_1383289804_68213cc269c22590bd1c22c180ad2751.jpg treat image : temp/1757666488_1976647_1383289803_beeee7231b68ff2219f0f2374fc9c293.jpg treat image : temp/1757666488_1976647_1383289784_b7a5be97b6c0444b2d4d741ebcf37d96.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.012666940689086914 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.012517213821411133 save missing photos in datou_result : time spend for datou_step_exec : 9.112361431121826 time spend to save output : 0.030994176864624023 total time spend for step 4 : 9.14335560798645 step5:rle_unique_nms_with_priority Fri Sep 12 10:44:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 281 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 79 nb_hashtags : 9 time to prepare the origin masks : 62.488945722579956 time for calcul the mask position with numpy : 1.537895679473877 nb_pixel_total : 5260829 time to create 1 rle with new method : 1.7332510948181152 time for calcul the mask position with numpy : 0.05313467979431152 nb_pixel_total : 700 time to create 1 rle with old method : 0.0008833408355712891 time for calcul the mask position with numpy : 0.05282235145568848 nb_pixel_total : 3952 time to create 1 rle with old method : 0.0044956207275390625 time for calcul the mask position with numpy : 0.052840471267700195 nb_pixel_total : 17820 time to create 1 rle with old method : 0.019733428955078125 time for calcul the mask position with numpy : 0.22353839874267578 nb_pixel_total : 419041 time to create 1 rle with new method : 1.3479394912719727 time for calcul the mask position with numpy : 0.05399918556213379 nb_pixel_total : 74431 time to create 1 rle with old method : 0.0803060531616211 time for calcul the mask position with numpy : 0.05379772186279297 nb_pixel_total : 2663 time to create 1 rle with old method : 0.003192424774169922 time for calcul the mask position with numpy : 0.053536415100097656 nb_pixel_total : 14358 time to create 1 rle with old method : 0.016120433807373047 time for calcul the mask position with numpy : 0.05924248695373535 nb_pixel_total : 67781 time to create 1 rle with old method : 0.07586455345153809 time for calcul the mask position with numpy : 0.05344390869140625 nb_pixel_total : 27093 time to create 1 rle with old method : 0.029137611389160156 time for calcul the mask position with numpy : 0.052431344985961914 nb_pixel_total : 6514 time to create 1 rle with old method : 0.008819103240966797 time for calcul the mask position with numpy : 0.05788850784301758 nb_pixel_total : 234967 time to create 1 rle with new method : 1.1781327724456787 time for calcul the mask position with numpy : 0.05376768112182617 nb_pixel_total : 16913 time to create 1 rle with old method : 0.018326282501220703 time for calcul the mask position with numpy : 0.055121660232543945 nb_pixel_total : 12247 time to create 1 rle with old method : 0.013839960098266602 time for calcul the mask position with numpy : 0.054505109786987305 nb_pixel_total : 44477 time to create 1 rle with old method : 0.0496673583984375 time for calcul the mask position with numpy : 0.053144216537475586 nb_pixel_total : 63325 time to create 1 rle with old method : 0.06981825828552246 time for calcul the mask position with numpy : 0.054403066635131836 nb_pixel_total : 123470 time to create 1 rle with old method : 0.13303470611572266 time for calcul the mask position with numpy : 0.05277061462402344 nb_pixel_total : 595 time to create 1 rle with old method : 0.0006806850433349609 time for calcul the mask position with numpy : 0.054488182067871094 nb_pixel_total : 177814 time to create 1 rle with new method : 1.3983886241912842 time for calcul the mask position with numpy : 0.05773520469665527 nb_pixel_total : 17260 time to create 1 rle with old method : 0.018926382064819336 time for calcul the mask position with numpy : 0.057257652282714844 nb_pixel_total : 417939 time to create 1 rle with new method : 1.6539080142974854 time for calcul the mask position with numpy : 0.05421137809753418 nb_pixel_total : 59974 time to create 1 rle with old method : 0.06514167785644531 time for calcul the mask position with numpy : 0.05397748947143555 nb_pixel_total : 54357 time to create 1 rle with old method : 0.0600125789642334 time for calcul the mask position with numpy : 0.05385279655456543 nb_pixel_total : 38911 time to create 1 rle with old method : 0.04263472557067871 time for calcul the mask position with numpy : 0.05610775947570801 nb_pixel_total : 328986 time to create 1 rle with new method : 1.8824424743652344 time for calcul the mask position with numpy : 0.05463457107543945 nb_pixel_total : 2445 time to create 1 rle with old method : 0.0029609203338623047 time for calcul the mask position with numpy : 0.054865360260009766 nb_pixel_total : 58488 time to create 1 rle with old method : 0.07086420059204102 time for calcul the mask position with numpy : 0.06121325492858887 nb_pixel_total : 33329 time to create 1 rle with old method : 0.03756546974182129 time for calcul the mask position with numpy : 0.054674386978149414 nb_pixel_total : 95502 time to create 1 rle with old method : 0.10474991798400879 time for calcul the mask position with numpy : 0.054564476013183594 nb_pixel_total : 45994 time to create 1 rle with old method : 0.05054354667663574 time for calcul the mask position with numpy : 0.05406546592712402 nb_pixel_total : 24826 time to create 1 rle with old method : 0.029103755950927734 time for calcul the mask position with numpy : 0.05447030067443848 nb_pixel_total : 170765 time to create 1 rle with new method : 1.3985490798950195 time for calcul the mask position with numpy : 0.05440330505371094 nb_pixel_total : 412 time to create 1 rle with old method : 0.0005710124969482422 time for calcul the mask position with numpy : 0.056772470474243164 nb_pixel_total : 16395 time to create 1 rle with old method : 0.020703554153442383 time for calcul the mask position with numpy : 0.06711077690124512 nb_pixel_total : 139163 time to create 1 rle with old method : 0.21069645881652832 time for calcul the mask position with numpy : 0.058869361877441406 nb_pixel_total : 47662 time to create 1 rle with old method : 0.05389046669006348 time for calcul the mask position with numpy : 0.054738521575927734 nb_pixel_total : 43043 time to create 1 rle with old method : 0.0479886531829834 time for calcul the mask position with numpy : 0.06090545654296875 nb_pixel_total : 49586 time to create 1 rle with old method : 0.05965876579284668 time for calcul the mask position with numpy : 0.05371284484863281 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0012540817260742188 time for calcul the mask position with numpy : 0.05878019332885742 nb_pixel_total : 62994 time to create 1 rle with old method : 0.06929254531860352 time for calcul the mask position with numpy : 0.05549311637878418 nb_pixel_total : 62202 time to create 1 rle with old method : 0.06937098503112793 time for calcul the mask position with numpy : 0.0539402961730957 nb_pixel_total : 59 time to create 1 rle with old method : 0.00013303756713867188 time for calcul the mask position with numpy : 0.05431866645812988 nb_pixel_total : 52406 time to create 1 rle with old method : 0.057526350021362305 time for calcul the mask position with numpy : 0.05417990684509277 nb_pixel_total : 71526 time to create 1 rle with old method : 0.0786135196685791 time for calcul the mask position with numpy : 0.054836273193359375 nb_pixel_total : 29263 time to create 1 rle with old method : 0.04678153991699219 time for calcul the mask position with numpy : 0.05999135971069336 nb_pixel_total : 178467 time to create 1 rle with new method : 1.8148858547210693 time for calcul the mask position with numpy : 0.05765533447265625 nb_pixel_total : 353374 time to create 1 rle with new method : 1.4915885925292969 time for calcul the mask position with numpy : 0.05401182174682617 nb_pixel_total : 2348 time to create 1 rle with old method : 0.002794981002807617 time for calcul the mask position with numpy : 0.054086923599243164 nb_pixel_total : 8153 time to create 1 rle with old method : 0.009247064590454102 time for calcul the mask position with numpy : 0.053784847259521484 nb_pixel_total : 24069 time to create 1 rle with old method : 0.0287625789642334 time for calcul the mask position with numpy : 0.05419588088989258 nb_pixel_total : 21130 time to create 1 rle with old method : 0.023634910583496094 time for calcul the mask position with numpy : 0.06068897247314453 nb_pixel_total : 64690 time to create 1 rle with old method : 0.07891225814819336 time for calcul the mask position with numpy : 0.06068849563598633 nb_pixel_total : 173950 time to create 1 rle with new method : 1.2950901985168457 time for calcul the mask position with numpy : 0.05532431602478027 nb_pixel_total : 8148 time to create 1 rle with old method : 0.009715795516967773 time for calcul the mask position with numpy : 0.0552067756652832 nb_pixel_total : 55681 time to create 1 rle with old method : 0.06463074684143066 time for calcul the mask position with numpy : 0.05641007423400879 nb_pixel_total : 2354 time to create 1 rle with old method : 0.0029850006103515625 time for calcul the mask position with numpy : 0.05499148368835449 nb_pixel_total : 42740 time to create 1 rle with old method : 0.047376155853271484 time for calcul the mask position with numpy : 0.05479073524475098 nb_pixel_total : 30130 time to create 1 rle with old method : 0.033153533935546875 time for calcul the mask position with numpy : 0.05729842185974121 nb_pixel_total : 43383 time to create 1 rle with old method : 0.05989336967468262 time for calcul the mask position with numpy : 0.18505001068115234 nb_pixel_total : 894361 time to create 1 rle with new method : 1.1130599975585938 time for calcul the mask position with numpy : 0.05591011047363281 nb_pixel_total : 103526 time to create 1 rle with old method : 0.1158909797668457 time for calcul the mask position with numpy : 0.053705453872680664 nb_pixel_total : 58726 time to create 1 rle with old method : 0.06630706787109375 time for calcul the mask position with numpy : 0.054285526275634766 nb_pixel_total : 20983 time to create 1 rle with old method : 0.02412128448486328 time for calcul the mask position with numpy : 0.05449867248535156 nb_pixel_total : 74928 time to create 1 rle with old method : 0.08528590202331543 time for calcul the mask position with numpy : 0.055737972259521484 nb_pixel_total : 256410 time to create 1 rle with new method : 0.9460070133209229 time for calcul the mask position with numpy : 0.05854010581970215 nb_pixel_total : 515462 time to create 1 rle with new method : 1.1519432067871094 time for calcul the mask position with numpy : 0.05485248565673828 nb_pixel_total : 10711 time to create 1 rle with old method : 0.012481689453125 time for calcul the mask position with numpy : 0.05521965026855469 nb_pixel_total : 66426 time to create 1 rle with old method : 0.07372379302978516 time for calcul the mask position with numpy : 0.056444406509399414 nb_pixel_total : 165420 time to create 1 rle with new method : 1.2908990383148193 time for calcul the mask position with numpy : 0.05277657508850098 nb_pixel_total : 37752 time to create 1 rle with old method : 0.0415492057800293 time for calcul the mask position with numpy : 0.05379748344421387 nb_pixel_total : 301544 time to create 1 rle with new method : 0.7889196872711182 time for calcul the mask position with numpy : 0.05402827262878418 nb_pixel_total : 42987 time to create 1 rle with old method : 0.047276973724365234 time for calcul the mask position with numpy : 0.056324005126953125 nb_pixel_total : 407925 time to create 1 rle with new method : 1.0912272930145264 time for calcul the mask position with numpy : 0.05318641662597656 nb_pixel_total : 39009 time to create 1 rle with old method : 0.04353904724121094 time for calcul the mask position with numpy : 0.05447053909301758 nb_pixel_total : 145530 time to create 1 rle with old method : 0.15578675270080566 time for calcul the mask position with numpy : 0.05971336364746094 nb_pixel_total : 15290 time to create 1 rle with old method : 0.01742100715637207 time for calcul the mask position with numpy : 0.05631208419799805 nb_pixel_total : 148118 time to create 1 rle with old method : 0.1627213954925537 time for calcul the mask position with numpy : 0.056119441986083984 nb_pixel_total : 58335 time to create 1 rle with old method : 0.06426048278808594 time for calcul the mask position with numpy : 0.05525922775268555 nb_pixel_total : 58874 time to create 1 rle with old method : 0.06488275527954102 time for calcul the mask position with numpy : 0.05502629280090332 nb_pixel_total : 54767 time to create 1 rle with old method : 0.06051468849182129 create new chi : 31.696866750717163 time to delete rle : 0.026088476181030273 batch 1 Loaded 80 chid ids of type : 4855 Number RLEs to save : 59649 TO DO : save crop sub photo not yet done ! save time : 3.0678064823150635 nb_obj : 66 nb_hashtags : 10 time to prepare the origin masks : 55.18453097343445 time for calcul the mask position with numpy : 1.2747802734375 nb_pixel_total : 4052562 time to create 1 rle with new method : 0.7342917919158936 time for calcul the mask position with numpy : 0.05381941795349121 nb_pixel_total : 50519 time to create 1 rle with old method : 0.054406166076660156 time for calcul the mask position with numpy : 0.07504391670227051 nb_pixel_total : 553202 time to create 1 rle with new method : 1.2122108936309814 time for calcul the mask position with numpy : 0.05314993858337402 nb_pixel_total : 79857 time to create 1 rle with old method : 0.08892583847045898 time for calcul the mask position with numpy : 0.06387972831726074 nb_pixel_total : 751302 time to create 1 rle with new method : 1.1138865947723389 time for calcul the mask position with numpy : 0.054495811462402344 nb_pixel_total : 49406 time to create 1 rle with old method : 0.05508136749267578 time for calcul the mask position with numpy : 0.05597662925720215 nb_pixel_total : 481464 time to create 1 rle with new method : 1.6932117938995361 time for calcul the mask position with numpy : 0.05371379852294922 nb_pixel_total : 408 time to create 1 rle with old method : 0.0004985332489013672 time for calcul the mask position with numpy : 0.05323362350463867 nb_pixel_total : 51488 time to create 1 rle with old method : 0.05706000328063965 time for calcul the mask position with numpy : 0.054892539978027344 nb_pixel_total : 52152 time to create 1 rle with old method : 0.061377763748168945 time for calcul the mask position with numpy : 0.05789518356323242 nb_pixel_total : 105927 time to create 1 rle with old method : 0.12162160873413086 time for calcul the mask position with numpy : 0.058576107025146484 nb_pixel_total : 409993 time to create 1 rle with new method : 0.9102838039398193 time for calcul the mask position with numpy : 0.05826759338378906 nb_pixel_total : 153676 time to create 1 rle with new method : 1.5145008563995361 time for calcul the mask position with numpy : 0.055588483810424805 nb_pixel_total : 11868 time to create 1 rle with old method : 0.02302241325378418 time for calcul the mask position with numpy : 0.062477827072143555 nb_pixel_total : 183771 time to create 1 rle with new method : 1.2795023918151855 time for calcul the mask position with numpy : 0.05808091163635254 nb_pixel_total : 5833 time to create 1 rle with old method : 0.006766080856323242 time for calcul the mask position with numpy : 0.058138370513916016 nb_pixel_total : 23186 time to create 1 rle with old method : 0.02727341651916504 time for calcul the mask position with numpy : 0.060256004333496094 nb_pixel_total : 72404 time to create 1 rle with old method : 0.09148931503295898 time for calcul the mask position with numpy : 0.06557917594909668 nb_pixel_total : 580704 time to create 1 rle with new method : 1.0486793518066406 time for calcul the mask position with numpy : 0.05938005447387695 nb_pixel_total : 119814 time to create 1 rle with old method : 0.13652920722961426 time for calcul the mask position with numpy : 0.05595564842224121 nb_pixel_total : 21343 time to create 1 rle with old method : 0.030824661254882812 time for calcul the mask position with numpy : 0.0551302433013916 nb_pixel_total : 121242 time to create 1 rle with old method : 0.13294005393981934 time for calcul the mask position with numpy : 0.055323123931884766 nb_pixel_total : 119688 time to create 1 rle with old method : 0.13480138778686523 time for calcul the mask position with numpy : 0.05699038505554199 nb_pixel_total : 13542 time to create 1 rle with old method : 0.01548457145690918 time for calcul the mask position with numpy : 0.05669689178466797 nb_pixel_total : 61132 time to create 1 rle with old method : 0.0707707405090332 time for calcul the mask position with numpy : 0.05501961708068848 nb_pixel_total : 98832 time to create 1 rle with old method : 0.10992145538330078 time for calcul the mask position with numpy : 0.05492687225341797 nb_pixel_total : 74309 time to create 1 rle with old method : 0.08175015449523926 time for calcul the mask position with numpy : 0.05553102493286133 nb_pixel_total : 126637 time to create 1 rle with old method : 0.1420292854309082 time for calcul the mask position with numpy : 0.05484127998352051 nb_pixel_total : 110593 time to create 1 rle with old method : 0.12966227531433105 time for calcul the mask position with numpy : 0.05845165252685547 nb_pixel_total : 30542 time to create 1 rle with old method : 0.04969358444213867 time for calcul the mask position with numpy : 0.05868792533874512 nb_pixel_total : 975 time to create 1 rle with old method : 0.0017125606536865234 time for calcul the mask position with numpy : 0.05939316749572754 nb_pixel_total : 15315 time to create 1 rle with old method : 0.019907236099243164 time for calcul the mask position with numpy : 0.05479097366333008 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006468296051025391 time for calcul the mask position with numpy : 0.05452537536621094 nb_pixel_total : 39344 time to create 1 rle with old method : 0.04495644569396973 time for calcul the mask position with numpy : 0.06080317497253418 nb_pixel_total : 455972 time to create 1 rle with new method : 1.3646814823150635 time for calcul the mask position with numpy : 0.056757450103759766 nb_pixel_total : 211263 time to create 1 rle with new method : 0.7843296527862549 time for calcul the mask position with numpy : 0.05489540100097656 nb_pixel_total : 50058 time to create 1 rle with old method : 0.05562448501586914 time for calcul the mask position with numpy : 0.05436897277832031 nb_pixel_total : 562 time to create 1 rle with old method : 0.0007011890411376953 time for calcul the mask position with numpy : 0.054464101791381836 nb_pixel_total : 41204 time to create 1 rle with old method : 0.04514360427856445 time for calcul the mask position with numpy : 0.05481863021850586 nb_pixel_total : 57803 time to create 1 rle with old method : 0.06499171257019043 time for calcul the mask position with numpy : 0.05662226676940918 nb_pixel_total : 183230 time to create 1 rle with new method : 0.560802698135376 time for calcul the mask position with numpy : 0.0553286075592041 nb_pixel_total : 14160 time to create 1 rle with old method : 0.01590275764465332 time for calcul the mask position with numpy : 0.05551791191101074 nb_pixel_total : 51495 time to create 1 rle with old method : 0.058869361877441406 time for calcul the mask position with numpy : 0.05956602096557617 nb_pixel_total : 22468 time to create 1 rle with old method : 0.03395509719848633 time for calcul the mask position with numpy : 0.056101322174072266 nb_pixel_total : 16146 time to create 1 rle with old method : 0.018346309661865234 time for calcul the mask position with numpy : 0.05873274803161621 nb_pixel_total : 504111 time to create 1 rle with new method : 0.6030693054199219 time for calcul the mask position with numpy : 0.055164337158203125 nb_pixel_total : 65135 time to create 1 rle with old method : 0.09920883178710938 time for calcul the mask position with numpy : 0.05759310722351074 nb_pixel_total : 318673 time to create 1 rle with new method : 0.6984415054321289 time for calcul the mask position with numpy : 0.054744720458984375 nb_pixel_total : 55056 time to create 1 rle with old method : 0.06049776077270508 time for calcul the mask position with numpy : 0.05629467964172363 nb_pixel_total : 113582 time to create 1 rle with old method : 0.12912702560424805 time for calcul the mask position with numpy : 0.05488324165344238 nb_pixel_total : 41131 time to create 1 rle with old method : 0.04634690284729004 time for calcul the mask position with numpy : 0.05834197998046875 nb_pixel_total : 11244 time to create 1 rle with old method : 0.012827873229980469 time for calcul the mask position with numpy : 0.05569195747375488 nb_pixel_total : 82445 time to create 1 rle with old method : 0.09224843978881836 time for calcul the mask position with numpy : 0.0556643009185791 nb_pixel_total : 47098 time to create 1 rle with old method : 0.05264687538146973 time for calcul the mask position with numpy : 0.056153059005737305 nb_pixel_total : 4897 time to create 1 rle with old method : 0.006012439727783203 time for calcul the mask position with numpy : 0.06708717346191406 nb_pixel_total : 803958 time to create 1 rle with new method : 0.6488072872161865 time for calcul the mask position with numpy : 0.056981801986694336 nb_pixel_total : 33467 time to create 1 rle with old method : 0.03782916069030762 time for calcul the mask position with numpy : 0.05438542366027832 nb_pixel_total : 30298 time to create 1 rle with old method : 0.03376936912536621 time for calcul the mask position with numpy : 0.055133819580078125 nb_pixel_total : 137174 time to create 1 rle with old method : 0.15169596672058105 time for calcul the mask position with numpy : 0.05740976333618164 nb_pixel_total : 23665 time to create 1 rle with old method : 0.027209997177124023 time for calcul the mask position with numpy : 0.05460548400878906 nb_pixel_total : 81752 time to create 1 rle with old method : 0.09023857116699219 time for calcul the mask position with numpy : 0.05563211441040039 nb_pixel_total : 234279 time to create 1 rle with new method : 0.7224113941192627 time for calcul the mask position with numpy : 0.059441566467285156 nb_pixel_total : 434870 time to create 1 rle with new method : 0.6730742454528809 time for calcul the mask position with numpy : 0.060980796813964844 nb_pixel_total : 81494 time to create 1 rle with old method : 0.08901143074035645 time for calcul the mask position with numpy : 0.05428147315979004 nb_pixel_total : 110691 time to create 1 rle with old method : 0.12108850479125977 time for calcul the mask position with numpy : 0.05474591255187988 nb_pixel_total : 203 time to create 1 rle with old method : 0.0005609989166259766 time for calcul the mask position with numpy : 0.053359270095825195 nb_pixel_total : 36106 time to create 1 rle with old method : 0.04099416732788086 create new chi : 24.407079219818115 time to delete rle : 0.009252548217773438 batch 1 Loaded 67 chid ids of type : 4855 Number RLEs to save : 61032 TO DO : save crop sub photo not yet done ! save time : 3.236097574234009 nb_obj : 71 nb_hashtags : 9 time to prepare the origin masks : 67.92556166648865 time for calcul the mask position with numpy : 0.7853672504425049 nb_pixel_total : 4600126 time to create 1 rle with new method : 2.1458675861358643 time for calcul the mask position with numpy : 0.053934335708618164 nb_pixel_total : 29669 time to create 1 rle with old method : 0.034287452697753906 time for calcul the mask position with numpy : 0.05363345146179199 nb_pixel_total : 11590 time to create 1 rle with old method : 0.01303410530090332 time for calcul the mask position with numpy : 0.06119203567504883 nb_pixel_total : 279483 time to create 1 rle with new method : 0.9343526363372803 time for calcul the mask position with numpy : 0.05382251739501953 nb_pixel_total : 42701 time to create 1 rle with old method : 0.04746127128601074 time for calcul the mask position with numpy : 0.053359031677246094 nb_pixel_total : 7757 time to create 1 rle with old method : 0.008861541748046875 time for calcul the mask position with numpy : 0.05588102340698242 nb_pixel_total : 386178 time to create 1 rle with new method : 1.4251816272735596 time for calcul the mask position with numpy : 0.06898808479309082 nb_pixel_total : 541617 time to create 1 rle with new method : 1.8537788391113281 time for calcul the mask position with numpy : 0.05922651290893555 nb_pixel_total : 9204 time to create 1 rle with old method : 0.014497041702270508 time for calcul the mask position with numpy : 0.06286239624023438 nb_pixel_total : 4360 time to create 1 rle with old method : 0.007840871810913086 time for calcul the mask position with numpy : 0.0559382438659668 nb_pixel_total : 26931 time to create 1 rle with old method : 0.029746055603027344 time for calcul the mask position with numpy : 0.05381202697753906 nb_pixel_total : 53 time to create 1 rle with old method : 0.00024175643920898438 time for calcul the mask position with numpy : 0.054947614669799805 nb_pixel_total : 53012 time to create 1 rle with old method : 0.06135392189025879 time for calcul the mask position with numpy : 0.05812811851501465 nb_pixel_total : 131837 time to create 1 rle with old method : 0.14589762687683105 time for calcul the mask position with numpy : 0.060108184814453125 nb_pixel_total : 35089 time to create 1 rle with old method : 0.041510581970214844 time for calcul the mask position with numpy : 0.05711650848388672 nb_pixel_total : 45141 time to create 1 rle with old method : 0.051393747329711914 time for calcul the mask position with numpy : 0.05649375915527344 nb_pixel_total : 402077 time to create 1 rle with new method : 1.6606881618499756 time for calcul the mask position with numpy : 0.05399942398071289 nb_pixel_total : 35369 time to create 1 rle with old method : 0.03969907760620117 time for calcul the mask position with numpy : 0.05437350273132324 nb_pixel_total : 29306 time to create 1 rle with old method : 0.03376340866088867 time for calcul the mask position with numpy : 0.05703592300415039 nb_pixel_total : 62161 time to create 1 rle with old method : 0.10382080078125 time for calcul the mask position with numpy : 0.06448507308959961 nb_pixel_total : 48207 time to create 1 rle with old method : 0.0768582820892334 time for calcul the mask position with numpy : 0.055550336837768555 nb_pixel_total : 123599 time to create 1 rle with old method : 0.14599347114562988 time for calcul the mask position with numpy : 0.05610918998718262 nb_pixel_total : 55060 time to create 1 rle with old method : 0.06967687606811523 time for calcul the mask position with numpy : 0.05542874336242676 nb_pixel_total : 1732 time to create 1 rle with old method : 0.0023093223571777344 time for calcul the mask position with numpy : 0.05595850944519043 nb_pixel_total : 36271 time to create 1 rle with old method : 0.044692277908325195 time for calcul the mask position with numpy : 0.05578255653381348 nb_pixel_total : 192943 time to create 1 rle with new method : 1.582124948501587 time for calcul the mask position with numpy : 0.054927825927734375 nb_pixel_total : 138116 time to create 1 rle with old method : 0.15020155906677246 time for calcul the mask position with numpy : 0.05615806579589844 nb_pixel_total : 175753 time to create 1 rle with new method : 1.3688123226165771 time for calcul the mask position with numpy : 0.057684898376464844 nb_pixel_total : 12546 time to create 1 rle with old method : 0.01448965072631836 time for calcul the mask position with numpy : 0.05497169494628906 nb_pixel_total : 143857 time to create 1 rle with old method : 0.1815500259399414 time for calcul the mask position with numpy : 0.05815601348876953 nb_pixel_total : 98674 time to create 1 rle with old method : 0.1329817771911621 time for calcul the mask position with numpy : 0.054404258728027344 nb_pixel_total : 124203 time to create 1 rle with old method : 0.13487958908081055 time for calcul the mask position with numpy : 0.05433821678161621 nb_pixel_total : 121734 time to create 1 rle with old method : 0.13721394538879395 time for calcul the mask position with numpy : 0.05328989028930664 nb_pixel_total : 30425 time to create 1 rle with old method : 0.03683137893676758 time for calcul the mask position with numpy : 0.053788185119628906 nb_pixel_total : 277296 time to create 1 rle with new method : 2.2048304080963135 time for calcul the mask position with numpy : 0.05302715301513672 nb_pixel_total : 30561 time to create 1 rle with old method : 0.03402280807495117 time for calcul the mask position with numpy : 0.054926395416259766 nb_pixel_total : 17720 time to create 1 rle with old method : 0.021473169326782227 time for calcul the mask position with numpy : 0.05697941780090332 nb_pixel_total : 227065 time to create 1 rle with new method : 1.2813644409179688 time for calcul the mask position with numpy : 0.055399417877197266 nb_pixel_total : 196761 time to create 1 rle with new method : 1.3737742900848389 time for calcul the mask position with numpy : 0.061576128005981445 nb_pixel_total : 80511 time to create 1 rle with old method : 0.09096026420593262 time for calcul the mask position with numpy : 0.05618166923522949 nb_pixel_total : 100365 time to create 1 rle with old method : 0.1300194263458252 time for calcul the mask position with numpy : 0.07113075256347656 nb_pixel_total : 1220870 time to create 1 rle with new method : 1.0779550075531006 time for calcul the mask position with numpy : 0.058237552642822266 nb_pixel_total : 510097 time to create 1 rle with new method : 1.255265712738037 time for calcul the mask position with numpy : 0.053334712982177734 nb_pixel_total : 58219 time to create 1 rle with old method : 0.06258749961853027 time for calcul the mask position with numpy : 0.05185508728027344 nb_pixel_total : 2351 time to create 1 rle with old method : 0.003195524215698242 time for calcul the mask position with numpy : 0.05293011665344238 nb_pixel_total : 470 time to create 1 rle with old method : 0.0010004043579101562 time for calcul the mask position with numpy : 0.05349421501159668 nb_pixel_total : 166352 time to create 1 rle with new method : 1.029691219329834 time for calcul the mask position with numpy : 0.0547635555267334 nb_pixel_total : 220334 time to create 1 rle with new method : 2.2554962635040283 time for calcul the mask position with numpy : 0.054093360900878906 nb_pixel_total : 31760 time to create 1 rle with old method : 0.034951210021972656 time for calcul the mask position with numpy : 0.05339860916137695 nb_pixel_total : 144825 time to create 1 rle with old method : 0.15496468544006348 time for calcul the mask position with numpy : 0.05111861228942871 nb_pixel_total : 7693 time to create 1 rle with old method : 0.0085906982421875 time for calcul the mask position with numpy : 0.05217885971069336 nb_pixel_total : 173221 time to create 1 rle with new method : 1.0193462371826172 time for calcul the mask position with numpy : 0.054532527923583984 nb_pixel_total : 144150 time to create 1 rle with old method : 0.159165620803833 time for calcul the mask position with numpy : 0.06127762794494629 nb_pixel_total : 4344 time to create 1 rle with old method : 0.017400503158569336 time for calcul the mask position with numpy : 0.05661630630493164 nb_pixel_total : 8778 time to create 1 rle with old method : 0.010663032531738281 time for calcul the mask position with numpy : 0.053919315338134766 nb_pixel_total : 105 time to create 1 rle with old method : 0.0002949237823486328 time for calcul the mask position with numpy : 0.05503416061401367 nb_pixel_total : 142227 time to create 1 rle with old method : 0.1558701992034912 time for calcul the mask position with numpy : 0.058225154876708984 nb_pixel_total : 54209 time to create 1 rle with old method : 0.06103777885437012 time for calcul the mask position with numpy : 0.05314779281616211 nb_pixel_total : 20 time to create 1 rle with old method : 5.9604644775390625e-05 time for calcul the mask position with numpy : 0.05569767951965332 nb_pixel_total : 21430 time to create 1 rle with old method : 0.023894548416137695 time for calcul the mask position with numpy : 0.0549929141998291 nb_pixel_total : 30927 time to create 1 rle with old method : 0.038055419921875 time for calcul the mask position with numpy : 0.05808520317077637 nb_pixel_total : 534597 time to create 1 rle with new method : 1.0300650596618652 time for calcul the mask position with numpy : 0.05495429039001465 nb_pixel_total : 89062 time to create 1 rle with old method : 0.10100769996643066 time for calcul the mask position with numpy : 0.05383467674255371 nb_pixel_total : 2945 time to create 1 rle with old method : 0.0034949779510498047 time for calcul the mask position with numpy : 0.0551912784576416 nb_pixel_total : 211561 time to create 1 rle with new method : 1.1942343711853027 time for calcul the mask position with numpy : 0.05373191833496094 nb_pixel_total : 16568 time to create 1 rle with old method : 0.01817488670349121 time for calcul the mask position with numpy : 0.058681488037109375 nb_pixel_total : 137593 time to create 1 rle with old method : 0.1676344871520996 time for calcul the mask position with numpy : 0.053705453872680664 nb_pixel_total : 2997 time to create 1 rle with old method : 0.003640890121459961 time for calcul the mask position with numpy : 0.05404925346374512 nb_pixel_total : 38021 time to create 1 rle with old method : 0.041657447814941406 time for calcul the mask position with numpy : 0.05396389961242676 nb_pixel_total : 13334 time to create 1 rle with old method : 0.014383792877197266 time for calcul the mask position with numpy : 0.05319952964782715 nb_pixel_total : 22620 time to create 1 rle with old method : 0.025041818618774414 time for calcul the mask position with numpy : 0.05537557601928711 nb_pixel_total : 460 time to create 1 rle with old method : 0.0009961128234863281 create new chi : 33.40864133834839 time to delete rle : 0.006310939788818359 batch 1 Loaded 72 chid ids of type : 4855 Number RLEs to save : 59645 TO DO : save crop sub photo not yet done ! save time : 4.449774503707886 nb_obj : 50 nb_hashtags : 9 time to prepare the origin masks : 41.586838722229004 time for calcul the mask position with numpy : 0.6403605937957764 nb_pixel_total : 3365592 time to create 1 rle with new method : 2.2474608421325684 time for calcul the mask position with numpy : 0.054456233978271484 nb_pixel_total : 21444 time to create 1 rle with old method : 0.024106979370117188 time for calcul the mask position with numpy : 0.05617880821228027 nb_pixel_total : 137710 time to create 1 rle with old method : 0.15047597885131836 time for calcul the mask position with numpy : 0.05481243133544922 nb_pixel_total : 60274 time to create 1 rle with old method : 0.06451940536499023 time for calcul the mask position with numpy : 0.05380868911743164 nb_pixel_total : 65543 time to create 1 rle with old method : 0.07055449485778809 time for calcul the mask position with numpy : 0.05692768096923828 nb_pixel_total : 292592 time to create 1 rle with new method : 1.6036527156829834 time for calcul the mask position with numpy : 0.055719852447509766 nb_pixel_total : 451384 time to create 1 rle with new method : 1.6754145622253418 time for calcul the mask position with numpy : 0.055077552795410156 nb_pixel_total : 49985 time to create 1 rle with old method : 0.05526423454284668 time for calcul the mask position with numpy : 0.05346846580505371 nb_pixel_total : 33023 time to create 1 rle with old method : 0.036803245544433594 time for calcul the mask position with numpy : 0.05376625061035156 nb_pixel_total : 238597 time to create 1 rle with new method : 1.1462345123291016 time for calcul the mask position with numpy : 0.05908536911010742 nb_pixel_total : 146367 time to create 1 rle with old method : 0.16031455993652344 time for calcul the mask position with numpy : 0.06501245498657227 nb_pixel_total : 809961 time to create 1 rle with new method : 1.1701676845550537 time for calcul the mask position with numpy : 0.06187844276428223 nb_pixel_total : 9362 time to create 1 rle with old method : 0.011868715286254883 time for calcul the mask position with numpy : 0.05416989326477051 nb_pixel_total : 58566 time to create 1 rle with old method : 0.06492042541503906 time for calcul the mask position with numpy : 0.05556607246398926 nb_pixel_total : 301362 time to create 1 rle with new method : 1.2333204746246338 time for calcul the mask position with numpy : 0.055539608001708984 nb_pixel_total : 153875 time to create 1 rle with new method : 1.4300892353057861 time for calcul the mask position with numpy : 0.0561978816986084 nb_pixel_total : 4540 time to create 1 rle with old method : 0.01124262809753418 time for calcul the mask position with numpy : 0.055214881896972656 nb_pixel_total : 138968 time to create 1 rle with old method : 0.15210437774658203 time for calcul the mask position with numpy : 0.0563664436340332 nb_pixel_total : 64676 time to create 1 rle with old method : 0.0699760913848877 time for calcul the mask position with numpy : 0.054305315017700195 nb_pixel_total : 88561 time to create 1 rle with old method : 0.12438511848449707 time for calcul the mask position with numpy : 0.06323981285095215 nb_pixel_total : 951664 time to create 1 rle with new method : 2.560941696166992 time for calcul the mask position with numpy : 0.06210970878601074 nb_pixel_total : 242598 time to create 1 rle with new method : 1.714940071105957 time for calcul the mask position with numpy : 0.05451226234436035 nb_pixel_total : 78186 time to create 1 rle with old method : 0.10954618453979492 time for calcul the mask position with numpy : 0.05628514289855957 nb_pixel_total : 5737 time to create 1 rle with old method : 0.006619691848754883 time for calcul the mask position with numpy : 0.05509305000305176 nb_pixel_total : 5167 time to create 1 rle with old method : 0.005944490432739258 time for calcul the mask position with numpy : 0.05634188652038574 nb_pixel_total : 63311 time to create 1 rle with old method : 0.09507226943969727 time for calcul the mask position with numpy : 0.05419754981994629 nb_pixel_total : 15870 time to create 1 rle with old method : 0.017451763153076172 time for calcul the mask position with numpy : 0.0537109375 nb_pixel_total : 815 time to create 1 rle with old method : 0.0010724067687988281 time for calcul the mask position with numpy : 0.05462050437927246 nb_pixel_total : 37459 time to create 1 rle with old method : 0.04114651679992676 time for calcul the mask position with numpy : 0.05713033676147461 nb_pixel_total : 10608 time to create 1 rle with old method : 0.012735128402709961 time for calcul the mask position with numpy : 0.056227684020996094 nb_pixel_total : 293468 time to create 1 rle with new method : 1.6290416717529297 time for calcul the mask position with numpy : 0.05402398109436035 nb_pixel_total : 19338 time to create 1 rle with old method : 0.021019935607910156 time for calcul the mask position with numpy : 0.05580615997314453 nb_pixel_total : 16856 time to create 1 rle with old method : 0.018790245056152344 time for calcul the mask position with numpy : 0.05496072769165039 nb_pixel_total : 217726 time to create 1 rle with new method : 1.2420108318328857 time for calcul the mask position with numpy : 0.05430865287780762 nb_pixel_total : 5772 time to create 1 rle with old method : 0.007079124450683594 time for calcul the mask position with numpy : 0.06292319297790527 nb_pixel_total : 102725 time to create 1 rle with old method : 0.121795654296875 time for calcul the mask position with numpy : 0.05487227439880371 nb_pixel_total : 5243 time to create 1 rle with old method : 0.006220579147338867 time for calcul the mask position with numpy : 0.05526590347290039 nb_pixel_total : 17456 time to create 1 rle with old method : 0.02861166000366211 time for calcul the mask position with numpy : 0.24035167694091797 nb_pixel_total : 1583217 time to create 1 rle with new method : 1.0450379848480225 time for calcul the mask position with numpy : 0.0543367862701416 nb_pixel_total : 68438 time to create 1 rle with old method : 0.07554149627685547 time for calcul the mask position with numpy : 0.06264877319335938 nb_pixel_total : 1018691 time to create 1 rle with new method : 1.742875337600708 time for calcul the mask position with numpy : 0.05999469757080078 nb_pixel_total : 70458 time to create 1 rle with old method : 0.07866883277893066 time for calcul the mask position with numpy : 0.054520606994628906 nb_pixel_total : 6642 time to create 1 rle with old method : 0.007762908935546875 time for calcul the mask position with numpy : 0.05463910102844238 nb_pixel_total : 162497 time to create 1 rle with new method : 1.5803301334381104 time for calcul the mask position with numpy : 0.054404497146606445 nb_pixel_total : 110779 time to create 1 rle with old method : 0.12153983116149902 time for calcul the mask position with numpy : 0.058640480041503906 nb_pixel_total : 683668 time to create 1 rle with new method : 1.6277379989624023 time for calcul the mask position with numpy : 0.056215763092041016 nb_pixel_total : 8484 time to create 1 rle with old method : 0.01360464096069336 time for calcul the mask position with numpy : 0.06375265121459961 nb_pixel_total : 591344 time to create 1 rle with new method : 1.34895658493042 time for calcul the mask position with numpy : 0.05400681495666504 nb_pixel_total : 11578 time to create 1 rle with old method : 0.013390302658081055 time for calcul the mask position with numpy : 0.05434298515319824 nb_pixel_total : 79567 time to create 1 rle with old method : 0.0879206657409668 time for calcul the mask position with numpy : 0.053749799728393555 nb_pixel_total : 1456 time to create 1 rle with old method : 0.0019464492797851562 create new chi : 31.32799792289734 time to delete rle : 0.004199504852294922 batch 1 Loaded 51 chid ids of type : 4855 Number RLEs to save : 50630 TO DO : save crop sub photo not yet done ! save time : 2.8353617191314697 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 25.040836334228516 time for calcul the mask position with numpy : 0.11426687240600586 nb_pixel_total : 1893982 time to create 1 rle with new method : 1.1104001998901367 time for calcul the mask position with numpy : 0.0789330005645752 nb_pixel_total : 16383 time to create 1 rle with old method : 0.02059769630432129 time for calcul the mask position with numpy : 0.07770109176635742 nb_pixel_total : 36096 time to create 1 rle with old method : 0.04551553726196289 time for calcul the mask position with numpy : 0.0987551212310791 nb_pixel_total : 718849 time to create 1 rle with new method : 1.0573108196258545 time for calcul the mask position with numpy : 0.05027127265930176 nb_pixel_total : 119327 time to create 1 rle with old method : 0.13146352767944336 time for calcul the mask position with numpy : 0.05394124984741211 nb_pixel_total : 237101 time to create 1 rle with new method : 1.107975721359253 time for calcul the mask position with numpy : 0.0659639835357666 nb_pixel_total : 900301 time to create 1 rle with new method : 0.7176475524902344 time for calcul the mask position with numpy : 0.05493474006652832 nb_pixel_total : 635773 time to create 1 rle with new method : 1.1269714832305908 time for calcul the mask position with numpy : 0.0721290111541748 nb_pixel_total : 2817678 time to create 1 rle with new method : 1.3914549350738525 time for calcul the mask position with numpy : 0.07272195816040039 nb_pixel_total : 434323 time to create 1 rle with new method : 1.0835506916046143 time for calcul the mask position with numpy : 0.5402300357818604 nb_pixel_total : 5169387 time to create 1 rle with new method : 0.679743766784668 create new chi : 10.18829083442688 time to delete rle : 0.0034749507904052734 batch 1 Loaded 11 chid ids of type : 4855 Number RLEs to save : 29037 TO DO : save crop sub photo not yet done ! save time : 1.6962084770202637 map_output_result : {1383289817: (0.46803448879783816, 'Should be the crop_list due to order', 0.327887021980448), 1383289813: (0.46803448879783816, 'Should be the crop_list due to order', 0.34682709875679685), 1383289804: (0.46803448879783816, 'Should be the crop_list due to order', 0.5234693723316113), 1383289803: (0.46803448879783816, 'Should be the crop_list due to order', 0.14198895092033442), 1383289784: (0.46803448879783816, 'Should be the crop_list due to order', 1.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1383289817, 1383289813, 1383289804, 1383289803, 1383289784] Looping around the photos to save general results len do output : 5 /1383289817.Didn't retrieve data . /1383289813.Didn't retrieve data . /1383289804.Didn't retrieve data . /1383289803.Didn't retrieve data . /1383289784.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289817', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289813', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289804', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289803', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289784', None, None, None, None, None, '3709895') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.02328348159790039 save_final save missing photos in datou_result : time spend for datou_step_exec : 400.5328207015991 time spend to save output : 0.11173105239868164 total time spend for step 5 : 400.6445517539978 step6:crop_condition Fri Sep 12 10:51:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 281 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3015255 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667136_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 39 photos in the portfolio 3015255 time of upload the photos Elapsed time : 27.852044105529785 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 57 About to insert : list_path_to_insert length 57 new photo from crops ! About to upload 57 photos upload in portfolio : 3015255 init cache_photo without model_param we have 57 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667206_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 57 photos in the portfolio 3015255 time of upload the photos Elapsed time : 13.648321628570557 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3015255 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667224_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.8047268390655518 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3015255 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667232_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.4410700798034668 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667236_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6220901012420654 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3015255 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667250_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 16 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.194475412368774 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667257_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6276366710662842 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667260_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6694016456604004 we have finished the crop for the class : verre begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3015255 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667297_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 30 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.167612791061401 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667307_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5235638618469238 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3015255 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667314_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.703669786453247 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3015255 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667429_1976647 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 33 photos in the portfolio 3015255 time of upload the photos Elapsed time : 8.648810863494873 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1383289817, 1383289813, 1383289804, 1383289803, 1383289784] Looping around the photos to save general results len do output : 203 /1383375319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383375989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383376422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383377342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289817', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289813', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289804', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289803', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289784', None, None, None, None, None, '3709895') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 614 time used for this insertion : 0.08867430686950684 save_final save missing photos in datou_result : time spend for datou_step_exec : 357.887731552124 time spend to save output : 0.10109138488769531 total time spend for step 6 : 357.9888229370117 step7:ventilate_hashtags_in_portfolio Fri Sep 12 10:57:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26763392 get user id for portfolio 26763392 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26763392 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26763392 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26763392 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26763392 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26783717,26783718,26783719,26783720,26783721,26783726,26783728,26783729,26783730,26783731,26783732,26783733,26783735,26783736,26783737,26783738,26783739,26783740,26783741,26783742?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26763392 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1383289817, 1383289813, 1383289804, 1383289803, 1383289784] Looping around the photos to save general results len do output : 1 /26763392. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289817', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289813', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289804', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289803', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289784', None, None, None, None, None, '3709895') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015579700469970703 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.4879865646362305 time spend to save output : 0.01584315299987793 total time spend for step 7 : 4.503829717636108 step8:final Fri Sep 12 10:57:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1383289817: ('0.34103424212035666',), 1383289813: ('0.34103424212035666',), 1383289804: ('0.34103424212035666',), 1383289803: ('0.34103424212035666',), 1383289784: ('0.34103424212035666',)} new output for save of step final : {1383289817: ('0.34103424212035666',), 1383289813: ('0.34103424212035666',), 1383289804: ('0.34103424212035666',), 1383289803: ('0.34103424212035666',), 1383289784: ('0.34103424212035666',)} [1383289817, 1383289813, 1383289804, 1383289803, 1383289784] Looping around the photos to save general results len do output : 5 /1383289817.Didn't retrieve data . /1383289813.Didn't retrieve data . /1383289804.Didn't retrieve data . /1383289803.Didn't retrieve data . /1383289784.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289817', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289813', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289804', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289803', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289784', None, None, None, None, None, '3709895') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.011770963668823242 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12911653518676758 time spend to save output : 0.012772798538208008 total time spend for step 8 : 0.14188933372497559 step9:velours_tree Fri Sep 12 10:57:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.5691378116607666 time spend to save output : 4.38690185546875e-05 total time spend for step 9 : 0.5691816806793213 step10:send_mail_cod Fri Sep 12 10:57:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26763392_12-09-2025_10_57_26.pdf 26783689 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267836891757667446 26783690 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267836901757667448 26783691 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267836911757667449 26783692 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267836921757667450 26783693 change filename to text .imagette267836931757667451 26783694 imagette267836941757667451 26783695 imagette267836951757667451 26783696 imagette267836961757667451 26783697 imagette267836971757667451 26783698 imagette267836981757667451 26783699 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267836991757667451 26783700 change filename to text .imagette267837001757667452 26783701 change filename to text .imagette267837011757667452 26783702 imagette267837021757667453 26783703 imagette267837031757667453 26783704 imagette267837041757667453 26783705 imagette267837051757667453 26783706 change filename to text .imagette267837061757667453 26783707 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267837071757667453 26783709 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267837091757667454 26783710 imagette267837101757667456 26783711 imagette267837111757667456 26783712 imagette267837121757667456 26783713 imagette267837131757667456 26783714 imagette267837141757667456 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26763392 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26783717,26783718,26783719,26783720,26783721,26783726,26783728,26783729,26783730,26783731,26783732,26783733,26783735,26783736,26783737,26783738,26783739,26783740,26783741,26783742?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26763392 your option no_mail is active, we will not send the real mail to your client args[1383289817] : ((1383289817, 2349.590516629589, 492609224), (1383289817, -0.2533512451777586, 496442774), '0.34103424212035666') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1383289813] : ((1383289813, 523.4247357305761, 492688767), (1383289813, -0.2672915565437822, 496442774), '0.34103424212035666') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1383289804] : ((1383289804, 1238.0179919147288, 2107751945), (1383289804, -0.34995748981457453, 496442774), '0.34103424212035666') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1383289803] : ((1383289803, 659.9934889091328, 492688767), (1383289803, -0.6065651313806212, 501862349), '0.34103424212035666') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1383289784] : ((1383289784, 461.9269740094865, 492688767), (1383289784, -1.1838587162750769, 501862349), '0.34103424212035666') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.34103424212035666 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26763392_12-09-2025_10_57_26.pdf results_Auto_P26763392_12-09-2025_10_57_26.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26763392_12-09-2025_10_57_26.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','26763392','results_Auto_P26763392_12-09-2025_10_57_26.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26763392_12-09-2025_10_57_26.pdf','pdf','','2.49','0.34103424212035666') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1383289817, 1383289813, 1383289804, 1383289803, 1383289784] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289817', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289813', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289804', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289803', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289784', None, None, None, None, None, '3709895') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012123823165893555 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.436222076416016 time spend to save output : 0.020750999450683594 total time spend for step 10 : 14.4569730758667 step11:split_time_score Fri Sep 12 10:57:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('22', 4), ('23', 1)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 11092025 26763392 Nombre de photos uploadées : 5 / 23040 (0%) 11092025 26763392 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 11092025 26763392 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 1.7642974853515625e-05 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00040340423583984375 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22108149528503418 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2967293262578312 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26763389_11-09-2025_21_03_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26763389 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26763389 AND mptpi.`type`=4855 To do Qualite : 0.40952757973689263 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26763391_11-09-2025_20_38_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26763391 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26763391 AND mptpi.`type`=4855 To do Qualite : 0.34103424212035666 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26763392_12-09-2025_10_57_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26763392 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26763392 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'11092025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1383289817, 1383289813, 1383289804, 1383289803, 1383289784] Looping around the photos to save general results len do output : 1 /26763392Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289817', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289813', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289804', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289803', None, None, None, None, None, '3709895') ('4741', None, None, None, None, None, None, None, '3709895') ('4741', '26763392', '1383289784', None, None, None, None, None, '3709895') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01249074935913086 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6023991107940674 time spend to save output : 0.012752532958984375 total time spend for step 11 : 0.6151516437530518 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 596.35user 300.92system 16:17.94elapsed 91%CPU (0avgtext+0avgdata 6815988maxresident)k 3776720inputs+617480outputs (47061major+46278772minor)pagefaults 0swaps