python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3657302 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['3623872'] with mtr_portfolio_ids : ['26292108'] and first list_photo_ids : [] new path : /proc/3657302/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 1.1435344219207764 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Thu Aug 28 13:41:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10603 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-28 13:41:34.096765: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-28 13:41:34.124698: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-28 13:41:34.126932: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f41f8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-28 13:41:34.127017: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-28 13:41:34.131254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-28 13:41:34.317122: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x264ee2f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-28 13:41:34.317187: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-28 13:41:34.318597: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:41:34.319190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:41:34.322669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:41:34.325861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:41:34.326417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:41:34.329279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:41:34.330416: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:41:34.335221: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:41:34.336747: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:41:34.336828: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:41:34.337616: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 13:41:34.337631: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 13:41:34.337640: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 13:41:34.338986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9821 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-28 13:41:34.614086: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:41:34.614229: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:41:34.614260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:41:34.614287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:41:34.614312: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:41:34.614336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:41:34.614360: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:41:34.614385: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:41:34.616559: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:41:34.618119: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:41:34.618150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:41:34.618164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:41:34.618177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:41:34.618205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:41:34.618219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:41:34.618232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:41:34.618245: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:41:34.619480: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:41:34.619525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 13:41:34.619534: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 13:41:34.619542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 13:41:34.620869: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9821 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-28 13:41:47.681833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:41:47.857093: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.66250 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.35000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.66250 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.22500 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 3657574 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5090 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10379 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.004439592361450195 nb_pixel_total : 139085 time to create 1 rle with old method : 0.17902445793151855 length of segment : 431 time for calcul the mask position with numpy : 0.002295255661010742 nb_pixel_total : 101064 time to create 1 rle with old method : 0.12863540649414062 length of segment : 339 time for calcul the mask position with numpy : 0.0017604827880859375 nb_pixel_total : 78217 time to create 1 rle with old method : 0.10902595520019531 length of segment : 408 time for calcul the mask position with numpy : 0.001508474349975586 nb_pixel_total : 62787 time to create 1 rle with old method : 0.08574175834655762 length of segment : 237 time for calcul the mask position with numpy : 0.11059093475341797 nb_pixel_total : 610177 time to create 1 rle with new method : 0.043005943298339844 length of segment : 1065 time for calcul the mask position with numpy : 0.001672506332397461 nb_pixel_total : 107688 time to create 1 rle with old method : 0.12089014053344727 length of segment : 400 time for calcul the mask position with numpy : 0.0006997585296630859 nb_pixel_total : 25570 time to create 1 rle with old method : 0.028378725051879883 length of segment : 334 time for calcul the mask position with numpy : 0.00014972686767578125 nb_pixel_total : 4514 time to create 1 rle with old method : 0.005559444427490234 length of segment : 58 time for calcul the mask position with numpy : 0.0006418228149414062 nb_pixel_total : 24563 time to create 1 rle with old method : 0.028413057327270508 length of segment : 181 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 8656 time to create 1 rle with old method : 0.010211467742919922 length of segment : 268 time for calcul the mask position with numpy : 0.004200935363769531 nb_pixel_total : 255948 time to create 1 rle with new method : 0.02353191375732422 length of segment : 610 time for calcul the mask position with numpy : 0.0018124580383300781 nb_pixel_total : 90165 time to create 1 rle with old method : 0.10276579856872559 length of segment : 512 time for calcul the mask position with numpy : 0.0012433528900146484 nb_pixel_total : 72302 time to create 1 rle with old method : 0.09238123893737793 length of segment : 314 time for calcul the mask position with numpy : 0.0008857250213623047 nb_pixel_total : 48388 time to create 1 rle with old method : 0.05715012550354004 length of segment : 274 time for calcul the mask position with numpy : 0.000732421875 nb_pixel_total : 50433 time to create 1 rle with old method : 0.0589292049407959 length of segment : 327 time for calcul the mask position with numpy : 0.0018949508666992188 nb_pixel_total : 135486 time to create 1 rle with old method : 0.1632394790649414 length of segment : 369 time for calcul the mask position with numpy : 0.002368450164794922 nb_pixel_total : 137085 time to create 1 rle with old method : 0.1548011302947998 length of segment : 428 time for calcul the mask position with numpy : 0.0008528232574462891 nb_pixel_total : 50018 time to create 1 rle with old method : 0.05704069137573242 length of segment : 260 time for calcul the mask position with numpy : 0.005778312683105469 nb_pixel_total : 349857 time to create 1 rle with new method : 0.02688312530517578 length of segment : 527 time for calcul the mask position with numpy : 0.0009083747863769531 nb_pixel_total : 50490 time to create 1 rle with old method : 0.057797908782958984 length of segment : 267 time for calcul the mask position with numpy : 0.0016474723815917969 nb_pixel_total : 101632 time to create 1 rle with old method : 0.11432766914367676 length of segment : 637 time for calcul the mask position with numpy : 0.0010938644409179688 nb_pixel_total : 88424 time to create 1 rle with old method : 0.10093212127685547 length of segment : 298 time for calcul the mask position with numpy : 0.0009276866912841797 nb_pixel_total : 80703 time to create 1 rle with old method : 0.09185004234313965 length of segment : 280 time for calcul the mask position with numpy : 0.0040149688720703125 nb_pixel_total : 306199 time to create 1 rle with new method : 0.03551959991455078 length of segment : 713 time for calcul the mask position with numpy : 0.0323636531829834 nb_pixel_total : 1024996 time to create 1 rle with new method : 0.3451042175292969 length of segment : 747 time for calcul the mask position with numpy : 0.0013356208801269531 nb_pixel_total : 65635 time to create 1 rle with old method : 0.07349753379821777 length of segment : 465 time for calcul the mask position with numpy : 0.008593082427978516 nb_pixel_total : 354392 time to create 1 rle with new method : 0.03457498550415039 length of segment : 649 time for calcul the mask position with numpy : 0.0014727115631103516 nb_pixel_total : 109779 time to create 1 rle with old method : 0.12373471260070801 length of segment : 538 time for calcul the mask position with numpy : 0.002835512161254883 nb_pixel_total : 114876 time to create 1 rle with old method : 0.13005971908569336 length of segment : 418 time for calcul the mask position with numpy : 0.0010831356048583984 nb_pixel_total : 33500 time to create 1 rle with old method : 0.03829312324523926 length of segment : 207 time for calcul the mask position with numpy : 0.0005853176116943359 nb_pixel_total : 18342 time to create 1 rle with old method : 0.021744966506958008 length of segment : 183 time for calcul the mask position with numpy : 0.00457763671875 nb_pixel_total : 266166 time to create 1 rle with new method : 0.012193918228149414 length of segment : 562 time for calcul the mask position with numpy : 0.0009949207305908203 nb_pixel_total : 34175 time to create 1 rle with old method : 0.040450334548950195 length of segment : 364 time for calcul the mask position with numpy : 0.00033593177795410156 nb_pixel_total : 20043 time to create 1 rle with old method : 0.023357629776000977 length of segment : 205 time for calcul the mask position with numpy : 0.0005381107330322266 nb_pixel_total : 36310 time to create 1 rle with old method : 0.04290485382080078 length of segment : 210 time for calcul the mask position with numpy : 0.0014116764068603516 nb_pixel_total : 69292 time to create 1 rle with old method : 0.0809476375579834 length of segment : 230 time for calcul the mask position with numpy : 0.09873676300048828 nb_pixel_total : 1444638 time to create 1 rle with new method : 0.11017465591430664 length of segment : 1360 time for calcul the mask position with numpy : 0.009848833084106445 nb_pixel_total : 583130 time to create 1 rle with new method : 0.02300262451171875 length of segment : 868 time for calcul the mask position with numpy : 0.0037763118743896484 nb_pixel_total : 211328 time to create 1 rle with new method : 0.006623268127441406 length of segment : 214 time for calcul the mask position with numpy : 0.0007195472717285156 nb_pixel_total : 28514 time to create 1 rle with old method : 0.03260016441345215 length of segment : 299 time for calcul the mask position with numpy : 0.0009448528289794922 nb_pixel_total : 63555 time to create 1 rle with old method : 0.08508634567260742 length of segment : 246 time for calcul the mask position with numpy : 0.01639699935913086 nb_pixel_total : 311076 time to create 1 rle with new method : 0.07950973510742188 length of segment : 1182 time for calcul the mask position with numpy : 0.021730422973632812 nb_pixel_total : 865337 time to create 1 rle with new method : 0.20552468299865723 length of segment : 1287 time for calcul the mask position with numpy : 0.0010447502136230469 nb_pixel_total : 71503 time to create 1 rle with old method : 0.08009839057922363 length of segment : 238 time for calcul the mask position with numpy : 0.003317594528198242 nb_pixel_total : 134769 time to create 1 rle with old method : 0.14974212646484375 length of segment : 1393 time for calcul the mask position with numpy : 0.0008034706115722656 nb_pixel_total : 61111 time to create 1 rle with old method : 0.07152414321899414 length of segment : 235 time for calcul the mask position with numpy : 0.019872665405273438 nb_pixel_total : 796387 time to create 1 rle with new method : 0.0529942512512207 length of segment : 1163 time for calcul the mask position with numpy : 0.009907007217407227 nb_pixel_total : 549003 time to create 1 rle with new method : 0.11023783683776855 length of segment : 1049 time for calcul the mask position with numpy : 0.0032389163970947266 nb_pixel_total : 132255 time to create 1 rle with old method : 0.14530515670776367 length of segment : 1284 time for calcul the mask position with numpy : 0.14321517944335938 nb_pixel_total : 3695541 time to create 1 rle with new method : 0.4836893081665039 length of segment : 4442 time for calcul the mask position with numpy : 0.06723737716674805 nb_pixel_total : 1784671 time to create 1 rle with new method : 0.21541643142700195 length of segment : 924 time for calcul the mask position with numpy : 0.0020661354064941406 nb_pixel_total : 104068 time to create 1 rle with old method : 0.1296086311340332 length of segment : 619 time for calcul the mask position with numpy : 0.30739450454711914 nb_pixel_total : 4577388 time to create 1 rle with new method : 0.2871057987213135 length of segment : 1859 time for calcul the mask position with numpy : 0.3830277919769287 nb_pixel_total : 4583215 time to create 1 rle with new method : 0.5480618476867676 length of segment : 1646 time spent for convertir_results : 15.238166570663452 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 54 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 56.66755151748657 time spend to save output : 0.10378170013427734 total time spend for step 1 : 56.77133321762085 step2:mask_detect Thu Aug 28 13:42:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10603 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-28 13:42:31.288686: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-28 13:42:31.312571: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-28 13:42:31.314617: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f41f4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-28 13:42:31.314663: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-28 13:42:31.318252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-28 13:42:31.489615: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x27cb4d00 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-28 13:42:31.489664: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-28 13:42:31.490862: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:42:31.495455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:42:31.498827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:42:31.501773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:42:31.505952: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:42:31.512650: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:42:31.514910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:42:31.528821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:42:31.530969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:42:31.531053: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:42:31.532056: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 13:42:31.532076: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 13:42:31.532087: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 13:42:31.533803: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9821 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-28 13:42:31.671013: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:42:31.671124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:42:31.671159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:42:31.671192: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:42:31.671223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:42:31.671255: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:42:31.671285: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:42:31.671317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:42:31.673362: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:42:31.674376: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:42:31.674404: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:42:31.674421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:42:31.674436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:42:31.674451: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:42:31.674465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:42:31.674480: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:42:31.674495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:42:31.675710: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:42:31.675735: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 13:42:31.675742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 13:42:31.675750: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 13:42:31.677039: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9821 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-28 13:42:43.463811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:42:43.631455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.66250 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.35000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 59 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.66250 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 64 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.22500 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 3659598 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5311 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10447 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.007108926773071289 nb_pixel_total : 171747 time to create 1 rle with new method : 0.014576435089111328 length of segment : 549 time for calcul the mask position with numpy : 0.0021169185638427734 nb_pixel_total : 111275 time to create 1 rle with old method : 0.13972902297973633 length of segment : 344 time for calcul the mask position with numpy : 0.022489547729492188 nb_pixel_total : 1041428 time to create 1 rle with new method : 0.24333691596984863 length of segment : 1399 time for calcul the mask position with numpy : 0.009188175201416016 nb_pixel_total : 472793 time to create 1 rle with new method : 0.041101932525634766 length of segment : 1263 time for calcul the mask position with numpy : 0.012811660766601562 nb_pixel_total : 579488 time to create 1 rle with new method : 0.054419517517089844 length of segment : 977 time for calcul the mask position with numpy : 0.0008220672607421875 nb_pixel_total : 24983 time to create 1 rle with old method : 0.02980208396911621 length of segment : 207 time for calcul the mask position with numpy : 0.0007593631744384766 nb_pixel_total : 33741 time to create 1 rle with old method : 0.04073309898376465 length of segment : 189 time for calcul the mask position with numpy : 0.0019860267639160156 nb_pixel_total : 101451 time to create 1 rle with old method : 0.12125658988952637 length of segment : 422 time for calcul the mask position with numpy : 0.003927946090698242 nb_pixel_total : 225098 time to create 1 rle with new method : 0.011753082275390625 length of segment : 477 time for calcul the mask position with numpy : 0.0007419586181640625 nb_pixel_total : 26788 time to create 1 rle with old method : 0.031090497970581055 length of segment : 200 time for calcul the mask position with numpy : 0.0024356842041015625 nb_pixel_total : 121772 time to create 1 rle with old method : 0.14186596870422363 length of segment : 542 time for calcul the mask position with numpy : 0.016801118850708008 nb_pixel_total : 983450 time to create 1 rle with new method : 0.501349925994873 length of segment : 1270 time for calcul the mask position with numpy : 0.0021271705627441406 nb_pixel_total : 93526 time to create 1 rle with old method : 0.10750317573547363 length of segment : 377 time for calcul the mask position with numpy : 0.0008864402770996094 nb_pixel_total : 42555 time to create 1 rle with old method : 0.04850196838378906 length of segment : 325 time for calcul the mask position with numpy : 0.0013637542724609375 nb_pixel_total : 72816 time to create 1 rle with old method : 0.1091158390045166 length of segment : 329 time for calcul the mask position with numpy : 0.0047626495361328125 nb_pixel_total : 122987 time to create 1 rle with old method : 0.1468496322631836 length of segment : 456 time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 33063 time to create 1 rle with old method : 0.052979469299316406 length of segment : 344 time for calcul the mask position with numpy : 0.0016241073608398438 nb_pixel_total : 70390 time to create 1 rle with old method : 0.08176159858703613 length of segment : 219 time for calcul the mask position with numpy : 0.0017833709716796875 nb_pixel_total : 69930 time to create 1 rle with old method : 0.0813298225402832 length of segment : 378 time for calcul the mask position with numpy : 0.0017774105072021484 nb_pixel_total : 76788 time to create 1 rle with old method : 0.08766007423400879 length of segment : 304 time for calcul the mask position with numpy : 0.008549928665161133 nb_pixel_total : 500185 time to create 1 rle with new method : 0.02244091033935547 length of segment : 1356 time for calcul the mask position with numpy : 0.0025904178619384766 nb_pixel_total : 156495 time to create 1 rle with new method : 0.006824493408203125 length of segment : 390 time for calcul the mask position with numpy : 0.002596139907836914 nb_pixel_total : 110937 time to create 1 rle with old method : 0.14519309997558594 length of segment : 555 time for calcul the mask position with numpy : 0.001116037368774414 nb_pixel_total : 36167 time to create 1 rle with old method : 0.05045056343078613 length of segment : 306 time for calcul the mask position with numpy : 0.0024139881134033203 nb_pixel_total : 98090 time to create 1 rle with old method : 0.13018155097961426 length of segment : 298 time for calcul the mask position with numpy : 0.0016834735870361328 nb_pixel_total : 63476 time to create 1 rle with old method : 0.07448697090148926 length of segment : 347 time for calcul the mask position with numpy : 0.011635780334472656 nb_pixel_total : 479039 time to create 1 rle with new method : 0.03359389305114746 length of segment : 731 time for calcul the mask position with numpy : 0.0009551048278808594 nb_pixel_total : 46115 time to create 1 rle with old method : 0.0666806697845459 length of segment : 161 time for calcul the mask position with numpy : 0.001628875732421875 nb_pixel_total : 41098 time to create 1 rle with old method : 0.04933333396911621 length of segment : 327 time for calcul the mask position with numpy : 0.0013527870178222656 nb_pixel_total : 68950 time to create 1 rle with old method : 0.0768885612487793 length of segment : 311 time for calcul the mask position with numpy : 0.001169443130493164 nb_pixel_total : 45293 time to create 1 rle with old method : 0.05623817443847656 length of segment : 267 time for calcul the mask position with numpy : 0.000980377197265625 nb_pixel_total : 46287 time to create 1 rle with old method : 0.05171847343444824 length of segment : 328 time for calcul the mask position with numpy : 0.002836942672729492 nb_pixel_total : 147209 time to create 1 rle with old method : 0.1636209487915039 length of segment : 485 time for calcul the mask position with numpy : 0.0011148452758789062 nb_pixel_total : 38682 time to create 1 rle with old method : 0.043918609619140625 length of segment : 366 time for calcul the mask position with numpy : 0.0008838176727294922 nb_pixel_total : 43076 time to create 1 rle with old method : 0.050000905990600586 length of segment : 228 time for calcul the mask position with numpy : 0.0011191368103027344 nb_pixel_total : 45728 time to create 1 rle with old method : 0.05237579345703125 length of segment : 229 time for calcul the mask position with numpy : 0.0018570423126220703 nb_pixel_total : 94913 time to create 1 rle with old method : 0.10463500022888184 length of segment : 347 time for calcul the mask position with numpy : 0.0059893131256103516 nb_pixel_total : 259037 time to create 1 rle with new method : 0.017934799194335938 length of segment : 1242 time for calcul the mask position with numpy : 0.0009484291076660156 nb_pixel_total : 40910 time to create 1 rle with old method : 0.046684980392456055 length of segment : 261 time for calcul the mask position with numpy : 0.007088899612426758 nb_pixel_total : 336888 time to create 1 rle with new method : 0.022204160690307617 length of segment : 861 time for calcul the mask position with numpy : 0.0031709671020507812 nb_pixel_total : 152552 time to create 1 rle with new method : 0.00995492935180664 length of segment : 541 time for calcul the mask position with numpy : 0.0014905929565429688 nb_pixel_total : 71643 time to create 1 rle with old method : 0.08194112777709961 length of segment : 278 time for calcul the mask position with numpy : 0.0008399486541748047 nb_pixel_total : 38370 time to create 1 rle with old method : 0.04417920112609863 length of segment : 247 time for calcul the mask position with numpy : 0.011530399322509766 nb_pixel_total : 558807 time to create 1 rle with new method : 0.03230714797973633 length of segment : 1188 time for calcul the mask position with numpy : 0.0008490085601806641 nb_pixel_total : 46623 time to create 1 rle with old method : 0.05368614196777344 length of segment : 315 time for calcul the mask position with numpy : 0.010595083236694336 nb_pixel_total : 649457 time to create 1 rle with new method : 0.023342132568359375 length of segment : 625 time for calcul the mask position with numpy : 0.003517627716064453 nb_pixel_total : 181799 time to create 1 rle with new method : 0.01007390022277832 length of segment : 575 time for calcul the mask position with numpy : 0.0006091594696044922 nb_pixel_total : 33977 time to create 1 rle with old method : 0.039847612380981445 length of segment : 172 time for calcul the mask position with numpy : 0.03452467918395996 nb_pixel_total : 1533611 time to create 1 rle with new method : 0.8464181423187256 length of segment : 2780 time for calcul the mask position with numpy : 0.0013644695281982422 nb_pixel_total : 64649 time to create 1 rle with old method : 0.07241964340209961 length of segment : 239 time for calcul the mask position with numpy : 0.0015599727630615234 nb_pixel_total : 67339 time to create 1 rle with old method : 0.07758951187133789 length of segment : 258 time for calcul the mask position with numpy : 0.002052783966064453 nb_pixel_total : 109048 time to create 1 rle with old method : 0.12630891799926758 length of segment : 465 time for calcul the mask position with numpy : 0.011458158493041992 nb_pixel_total : 683297 time to create 1 rle with new method : 0.025896310806274414 length of segment : 595 time for calcul the mask position with numpy : 0.002613067626953125 nb_pixel_total : 130603 time to create 1 rle with old method : 0.14789986610412598 length of segment : 465 time for calcul the mask position with numpy : 0.003027677536010742 nb_pixel_total : 148290 time to create 1 rle with old method : 0.1693277359008789 length of segment : 571 time for calcul the mask position with numpy : 0.003053903579711914 nb_pixel_total : 208907 time to create 1 rle with new method : 0.007742881774902344 length of segment : 559 time for calcul the mask position with numpy : 0.002634763717651367 nb_pixel_total : 151149 time to create 1 rle with new method : 0.006916046142578125 length of segment : 460 time for calcul the mask position with numpy : 0.0025250911712646484 nb_pixel_total : 129006 time to create 1 rle with old method : 0.14378118515014648 length of segment : 720 time for calcul the mask position with numpy : 0.0034279823303222656 nb_pixel_total : 198447 time to create 1 rle with new method : 0.009395837783813477 length of segment : 597 time for calcul the mask position with numpy : 0.002462625503540039 nb_pixel_total : 133392 time to create 1 rle with old method : 0.14928317070007324 length of segment : 473 time for calcul the mask position with numpy : 0.009597539901733398 nb_pixel_total : 604216 time to create 1 rle with new method : 0.021808147430419922 length of segment : 1109 time for calcul the mask position with numpy : 0.023768901824951172 nb_pixel_total : 941193 time to create 1 rle with new method : 0.12923455238342285 length of segment : 2600 time for calcul the mask position with numpy : 0.005601167678833008 nb_pixel_total : 249993 time to create 1 rle with new method : 0.013355016708374023 length of segment : 640 time for calcul the mask position with numpy : 0.008933305740356445 nb_pixel_total : 366744 time to create 1 rle with new method : 0.024578332901000977 length of segment : 995 time for calcul the mask position with numpy : 0.00879669189453125 nb_pixel_total : 405237 time to create 1 rle with new method : 0.020557880401611328 length of segment : 690 time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 22955 time to create 1 rle with old method : 0.026768922805786133 length of segment : 132 time for calcul the mask position with numpy : 0.0010061264038085938 nb_pixel_total : 59598 time to create 1 rle with old method : 0.07002782821655273 length of segment : 233 time for calcul the mask position with numpy : 0.017201900482177734 nb_pixel_total : 950198 time to create 1 rle with new method : 0.08763551712036133 length of segment : 1348 time for calcul the mask position with numpy : 0.004440784454345703 nb_pixel_total : 121105 time to create 1 rle with old method : 0.14518189430236816 length of segment : 576 time for calcul the mask position with numpy : 0.0013244152069091797 nb_pixel_total : 64840 time to create 1 rle with old method : 0.07379364967346191 length of segment : 274 time for calcul the mask position with numpy : 0.004195213317871094 nb_pixel_total : 190885 time to create 1 rle with new method : 0.012752771377563477 length of segment : 643 time for calcul the mask position with numpy : 0.002574920654296875 nb_pixel_total : 124285 time to create 1 rle with old method : 0.15145087242126465 length of segment : 509 time for calcul the mask position with numpy : 0.0011336803436279297 nb_pixel_total : 29378 time to create 1 rle with old method : 0.03592538833618164 length of segment : 246 time for calcul the mask position with numpy : 0.006605625152587891 nb_pixel_total : 341070 time to create 1 rle with new method : 0.01990532875061035 length of segment : 831 time for calcul the mask position with numpy : 0.0011546611785888672 nb_pixel_total : 57549 time to create 1 rle with old method : 0.06696748733520508 length of segment : 329 time for calcul the mask position with numpy : 0.0018677711486816406 nb_pixel_total : 86642 time to create 1 rle with old method : 0.09976434707641602 length of segment : 497 time for calcul the mask position with numpy : 0.0008978843688964844 nb_pixel_total : 51437 time to create 1 rle with old method : 0.059122323989868164 length of segment : 261 time for calcul the mask position with numpy : 0.0006976127624511719 nb_pixel_total : 26569 time to create 1 rle with old method : 0.031754493713378906 length of segment : 169 time for calcul the mask position with numpy : 0.0011751651763916016 nb_pixel_total : 65219 time to create 1 rle with old method : 0.07673311233520508 length of segment : 346 time for calcul the mask position with numpy : 0.0034313201904296875 nb_pixel_total : 182437 time to create 1 rle with new method : 0.009204864501953125 length of segment : 673 time for calcul the mask position with numpy : 0.001268625259399414 nb_pixel_total : 65990 time to create 1 rle with old method : 0.07707762718200684 length of segment : 342 time for calcul the mask position with numpy : 0.0010540485382080078 nb_pixel_total : 44714 time to create 1 rle with old method : 0.053072214126586914 length of segment : 346 time for calcul the mask position with numpy : 0.0007481575012207031 nb_pixel_total : 26341 time to create 1 rle with old method : 0.030991554260253906 length of segment : 203 time for calcul the mask position with numpy : 0.005997896194458008 nb_pixel_total : 166124 time to create 1 rle with new method : 0.017467737197875977 length of segment : 528 time for calcul the mask position with numpy : 0.002970457077026367 nb_pixel_total : 162549 time to create 1 rle with new method : 0.008292436599731445 length of segment : 372 time for calcul the mask position with numpy : 0.002954244613647461 nb_pixel_total : 188477 time to create 1 rle with new method : 0.006983518600463867 length of segment : 479 time for calcul the mask position with numpy : 0.003032684326171875 nb_pixel_total : 135055 time to create 1 rle with old method : 0.1526942253112793 length of segment : 533 time for calcul the mask position with numpy : 0.0025081634521484375 nb_pixel_total : 120333 time to create 1 rle with old method : 0.13840389251708984 length of segment : 454 time for calcul the mask position with numpy : 0.012395143508911133 nb_pixel_total : 517174 time to create 1 rle with new method : 0.03144431114196777 length of segment : 950 time for calcul the mask position with numpy : 0.0016682147979736328 nb_pixel_total : 74820 time to create 1 rle with old method : 0.08684158325195312 length of segment : 279 time for calcul the mask position with numpy : 0.0013992786407470703 nb_pixel_total : 63882 time to create 1 rle with old method : 0.07381772994995117 length of segment : 261 time for calcul the mask position with numpy : 0.0009267330169677734 nb_pixel_total : 18283 time to create 1 rle with old method : 0.021869182586669922 length of segment : 303 time for calcul the mask position with numpy : 0.0007658004760742188 nb_pixel_total : 31236 time to create 1 rle with old method : 0.03621411323547363 length of segment : 235 time for calcul the mask position with numpy : 0.0035893917083740234 nb_pixel_total : 189060 time to create 1 rle with new method : 0.009715557098388672 length of segment : 530 time for calcul the mask position with numpy : 0.004068613052368164 nb_pixel_total : 144622 time to create 1 rle with old method : 0.1659870147705078 length of segment : 1474 time for calcul the mask position with numpy : 0.002420663833618164 nb_pixel_total : 112971 time to create 1 rle with old method : 0.1301577091217041 length of segment : 434 time for calcul the mask position with numpy : 0.007326841354370117 nb_pixel_total : 312040 time to create 1 rle with new method : 0.02144145965576172 length of segment : 688 time for calcul the mask position with numpy : 0.0015332698822021484 nb_pixel_total : 66310 time to create 1 rle with old method : 0.0908670425415039 length of segment : 345 time for calcul the mask position with numpy : 0.002752065658569336 nb_pixel_total : 120346 time to create 1 rle with old method : 0.13955283164978027 length of segment : 430 time for calcul the mask position with numpy : 0.004838705062866211 nb_pixel_total : 299542 time to create 1 rle with new method : 0.012760162353515625 length of segment : 710 time for calcul the mask position with numpy : 0.0010356903076171875 nb_pixel_total : 48152 time to create 1 rle with old method : 0.05465054512023926 length of segment : 236 time for calcul the mask position with numpy : 0.0008058547973632812 nb_pixel_total : 38893 time to create 1 rle with old method : 0.044992923736572266 length of segment : 232 time for calcul the mask position with numpy : 0.0072422027587890625 nb_pixel_total : 387373 time to create 1 rle with new method : 0.021505355834960938 length of segment : 881 time for calcul the mask position with numpy : 0.0034782886505126953 nb_pixel_total : 208144 time to create 1 rle with new method : 0.009935855865478516 length of segment : 531 time for calcul the mask position with numpy : 0.0013113021850585938 nb_pixel_total : 59976 time to create 1 rle with old method : 0.06853151321411133 length of segment : 305 time for calcul the mask position with numpy : 0.001961946487426758 nb_pixel_total : 74755 time to create 1 rle with old method : 0.08509087562561035 length of segment : 339 time for calcul the mask position with numpy : 0.000377655029296875 nb_pixel_total : 13124 time to create 1 rle with old method : 0.015038013458251953 length of segment : 106 time for calcul the mask position with numpy : 0.0005414485931396484 nb_pixel_total : 21498 time to create 1 rle with old method : 0.024942398071289062 length of segment : 210 time for calcul the mask position with numpy : 0.0012674331665039062 nb_pixel_total : 69671 time to create 1 rle with old method : 0.07730221748352051 length of segment : 367 time for calcul the mask position with numpy : 0.0012171268463134766 nb_pixel_total : 52108 time to create 1 rle with old method : 0.05902361869812012 length of segment : 340 time for calcul the mask position with numpy : 0.011209487915039062 nb_pixel_total : 517337 time to create 1 rle with new method : 0.03284597396850586 length of segment : 932 time for calcul the mask position with numpy : 0.004298210144042969 nb_pixel_total : 208914 time to create 1 rle with new method : 0.012342453002929688 length of segment : 963 time for calcul the mask position with numpy : 0.001691579818725586 nb_pixel_total : 81779 time to create 1 rle with old method : 0.0901796817779541 length of segment : 432 time for calcul the mask position with numpy : 0.0037887096405029297 nb_pixel_total : 221320 time to create 1 rle with new method : 0.010983943939208984 length of segment : 603 time for calcul the mask position with numpy : 0.002864837646484375 nb_pixel_total : 119960 time to create 1 rle with old method : 0.1499934196472168 length of segment : 338 time for calcul the mask position with numpy : 0.0010790824890136719 nb_pixel_total : 49456 time to create 1 rle with old method : 0.054955244064331055 length of segment : 250 time for calcul the mask position with numpy : 0.0013365745544433594 nb_pixel_total : 53822 time to create 1 rle with old method : 0.060044050216674805 length of segment : 254 time for calcul the mask position with numpy : 0.007104158401489258 nb_pixel_total : 395569 time to create 1 rle with new method : 0.02027606964111328 length of segment : 765 time for calcul the mask position with numpy : 0.0011699199676513672 nb_pixel_total : 62359 time to create 1 rle with old method : 0.06848955154418945 length of segment : 414 time for calcul the mask position with numpy : 0.0014503002166748047 nb_pixel_total : 55752 time to create 1 rle with old method : 0.061858177185058594 length of segment : 344 time for calcul the mask position with numpy : 0.002870321273803711 nb_pixel_total : 152190 time to create 1 rle with new method : 0.00863504409790039 length of segment : 630 time for calcul the mask position with numpy : 0.002165555953979492 nb_pixel_total : 110293 time to create 1 rle with old method : 0.12455511093139648 length of segment : 359 time for calcul the mask position with numpy : 0.0032227039337158203 nb_pixel_total : 180913 time to create 1 rle with new method : 0.008579730987548828 length of segment : 457 time for calcul the mask position with numpy : 0.0029163360595703125 nb_pixel_total : 104855 time to create 1 rle with old method : 0.1175987720489502 length of segment : 612 time for calcul the mask position with numpy : 0.00180816650390625 nb_pixel_total : 59153 time to create 1 rle with old method : 0.06870722770690918 length of segment : 464 time for calcul the mask position with numpy : 0.0019562244415283203 nb_pixel_total : 110820 time to create 1 rle with old method : 0.12270212173461914 length of segment : 348 time for calcul the mask position with numpy : 0.0018835067749023438 nb_pixel_total : 98418 time to create 1 rle with old method : 0.1127784252166748 length of segment : 358 time for calcul the mask position with numpy : 0.004803657531738281 nb_pixel_total : 267454 time to create 1 rle with new method : 0.012795448303222656 length of segment : 761 time for calcul the mask position with numpy : 0.021776676177978516 nb_pixel_total : 1436773 time to create 1 rle with new method : 0.07166123390197754 length of segment : 956 time for calcul the mask position with numpy : 0.001645803451538086 nb_pixel_total : 90618 time to create 1 rle with old method : 0.10184979438781738 length of segment : 552 time for calcul the mask position with numpy : 0.009992361068725586 nb_pixel_total : 549006 time to create 1 rle with new method : 0.023282766342163086 length of segment : 795 time for calcul the mask position with numpy : 0.004370450973510742 nb_pixel_total : 239287 time to create 1 rle with new method : 0.011863231658935547 length of segment : 526 time for calcul the mask position with numpy : 0.0008685588836669922 nb_pixel_total : 36656 time to create 1 rle with old method : 0.04335904121398926 length of segment : 230 time for calcul the mask position with numpy : 0.0022673606872558594 nb_pixel_total : 130967 time to create 1 rle with old method : 0.1545562744140625 length of segment : 450 time for calcul the mask position with numpy : 0.00299072265625 nb_pixel_total : 63205 time to create 1 rle with old method : 0.07569646835327148 length of segment : 542 time for calcul the mask position with numpy : 0.03122735023498535 nb_pixel_total : 157777 time to create 1 rle with new method : 0.009489774703979492 length of segment : 525 time for calcul the mask position with numpy : 0.0008165836334228516 nb_pixel_total : 28437 time to create 1 rle with old method : 0.03414654731750488 length of segment : 172 time for calcul the mask position with numpy : 0.0016932487487792969 nb_pixel_total : 92876 time to create 1 rle with old method : 0.1202690601348877 length of segment : 312 time for calcul the mask position with numpy : 0.0017502307891845703 nb_pixel_total : 70932 time to create 1 rle with old method : 0.08399653434753418 length of segment : 287 time for calcul the mask position with numpy : 0.0014913082122802734 nb_pixel_total : 81518 time to create 1 rle with old method : 0.09690332412719727 length of segment : 320 time for calcul the mask position with numpy : 0.008596658706665039 nb_pixel_total : 465997 time to create 1 rle with new method : 0.021595001220703125 length of segment : 659 time for calcul the mask position with numpy : 0.012477874755859375 nb_pixel_total : 471868 time to create 1 rle with new method : 0.048163652420043945 length of segment : 673 time for calcul the mask position with numpy : 0.004651784896850586 nb_pixel_total : 237820 time to create 1 rle with new method : 0.013242721557617188 length of segment : 583 time for calcul the mask position with numpy : 0.008477926254272461 nb_pixel_total : 426592 time to create 1 rle with new method : 0.021669626235961914 length of segment : 689 time for calcul the mask position with numpy : 0.003178834915161133 nb_pixel_total : 142905 time to create 1 rle with old method : 0.16423511505126953 length of segment : 585 time for calcul the mask position with numpy : 0.0029249191284179688 nb_pixel_total : 122969 time to create 1 rle with old method : 0.14186501502990723 length of segment : 435 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 25241 time to create 1 rle with old method : 0.02977275848388672 length of segment : 278 time for calcul the mask position with numpy : 0.0031218528747558594 nb_pixel_total : 147320 time to create 1 rle with old method : 0.17108941078186035 length of segment : 753 time for calcul the mask position with numpy : 0.0034193992614746094 nb_pixel_total : 172665 time to create 1 rle with new method : 0.009737014770507812 length of segment : 489 time for calcul the mask position with numpy : 0.0015981197357177734 nb_pixel_total : 64855 time to create 1 rle with old method : 0.07269167900085449 length of segment : 367 time for calcul the mask position with numpy : 0.0010578632354736328 nb_pixel_total : 41145 time to create 1 rle with old method : 0.04837918281555176 length of segment : 192 time for calcul the mask position with numpy : 0.02129077911376953 nb_pixel_total : 991596 time to create 1 rle with new method : 0.5517270565032959 length of segment : 1749 time for calcul the mask position with numpy : 0.0010981559753417969 nb_pixel_total : 42969 time to create 1 rle with old method : 0.04953122138977051 length of segment : 232 time for calcul the mask position with numpy : 0.0005140304565429688 nb_pixel_total : 12726 time to create 1 rle with old method : 0.015891551971435547 length of segment : 96 time for calcul the mask position with numpy : 0.0010411739349365234 nb_pixel_total : 52886 time to create 1 rle with old method : 0.061881303787231445 length of segment : 209 time for calcul the mask position with numpy : 0.001338958740234375 nb_pixel_total : 51230 time to create 1 rle with old method : 0.0586700439453125 length of segment : 273 time for calcul the mask position with numpy : 0.0014905929565429688 nb_pixel_total : 65922 time to create 1 rle with old method : 0.07524967193603516 length of segment : 339 time for calcul the mask position with numpy : 0.002226114273071289 nb_pixel_total : 89560 time to create 1 rle with old method : 0.10626053810119629 length of segment : 445 time for calcul the mask position with numpy : 0.0002512931823730469 nb_pixel_total : 11415 time to create 1 rle with old method : 0.013543128967285156 length of segment : 118 time for calcul the mask position with numpy : 0.0029785633087158203 nb_pixel_total : 128261 time to create 1 rle with old method : 0.14555120468139648 length of segment : 934 time for calcul the mask position with numpy : 0.0014586448669433594 nb_pixel_total : 73863 time to create 1 rle with old method : 0.08673691749572754 length of segment : 285 time for calcul the mask position with numpy : 0.000286102294921875 nb_pixel_total : 12014 time to create 1 rle with old method : 0.014072179794311523 length of segment : 112 time for calcul the mask position with numpy : 0.0006587505340576172 nb_pixel_total : 33910 time to create 1 rle with old method : 0.039316654205322266 length of segment : 277 time for calcul the mask position with numpy : 0.0009770393371582031 nb_pixel_total : 53760 time to create 1 rle with old method : 0.0623316764831543 length of segment : 371 time for calcul the mask position with numpy : 0.007645845413208008 nb_pixel_total : 416283 time to create 1 rle with new method : 0.020578622817993164 length of segment : 1297 time for calcul the mask position with numpy : 0.0009884834289550781 nb_pixel_total : 45423 time to create 1 rle with old method : 0.05212807655334473 length of segment : 222 time for calcul the mask position with numpy : 0.01406717300415039 nb_pixel_total : 483488 time to create 1 rle with new method : 0.09790158271789551 length of segment : 1354 time for calcul the mask position with numpy : 0.001178741455078125 nb_pixel_total : 55346 time to create 1 rle with old method : 0.06616520881652832 length of segment : 211 time for calcul the mask position with numpy : 0.004500865936279297 nb_pixel_total : 229940 time to create 1 rle with new method : 0.012868642807006836 length of segment : 581 time for calcul the mask position with numpy : 0.005924701690673828 nb_pixel_total : 31672 time to create 1 rle with old method : 0.03615260124206543 length of segment : 844 time for calcul the mask position with numpy : 0.0034041404724121094 nb_pixel_total : 139838 time to create 1 rle with old method : 0.16527938842773438 length of segment : 688 time for calcul the mask position with numpy : 0.002099275588989258 nb_pixel_total : 92288 time to create 1 rle with old method : 0.12380433082580566 length of segment : 361 time for calcul the mask position with numpy : 0.0011341571807861328 nb_pixel_total : 46645 time to create 1 rle with old method : 0.05872464179992676 length of segment : 248 time for calcul the mask position with numpy : 0.0032906532287597656 nb_pixel_total : 136277 time to create 1 rle with old method : 0.16155529022216797 length of segment : 386 time for calcul the mask position with numpy : 0.0013127326965332031 nb_pixel_total : 14438 time to create 1 rle with old method : 0.018107891082763672 length of segment : 127 time for calcul the mask position with numpy : 0.0027320384979248047 nb_pixel_total : 139712 time to create 1 rle with old method : 0.1670668125152588 length of segment : 553 time for calcul the mask position with numpy : 0.0021839141845703125 nb_pixel_total : 124632 time to create 1 rle with old method : 0.16883015632629395 length of segment : 336 time for calcul the mask position with numpy : 0.008553743362426758 nb_pixel_total : 401128 time to create 1 rle with new method : 0.02425670623779297 length of segment : 1165 time for calcul the mask position with numpy : 0.016689777374267578 nb_pixel_total : 645759 time to create 1 rle with new method : 0.054706573486328125 length of segment : 707 time for calcul the mask position with numpy : 0.0060825347900390625 nb_pixel_total : 329706 time to create 1 rle with new method : 0.018265247344970703 length of segment : 1284 time for calcul the mask position with numpy : 0.008245468139648438 nb_pixel_total : 427879 time to create 1 rle with new method : 0.023436307907104492 length of segment : 668 time for calcul the mask position with numpy : 0.004532814025878906 nb_pixel_total : 246949 time to create 1 rle with new method : 0.014595746994018555 length of segment : 528 time for calcul the mask position with numpy : 0.0026502609252929688 nb_pixel_total : 133923 time to create 1 rle with old method : 0.15449166297912598 length of segment : 371 time for calcul the mask position with numpy : 0.003458261489868164 nb_pixel_total : 176134 time to create 1 rle with new method : 0.007895946502685547 length of segment : 422 time for calcul the mask position with numpy : 0.016779422760009766 nb_pixel_total : 748556 time to create 1 rle with new method : 0.221052885055542 length of segment : 1446 time for calcul the mask position with numpy : 0.0015604496002197266 nb_pixel_total : 101394 time to create 1 rle with old method : 0.11790609359741211 length of segment : 452 time for calcul the mask position with numpy : 0.0010056495666503906 nb_pixel_total : 68391 time to create 1 rle with old method : 0.07629537582397461 length of segment : 379 time for calcul the mask position with numpy : 0.0011239051818847656 nb_pixel_total : 75438 time to create 1 rle with old method : 0.08650612831115723 length of segment : 361 time for calcul the mask position with numpy : 0.0033617019653320312 nb_pixel_total : 110796 time to create 1 rle with old method : 0.12586283683776855 length of segment : 1358 time for calcul the mask position with numpy : 0.0013179779052734375 nb_pixel_total : 81638 time to create 1 rle with old method : 0.09658980369567871 length of segment : 330 time for calcul the mask position with numpy : 0.0011925697326660156 nb_pixel_total : 81768 time to create 1 rle with old method : 0.09352445602416992 length of segment : 399 time for calcul the mask position with numpy : 0.30579042434692383 nb_pixel_total : 4581839 time to create 1 rle with new method : 0.7968151569366455 length of segment : 3247 time for calcul the mask position with numpy : 0.012916326522827148 nb_pixel_total : 160493 time to create 1 rle with new method : 0.3020358085632324 length of segment : 1594 time for calcul the mask position with numpy : 0.0041158199310302734 nb_pixel_total : 260481 time to create 1 rle with new method : 0.010469198226928711 length of segment : 612 time for calcul the mask position with numpy : 0.014861822128295898 nb_pixel_total : 809722 time to create 1 rle with new method : 0.033419132232666016 length of segment : 1411 time for calcul the mask position with numpy : 0.0004544258117675781 nb_pixel_total : 24443 time to create 1 rle with old method : 0.028191804885864258 length of segment : 147 time for calcul the mask position with numpy : 0.0008471012115478516 nb_pixel_total : 45762 time to create 1 rle with old method : 0.05242800712585449 length of segment : 311 time for calcul the mask position with numpy : 0.0011339187622070312 nb_pixel_total : 61037 time to create 1 rle with old method : 0.07013988494873047 length of segment : 310 time for calcul the mask position with numpy : 0.022635459899902344 nb_pixel_total : 1381564 time to create 1 rle with new method : 0.31133127212524414 length of segment : 1522 time for calcul the mask position with numpy : 0.0018239021301269531 nb_pixel_total : 111192 time to create 1 rle with old method : 0.12245440483093262 length of segment : 532 time for calcul the mask position with numpy : 0.0007390975952148438 nb_pixel_total : 51659 time to create 1 rle with old method : 0.057016611099243164 length of segment : 220 time for calcul the mask position with numpy : 0.0008573532104492188 nb_pixel_total : 49189 time to create 1 rle with old method : 0.05468463897705078 length of segment : 252 time for calcul the mask position with numpy : 0.002025604248046875 nb_pixel_total : 152224 time to create 1 rle with new method : 0.005002021789550781 length of segment : 224 time for calcul the mask position with numpy : 0.010204315185546875 nb_pixel_total : 657696 time to create 1 rle with new method : 0.0350186824798584 length of segment : 705 time for calcul the mask position with numpy : 0.0035550594329833984 nb_pixel_total : 235675 time to create 1 rle with new method : 0.009725332260131836 length of segment : 941 time for calcul the mask position with numpy : 0.0007970333099365234 nb_pixel_total : 56524 time to create 1 rle with old method : 0.06288361549377441 length of segment : 180 time for calcul the mask position with numpy : 0.0012178421020507812 nb_pixel_total : 79164 time to create 1 rle with old method : 0.08886027336120605 length of segment : 247 time for calcul the mask position with numpy : 0.0027909278869628906 nb_pixel_total : 212048 time to create 1 rle with new method : 0.006783246994018555 length of segment : 354 time for calcul the mask position with numpy : 0.001638174057006836 nb_pixel_total : 61829 time to create 1 rle with old method : 0.0697333812713623 length of segment : 332 time for calcul the mask position with numpy : 0.0008523464202880859 nb_pixel_total : 28403 time to create 1 rle with old method : 0.032414913177490234 length of segment : 355 time for calcul the mask position with numpy : 0.0014014244079589844 nb_pixel_total : 65556 time to create 1 rle with old method : 0.07379031181335449 length of segment : 349 time for calcul the mask position with numpy : 0.0017151832580566406 nb_pixel_total : 124313 time to create 1 rle with old method : 0.1401963233947754 length of segment : 183 time for calcul the mask position with numpy : 0.003248929977416992 nb_pixel_total : 221434 time to create 1 rle with new method : 0.008586406707763672 length of segment : 497 time for calcul the mask position with numpy : 0.010262012481689453 nb_pixel_total : 673496 time to create 1 rle with new method : 0.02115321159362793 length of segment : 777 time for calcul the mask position with numpy : 0.004336833953857422 nb_pixel_total : 299426 time to create 1 rle with new method : 0.010715007781982422 length of segment : 664 time for calcul the mask position with numpy : 0.0026006698608398438 nb_pixel_total : 108375 time to create 1 rle with old method : 0.12248921394348145 length of segment : 507 time for calcul the mask position with numpy : 0.0036313533782958984 nb_pixel_total : 250359 time to create 1 rle with new method : 0.009032487869262695 length of segment : 607 time for calcul the mask position with numpy : 0.039995670318603516 nb_pixel_total : 2077587 time to create 1 rle with new method : 0.682114839553833 length of segment : 3245 time for calcul the mask position with numpy : 0.303757905960083 nb_pixel_total : 5150037 time to create 1 rle with new method : 0.4323136806488037 length of segment : 2791 time for calcul the mask position with numpy : 0.00703120231628418 nb_pixel_total : 142410 time to create 1 rle with old method : 0.172285795211792 length of segment : 613 time for calcul the mask position with numpy : 0.0005824565887451172 nb_pixel_total : 44226 time to create 1 rle with old method : 0.05048370361328125 length of segment : 269 time for calcul the mask position with numpy : 0.021106481552124023 nb_pixel_total : 1747193 time to create 1 rle with new method : 0.16260504722595215 length of segment : 1052 time for calcul the mask position with numpy : 0.0077915191650390625 nb_pixel_total : 639734 time to create 1 rle with new method : 0.013696670532226562 length of segment : 844 time spent for convertir_results : 46.72931241989136 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 277 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 116.08391761779785 time spend to save output : 0.3035094738006592 total time spend for step 2 : 116.38742709159851 step3:blur_detection Thu Aug 28 13:44:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 904.2086186981029 (4160, 3120) 1394.456051647153 (4160, 3120) 1204.4706771246945 (4160, 3120) 434.6533681510329 (4160, 3120) 240.80867948976717 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.015994548797607422 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.014026165008544922 save missing photos in datou_result : time spend for datou_step_exec : 1.8303391933441162 time spend to save output : 0.03438854217529297 total time spend for step 3 : 1.8647277355194092 step4:brightness Thu Aug 28 13:44:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756381290_3657302_1379845997_4705466b4c36ea9d0079d90cf799dd76.jpg treat image : temp/1756381290_3657302_1379845977_a4f75df4847dcf591bde055be4c76e97.jpg treat image : temp/1756381290_3657302_1379845594_75d3967fba0c1b60597e7c4380272abb.jpg treat image : temp/1756381290_3657302_1379845574_6517e4b56b57821cd3ad6e4ced92c31b.jpg treat image : temp/1756381290_3657302_1379845557_a6848caae80cd9742f403ceb7dd5062c.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.013913869857788086 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.013074874877929688 save missing photos in datou_result : time spend for datou_step_exec : 8.053495645523071 time spend to save output : 0.03177523612976074 total time spend for step 4 : 8.085270881652832 step5:rle_unique_nms_with_priority Thu Aug 28 13:44:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 277 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 70 nb_hashtags : 11 time to prepare the origin masks : 58.45957279205322 time for calcul the mask position with numpy : 0.5527596473693848 nb_pixel_total : 3316236 time to create 1 rle with new method : 1.4867844581604004 time for calcul the mask position with numpy : 0.05417895317077637 nb_pixel_total : 1358 time to create 1 rle with old method : 0.002031564712524414 time for calcul the mask position with numpy : 0.06568765640258789 nb_pixel_total : 533834 time to create 1 rle with new method : 1.144641637802124 time for calcul the mask position with numpy : 0.056181907653808594 nb_pixel_total : 609460 time to create 1 rle with new method : 1.4985363483428955 time for calcul the mask position with numpy : 0.053299665451049805 nb_pixel_total : 33689 time to create 1 rle with old method : 0.038895606994628906 time for calcul the mask position with numpy : 0.05497145652770996 nb_pixel_total : 450520 time to create 1 rle with new method : 1.0787343978881836 time for calcul the mask position with numpy : 0.05321073532104492 nb_pixel_total : 77948 time to create 1 rle with old method : 0.08787178993225098 time for calcul the mask position with numpy : 0.05205726623535156 nb_pixel_total : 100757 time to create 1 rle with old method : 0.11535978317260742 time for calcul the mask position with numpy : 0.05282115936279297 nb_pixel_total : 3378 time to create 1 rle with old method : 0.004220247268676758 time for calcul the mask position with numpy : 0.06490349769592285 nb_pixel_total : 973867 time to create 1 rle with new method : 1.0250036716461182 time for calcul the mask position with numpy : 0.05271577835083008 nb_pixel_total : 97956 time to create 1 rle with old method : 0.11079549789428711 time for calcul the mask position with numpy : 0.05097556114196777 nb_pixel_total : 57323 time to create 1 rle with old method : 0.0654137134552002 time for calcul the mask position with numpy : 0.05200338363647461 nb_pixel_total : 24861 time to create 1 rle with old method : 0.028239727020263672 time for calcul the mask position with numpy : 0.05202507972717285 nb_pixel_total : 171570 time to create 1 rle with new method : 1.3677785396575928 time for calcul the mask position with numpy : 0.0515894889831543 nb_pixel_total : 2684 time to create 1 rle with old method : 0.0030727386474609375 time for calcul the mask position with numpy : 0.05110573768615723 nb_pixel_total : 97 time to create 1 rle with old method : 0.0002465248107910156 time for calcul the mask position with numpy : 0.05203056335449219 nb_pixel_total : 33876 time to create 1 rle with old method : 0.0383603572845459 time for calcul the mask position with numpy : 0.05224609375 nb_pixel_total : 42943 time to create 1 rle with old method : 0.04639005661010742 time for calcul the mask position with numpy : 0.05095791816711426 nb_pixel_total : 40184 time to create 1 rle with old method : 0.04622244834899902 time for calcul the mask position with numpy : 0.05063748359680176 nb_pixel_total : 121613 time to create 1 rle with old method : 0.13783740997314453 time for calcul the mask position with numpy : 0.05271172523498535 nb_pixel_total : 122566 time to create 1 rle with old method : 0.13904523849487305 time for calcul the mask position with numpy : 0.05098724365234375 nb_pixel_total : 26637 time to create 1 rle with old method : 0.028636455535888672 time for calcul the mask position with numpy : 0.04900503158569336 nb_pixel_total : 610 time to create 1 rle with old method : 0.0008549690246582031 time for calcul the mask position with numpy : 0.04964113235473633 nb_pixel_total : 40823 time to create 1 rle with old method : 0.04504585266113281 time for calcul the mask position with numpy : 0.05221438407897949 nb_pixel_total : 37457 time to create 1 rle with old method : 0.04256010055541992 time for calcul the mask position with numpy : 0.05111408233642578 nb_pixel_total : 151466 time to create 1 rle with new method : 1.0949418544769287 time for calcul the mask position with numpy : 0.053441524505615234 nb_pixel_total : 111469 time to create 1 rle with old method : 0.12580180168151855 time for calcul the mask position with numpy : 0.05240511894226074 nb_pixel_total : 9112 time to create 1 rle with old method : 0.010837078094482422 time for calcul the mask position with numpy : 0.052471160888671875 nb_pixel_total : 146496 time to create 1 rle with old method : 0.16219711303710938 time for calcul the mask position with numpy : 0.05059027671813965 nb_pixel_total : 8536 time to create 1 rle with old method : 0.009860038757324219 time for calcul the mask position with numpy : 0.05316662788391113 nb_pixel_total : 110968 time to create 1 rle with old method : 0.13746261596679688 time for calcul the mask position with numpy : 0.06761980056762695 nb_pixel_total : 466825 time to create 1 rle with new method : 1.1892669200897217 time for calcul the mask position with numpy : 0.05551552772521973 nb_pixel_total : 28972 time to create 1 rle with old method : 0.04768872261047363 time for calcul the mask position with numpy : 0.05144047737121582 nb_pixel_total : 1860 time to create 1 rle with old method : 0.0024251937866210938 time for calcul the mask position with numpy : 0.0509800910949707 nb_pixel_total : 93364 time to create 1 rle with old method : 0.10325908660888672 time for calcul the mask position with numpy : 0.05066323280334473 nb_pixel_total : 38249 time to create 1 rle with old method : 0.04186892509460449 time for calcul the mask position with numpy : 0.05242276191711426 nb_pixel_total : 94734 time to create 1 rle with old method : 0.10854601860046387 time for calcul the mask position with numpy : 0.0506899356842041 nb_pixel_total : 69716 time to create 1 rle with old method : 0.07698655128479004 time for calcul the mask position with numpy : 0.05116844177246094 nb_pixel_total : 31571 time to create 1 rle with old method : 0.03511238098144531 time for calcul the mask position with numpy : 0.05133461952209473 nb_pixel_total : 79331 time to create 1 rle with old method : 0.09067463874816895 time for calcul the mask position with numpy : 0.05360698699951172 nb_pixel_total : 195821 time to create 1 rle with new method : 1.2017598152160645 time for calcul the mask position with numpy : 0.051381826400756836 nb_pixel_total : 29420 time to create 1 rle with old method : 0.03308677673339844 time for calcul the mask position with numpy : 0.050972700119018555 nb_pixel_total : 20490 time to create 1 rle with old method : 0.022544384002685547 time for calcul the mask position with numpy : 0.050530195236206055 nb_pixel_total : 129280 time to create 1 rle with old method : 0.14433002471923828 time for calcul the mask position with numpy : 0.05155348777770996 nb_pixel_total : 45372 time to create 1 rle with old method : 0.05246329307556152 time for calcul the mask position with numpy : 0.0519404411315918 nb_pixel_total : 36081 time to create 1 rle with old method : 0.0413515567779541 time for calcul the mask position with numpy : 0.05389404296875 nb_pixel_total : 302731 time to create 1 rle with new method : 0.9460017681121826 time for calcul the mask position with numpy : 0.051918983459472656 nb_pixel_total : 2178 time to create 1 rle with old method : 0.0027761459350585938 time for calcul the mask position with numpy : 0.05176997184753418 nb_pixel_total : 12639 time to create 1 rle with old method : 0.014431238174438477 time for calcul the mask position with numpy : 0.051384687423706055 nb_pixel_total : 62425 time to create 1 rle with old method : 0.07155060768127441 time for calcul the mask position with numpy : 0.05148005485534668 nb_pixel_total : 11242 time to create 1 rle with old method : 0.013156414031982422 time for calcul the mask position with numpy : 0.05163216590881348 nb_pixel_total : 138797 time to create 1 rle with old method : 0.15498733520507812 time for calcul the mask position with numpy : 0.049836158752441406 nb_pixel_total : 71510 time to create 1 rle with old method : 0.07944631576538086 time for calcul the mask position with numpy : 0.05002617835998535 nb_pixel_total : 25402 time to create 1 rle with old method : 0.027418136596679688 time for calcul the mask position with numpy : 0.04957008361816406 nb_pixel_total : 948 time to create 1 rle with old method : 0.0012471675872802734 time for calcul the mask position with numpy : 0.050078392028808594 nb_pixel_total : 44780 time to create 1 rle with old method : 0.048108816146850586 time for calcul the mask position with numpy : 0.05579400062561035 nb_pixel_total : 1040473 time to create 1 rle with new method : 1.0375211238861084 time for calcul the mask position with numpy : 0.05029916763305664 nb_pixel_total : 183965 time to create 1 rle with new method : 0.8888514041900635 time for calcul the mask position with numpy : 0.050011634826660156 nb_pixel_total : 8534 time to create 1 rle with old method : 0.009526491165161133 time for calcul the mask position with numpy : 0.05043649673461914 nb_pixel_total : 103393 time to create 1 rle with old method : 0.11449790000915527 time for calcul the mask position with numpy : 0.05350947380065918 nb_pixel_total : 501329 time to create 1 rle with new method : 0.9765474796295166 time for calcul the mask position with numpy : 0.055553436279296875 nb_pixel_total : 228677 time to create 1 rle with new method : 1.0579931735992432 time for calcul the mask position with numpy : 0.05416274070739746 nb_pixel_total : 477089 time to create 1 rle with new method : 1.0714242458343506 time for calcul the mask position with numpy : 0.05244088172912598 nb_pixel_total : 72774 time to create 1 rle with old method : 0.08265900611877441 time for calcul the mask position with numpy : 0.05196571350097656 nb_pixel_total : 33033 time to create 1 rle with old method : 0.03732419013977051 time for calcul the mask position with numpy : 0.0521848201751709 nb_pixel_total : 42535 time to create 1 rle with old method : 0.04873061180114746 time for calcul the mask position with numpy : 0.051160573959350586 nb_pixel_total : 45116 time to create 1 rle with old method : 0.05274844169616699 time for calcul the mask position with numpy : 0.05435609817504883 nb_pixel_total : 639452 time to create 1 rle with new method : 0.9852728843688965 time for calcul the mask position with numpy : 0.05108785629272461 nb_pixel_total : 40814 time to create 1 rle with old method : 0.045558929443359375 time for calcul the mask position with numpy : 0.051854848861694336 nb_pixel_total : 63505 time to create 1 rle with old method : 0.06943655014038086 time for calcul the mask position with numpy : 0.04980945587158203 nb_pixel_total : 4479 time to create 1 rle with old method : 0.005190134048461914 create new chi : 26.02783226966858 time to delete rle : 0.026988744735717773 batch 1 Loaded 71 chid ids of type : 4855 Number RLEs to save : 57873 TO DO : save crop sub photo not yet done ! save time : 6.244922161102295 nb_obj : 72 nb_hashtags : 8 time to prepare the origin masks : 62.71656036376953 time for calcul the mask position with numpy : 0.5178112983703613 nb_pixel_total : 3331466 time to create 1 rle with new method : 1.8990859985351562 time for calcul the mask position with numpy : 0.05254864692687988 nb_pixel_total : 87873 time to create 1 rle with old method : 0.09750938415527344 time for calcul the mask position with numpy : 0.05251598358154297 nb_pixel_total : 348185 time to create 1 rle with new method : 1.2393245697021484 time for calcul the mask position with numpy : 0.05206012725830078 nb_pixel_total : 131627 time to create 1 rle with old method : 0.14232468605041504 time for calcul the mask position with numpy : 0.05308938026428223 nb_pixel_total : 481 time to create 1 rle with old method : 0.0007584095001220703 time for calcul the mask position with numpy : 0.0521848201751709 nb_pixel_total : 340056 time to create 1 rle with new method : 1.0381169319152832 time for calcul the mask position with numpy : 0.051107168197631836 nb_pixel_total : 86076 time to create 1 rle with old method : 0.09752845764160156 time for calcul the mask position with numpy : 0.051532745361328125 nb_pixel_total : 35899 time to create 1 rle with old method : 0.03978133201599121 time for calcul the mask position with numpy : 0.05185890197753906 nb_pixel_total : 51170 time to create 1 rle with old method : 0.05644106864929199 time for calcul the mask position with numpy : 0.05419611930847168 nb_pixel_total : 404374 time to create 1 rle with new method : 1.0104763507843018 time for calcul the mask position with numpy : 0.05266714096069336 nb_pixel_total : 120116 time to create 1 rle with old method : 0.13561749458312988 time for calcul the mask position with numpy : 0.05491328239440918 nb_pixel_total : 33624 time to create 1 rle with old method : 0.04085350036621094 time for calcul the mask position with numpy : 0.051097869873046875 nb_pixel_total : 87131 time to create 1 rle with old method : 0.0994875431060791 time for calcul the mask position with numpy : 0.05190539360046387 nb_pixel_total : 23689 time to create 1 rle with old method : 0.026597023010253906 time for calcul the mask position with numpy : 0.051772117614746094 nb_pixel_total : 48550 time to create 1 rle with old method : 0.05390024185180664 time for calcul the mask position with numpy : 0.05192112922668457 nb_pixel_total : 51024 time to create 1 rle with old method : 0.05883622169494629 time for calcul the mask position with numpy : 0.053224802017211914 nb_pixel_total : 254648 time to create 1 rle with new method : 1.0024428367614746 time for calcul the mask position with numpy : 0.05097842216491699 nb_pixel_total : 44634 time to create 1 rle with old method : 0.049076080322265625 time for calcul the mask position with numpy : 0.0637967586517334 nb_pixel_total : 478433 time to create 1 rle with new method : 0.9695734977722168 time for calcul the mask position with numpy : 0.051320791244506836 nb_pixel_total : 10807 time to create 1 rle with old method : 0.013070821762084961 time for calcul the mask position with numpy : 0.05154013633728027 nb_pixel_total : 26357 time to create 1 rle with old method : 0.031072139739990234 time for calcul the mask position with numpy : 0.05142354965209961 nb_pixel_total : 955 time to create 1 rle with old method : 0.001270294189453125 time for calcul the mask position with numpy : 0.05281209945678711 nb_pixel_total : 48083 time to create 1 rle with old method : 0.05404996871948242 time for calcul the mask position with numpy : 0.05186295509338379 nb_pixel_total : 9416 time to create 1 rle with old method : 0.011035680770874023 time for calcul the mask position with numpy : 0.05247378349304199 nb_pixel_total : 134912 time to create 1 rle with old method : 0.1537036895751953 time for calcul the mask position with numpy : 0.05286669731140137 nb_pixel_total : 1510 time to create 1 rle with old method : 0.002094268798828125 time for calcul the mask position with numpy : 0.052089691162109375 nb_pixel_total : 65830 time to create 1 rle with old method : 0.07492661476135254 time for calcul the mask position with numpy : 0.05285072326660156 nb_pixel_total : 82588 time to create 1 rle with old method : 0.09856057167053223 time for calcul the mask position with numpy : 0.052292823791503906 nb_pixel_total : 38995 time to create 1 rle with old method : 0.04505562782287598 time for calcul the mask position with numpy : 0.052236080169677734 nb_pixel_total : 72074 time to create 1 rle with old method : 0.08132648468017578 time for calcul the mask position with numpy : 0.052865028381347656 nb_pixel_total : 136905 time to create 1 rle with old method : 0.15573620796203613 time for calcul the mask position with numpy : 0.05281233787536621 nb_pixel_total : 24854 time to create 1 rle with old method : 0.028925180435180664 time for calcul the mask position with numpy : 0.053194522857666016 nb_pixel_total : 188348 time to create 1 rle with new method : 0.9534931182861328 time for calcul the mask position with numpy : 0.05354762077331543 nb_pixel_total : 365593 time to create 1 rle with new method : 1.0774791240692139 time for calcul the mask position with numpy : 0.05746173858642578 nb_pixel_total : 3699 time to create 1 rle with old method : 0.00456547737121582 time for calcul the mask position with numpy : 0.054548025131225586 nb_pixel_total : 50415 time to create 1 rle with old method : 0.05902457237243652 time for calcul the mask position with numpy : 0.05361628532409668 nb_pixel_total : 26300 time to create 1 rle with old method : 0.030164003372192383 time for calcul the mask position with numpy : 0.05726265907287598 nb_pixel_total : 49018 time to create 1 rle with old method : 0.05643725395202637 time for calcul the mask position with numpy : 0.05412435531616211 nb_pixel_total : 117389 time to create 1 rle with old method : 0.13609790802001953 time for calcul the mask position with numpy : 0.05458235740661621 nb_pixel_total : 89957 time to create 1 rle with old method : 0.10423874855041504 time for calcul the mask position with numpy : 0.05324387550354004 nb_pixel_total : 69330 time to create 1 rle with old method : 0.08167481422424316 time for calcul the mask position with numpy : 0.05370473861694336 nb_pixel_total : 120032 time to create 1 rle with old method : 0.13874268531799316 time for calcul the mask position with numpy : 0.05285811424255371 nb_pixel_total : 38800 time to create 1 rle with old method : 0.04604387283325195 time for calcul the mask position with numpy : 0.052632808685302734 nb_pixel_total : 64652 time to create 1 rle with old method : 0.07379388809204102 time for calcul the mask position with numpy : 0.05267906188964844 nb_pixel_total : 33049 time to create 1 rle with old method : 0.04307675361633301 time for calcul the mask position with numpy : 0.061356544494628906 nb_pixel_total : 74738 time to create 1 rle with old method : 0.08876824378967285 time for calcul the mask position with numpy : 0.05528831481933594 nb_pixel_total : 190447 time to create 1 rle with new method : 0.8791079521179199 time for calcul the mask position with numpy : 0.05228757858276367 nb_pixel_total : 26476 time to create 1 rle with old method : 0.03228116035461426 time for calcul the mask position with numpy : 0.05398917198181152 nb_pixel_total : 293091 time to create 1 rle with new method : 1.5037519931793213 time for calcul the mask position with numpy : 0.055727243423461914 nb_pixel_total : 144192 time to create 1 rle with old method : 0.18354320526123047 time for calcul the mask position with numpy : 0.05396294593811035 nb_pixel_total : 57468 time to create 1 rle with old method : 0.06499195098876953 time for calcul the mask position with numpy : 0.053987979888916016 nb_pixel_total : 119700 time to create 1 rle with old method : 0.13760900497436523 time for calcul the mask position with numpy : 0.05294013023376465 nb_pixel_total : 50439 time to create 1 rle with old method : 0.05779743194580078 time for calcul the mask position with numpy : 0.05242729187011719 nb_pixel_total : 17026 time to create 1 rle with old method : 0.01975250244140625 time for calcul the mask position with numpy : 0.06894159317016602 nb_pixel_total : 931455 time to create 1 rle with new method : 1.0248301029205322 time for calcul the mask position with numpy : 0.05354666709899902 nb_pixel_total : 181915 time to create 1 rle with new method : 1.0845966339111328 time for calcul the mask position with numpy : 0.05871081352233887 nb_pixel_total : 394912 time to create 1 rle with new method : 1.0240402221679688 time for calcul the mask position with numpy : 0.05054354667663574 nb_pixel_total : 21431 time to create 1 rle with old method : 0.02496504783630371 time for calcul the mask position with numpy : 0.05189847946166992 nb_pixel_total : 45576 time to create 1 rle with old method : 0.053871870040893555 time for calcul the mask position with numpy : 0.05217409133911133 nb_pixel_total : 62069 time to create 1 rle with old method : 0.07220745086669922 time for calcul the mask position with numpy : 0.05904388427734375 nb_pixel_total : 919370 time to create 1 rle with new method : 1.980130672454834 time for calcul the mask position with numpy : 0.051091909408569336 nb_pixel_total : 18063 time to create 1 rle with old method : 0.020522117614746094 time for calcul the mask position with numpy : 0.054128408432006836 nb_pixel_total : 603380 time to create 1 rle with new method : 1.0269012451171875 time for calcul the mask position with numpy : 0.053118228912353516 nb_pixel_total : 31121 time to create 1 rle with old method : 0.03519320487976074 time for calcul the mask position with numpy : 0.05187225341796875 nb_pixel_total : 81486 time to create 1 rle with old method : 0.09181809425354004 time for calcul the mask position with numpy : 0.052454471588134766 nb_pixel_total : 1910 time to create 1 rle with old method : 0.002433300018310547 time for calcul the mask position with numpy : 0.05385184288024902 nb_pixel_total : 10458 time to create 1 rle with old method : 0.013310432434082031 time for calcul the mask position with numpy : 0.053636789321899414 nb_pixel_total : 298764 time to create 1 rle with new method : 0.8205692768096924 time for calcul the mask position with numpy : 0.05211663246154785 nb_pixel_total : 249680 time to create 1 rle with new method : 1.058459997177124 time for calcul the mask position with numpy : 0.051827192306518555 nb_pixel_total : 84329 time to create 1 rle with old method : 0.12024307250976562 time for calcul the mask position with numpy : 0.053800106048583984 nb_pixel_total : 161873 time to create 1 rle with new method : 0.7852435111999512 time for calcul the mask position with numpy : 0.05147528648376465 nb_pixel_total : 56004 time to create 1 rle with old method : 0.06488323211669922 time for calcul the mask position with numpy : 0.05161237716674805 nb_pixel_total : 22903 time to create 1 rle with old method : 0.025957822799682617 create new chi : 29.11626362800598 time to delete rle : 0.007256984710693359 batch 1 Loaded 73 chid ids of type : 4855 Number RLEs to save : 66135 TO DO : save crop sub photo not yet done ! save time : 5.035590887069702 nb_obj : 75 nb_hashtags : 9 time to prepare the origin masks : 69.98496341705322 time for calcul the mask position with numpy : 0.23971199989318848 nb_pixel_total : 3439377 time to create 1 rle with new method : 1.1209020614624023 time for calcul the mask position with numpy : 0.049653053283691406 nb_pixel_total : 12586 time to create 1 rle with old method : 0.03701639175415039 time for calcul the mask position with numpy : 0.05139279365539551 nb_pixel_total : 122760 time to create 1 rle with old method : 0.13161683082580566 time for calcul the mask position with numpy : 0.0523073673248291 nb_pixel_total : 352326 time to create 1 rle with new method : 0.9435725212097168 time for calcul the mask position with numpy : 0.05144500732421875 nb_pixel_total : 349955 time to create 1 rle with new method : 1.2334890365600586 time for calcul the mask position with numpy : 0.05008888244628906 nb_pixel_total : 41495 time to create 1 rle with old method : 0.05009818077087402 time for calcul the mask position with numpy : 0.06072664260864258 nb_pixel_total : 1186 time to create 1 rle with old method : 0.002478361129760742 time for calcul the mask position with numpy : 0.05543112754821777 nb_pixel_total : 34791 time to create 1 rle with old method : 0.038565635681152344 time for calcul the mask position with numpy : 0.05126357078552246 nb_pixel_total : 109110 time to create 1 rle with old method : 0.11915874481201172 time for calcul the mask position with numpy : 0.05203437805175781 nb_pixel_total : 55482 time to create 1 rle with old method : 0.06435704231262207 time for calcul the mask position with numpy : 0.050544023513793945 nb_pixel_total : 36459 time to create 1 rle with old method : 0.040749311447143555 time for calcul the mask position with numpy : 0.05044746398925781 nb_pixel_total : 81246 time to create 1 rle with old method : 0.08919787406921387 time for calcul the mask position with numpy : 0.05127716064453125 nb_pixel_total : 42646 time to create 1 rle with old method : 0.04902935028076172 time for calcul the mask position with numpy : 0.051668643951416016 nb_pixel_total : 94064 time to create 1 rle with old method : 0.10596346855163574 time for calcul the mask position with numpy : 0.049532413482666016 nb_pixel_total : 194727 time to create 1 rle with new method : 1.1073040962219238 time for calcul the mask position with numpy : 0.051378726959228516 nb_pixel_total : 1716 time to create 1 rle with old method : 0.0021123886108398438 time for calcul the mask position with numpy : 0.05119752883911133 nb_pixel_total : 11972 time to create 1 rle with old method : 0.013835668563842773 time for calcul the mask position with numpy : 0.04972529411315918 nb_pixel_total : 33385 time to create 1 rle with old method : 0.0357511043548584 time for calcul the mask position with numpy : 0.05087733268737793 nb_pixel_total : 25151 time to create 1 rle with old method : 0.026893138885498047 time for calcul the mask position with numpy : 0.04945945739746094 nb_pixel_total : 152086 time to create 1 rle with new method : 1.065164566040039 time for calcul the mask position with numpy : 0.05068659782409668 nb_pixel_total : 267 time to create 1 rle with old method : 0.0004074573516845703 time for calcul the mask position with numpy : 0.049730777740478516 nb_pixel_total : 28337 time to create 1 rle with old method : 0.030972957611083984 time for calcul the mask position with numpy : 0.05013394355773926 nb_pixel_total : 167578 time to create 1 rle with new method : 1.0984418392181396 time for calcul the mask position with numpy : 0.05159807205200195 nb_pixel_total : 51059 time to create 1 rle with old method : 0.058431148529052734 time for calcul the mask position with numpy : 0.052278995513916016 nb_pixel_total : 237026 time to create 1 rle with new method : 1.3073093891143799 time for calcul the mask position with numpy : 0.0690314769744873 nb_pixel_total : 548117 time to create 1 rle with new method : 1.3933045864105225 time for calcul the mask position with numpy : 0.051579952239990234 nb_pixel_total : 70667 time to create 1 rle with old method : 0.08044743537902832 time for calcul the mask position with numpy : 0.055342912673950195 nb_pixel_total : 829 time to create 1 rle with old method : 0.0011641979217529297 time for calcul the mask position with numpy : 0.053388118743896484 nb_pixel_total : 18212 time to create 1 rle with old method : 0.020865201950073242 time for calcul the mask position with numpy : 0.05268406867980957 nb_pixel_total : 8451 time to create 1 rle with old method : 0.009629487991333008 time for calcul the mask position with numpy : 0.05329561233520508 nb_pixel_total : 323498 time to create 1 rle with new method : 1.0853757858276367 time for calcul the mask position with numpy : 0.05138230323791504 nb_pixel_total : 65756 time to create 1 rle with old method : 0.07575583457946777 time for calcul the mask position with numpy : 0.04995417594909668 nb_pixel_total : 142880 time to create 1 rle with old method : 0.15636134147644043 time for calcul the mask position with numpy : 0.0501103401184082 nb_pixel_total : 18414 time to create 1 rle with old method : 0.020753860473632812 time for calcul the mask position with numpy : 0.05168557167053223 nb_pixel_total : 10277 time to create 1 rle with old method : 0.011361122131347656 time for calcul the mask position with numpy : 0.05133652687072754 nb_pixel_total : 109967 time to create 1 rle with old method : 0.1243443489074707 time for calcul the mask position with numpy : 0.05223536491394043 nb_pixel_total : 58786 time to create 1 rle with old method : 0.06860709190368652 time for calcul the mask position with numpy : 0.05342984199523926 nb_pixel_total : 180777 time to create 1 rle with new method : 1.2096717357635498 time for calcul the mask position with numpy : 0.04979681968688965 nb_pixel_total : 11363 time to create 1 rle with old method : 0.012089967727661133 time for calcul the mask position with numpy : 0.051184892654418945 nb_pixel_total : 8735 time to create 1 rle with old method : 0.009974241256713867 time for calcul the mask position with numpy : 0.05072975158691406 nb_pixel_total : 238710 time to create 1 rle with new method : 0.9934465885162354 time for calcul the mask position with numpy : 0.05307149887084961 nb_pixel_total : 3556 time to create 1 rle with old method : 0.004103183746337891 time for calcul the mask position with numpy : 0.051447391510009766 nb_pixel_total : 34069 time to create 1 rle with old method : 0.03855252265930176 time for calcul the mask position with numpy : 0.05221390724182129 nb_pixel_total : 136055 time to create 1 rle with old method : 0.15468525886535645 time for calcul the mask position with numpy : 0.05604887008666992 nb_pixel_total : 267086 time to create 1 rle with new method : 0.7717616558074951 time for calcul the mask position with numpy : 0.05166792869567871 nb_pixel_total : 9211 time to create 1 rle with old method : 0.011286735534667969 time for calcul the mask position with numpy : 0.0576784610748291 nb_pixel_total : 425223 time to create 1 rle with new method : 1.0989980697631836 time for calcul the mask position with numpy : 0.05427718162536621 nb_pixel_total : 136197 time to create 1 rle with old method : 0.15491747856140137 time for calcul the mask position with numpy : 0.051219940185546875 nb_pixel_total : 62811 time to create 1 rle with old method : 0.0700228214263916 time for calcul the mask position with numpy : 0.05161428451538086 nb_pixel_total : 48179 time to create 1 rle with old method : 0.05379199981689453 time for calcul the mask position with numpy : 0.06398987770080566 nb_pixel_total : 878709 time to create 1 rle with new method : 0.9542241096496582 time for calcul the mask position with numpy : 0.052567243576049805 nb_pixel_total : 87962 time to create 1 rle with old method : 0.09726476669311523 time for calcul the mask position with numpy : 0.0516819953918457 nb_pixel_total : 5352 time to create 1 rle with old method : 0.006539821624755859 time for calcul the mask position with numpy : 0.05335545539855957 nb_pixel_total : 114600 time to create 1 rle with old method : 0.12633919715881348 time for calcul the mask position with numpy : 0.05139422416687012 nb_pixel_total : 55107 time to create 1 rle with old method : 0.06064748764038086 time for calcul the mask position with numpy : 0.052043914794921875 nb_pixel_total : 130670 time to create 1 rle with old method : 0.1468653678894043 time for calcul the mask position with numpy : 0.05132150650024414 nb_pixel_total : 5441 time to create 1 rle with old method : 0.006422281265258789 time for calcul the mask position with numpy : 0.052156686782836914 nb_pixel_total : 8519 time to create 1 rle with old method : 0.010139226913452148 time for calcul the mask position with numpy : 0.05618596076965332 nb_pixel_total : 464018 time to create 1 rle with new method : 1.1030879020690918 time for calcul the mask position with numpy : 0.05409955978393555 nb_pixel_total : 98022 time to create 1 rle with old method : 0.11243462562561035 time for calcul the mask position with numpy : 0.05336356163024902 nb_pixel_total : 104786 time to create 1 rle with old method : 0.11893701553344727 time for calcul the mask position with numpy : 0.05457901954650879 nb_pixel_total : 270040 time to create 1 rle with new method : 0.9879469871520996 time for calcul the mask position with numpy : 0.05756878852844238 nb_pixel_total : 37 time to create 1 rle with old method : 0.00015473365783691406 time for calcul the mask position with numpy : 0.05230569839477539 nb_pixel_total : 4476 time to create 1 rle with old method : 0.005437612533569336 time for calcul the mask position with numpy : 0.05297112464904785 nb_pixel_total : 42539 time to create 1 rle with old method : 0.04880070686340332 time for calcul the mask position with numpy : 0.053809165954589844 nb_pixel_total : 129654 time to create 1 rle with old method : 0.14734554290771484 time for calcul the mask position with numpy : 0.05353879928588867 nb_pixel_total : 157736 time to create 1 rle with new method : 1.2612266540527344 time for calcul the mask position with numpy : 0.05412459373474121 nb_pixel_total : 37924 time to create 1 rle with old method : 0.04427647590637207 time for calcul the mask position with numpy : 0.054902076721191406 nb_pixel_total : 409522 time to create 1 rle with new method : 1.0546519756317139 time for calcul the mask position with numpy : 0.06065511703491211 nb_pixel_total : 1024653 time to create 1 rle with new method : 1.054328203201294 time for calcul the mask position with numpy : 0.052953481674194336 nb_pixel_total : 5081 time to create 1 rle with old method : 0.006270647048950195 time for calcul the mask position with numpy : 0.05276155471801758 nb_pixel_total : 108322 time to create 1 rle with old method : 0.12459349632263184 time for calcul the mask position with numpy : 0.05272531509399414 nb_pixel_total : 65584 time to create 1 rle with old method : 0.0754692554473877 time for calcul the mask position with numpy : 0.052459716796875 nb_pixel_total : 25805 time to create 1 rle with old method : 0.031328439712524414 time for calcul the mask position with numpy : 0.053444862365722656 nb_pixel_total : 110331 time to create 1 rle with old method : 0.12743306159973145 time for calcul the mask position with numpy : 0.052393436431884766 nb_pixel_total : 19697 time to create 1 rle with old method : 0.023194313049316406 create new chi : 29.07691979408264 time to delete rle : 0.004885673522949219 batch 1 Loaded 76 chid ids of type : 4855 Number RLEs to save : 59523 TO DO : save crop sub photo not yet done ! save time : 7.54083776473999 nb_obj : 44 nb_hashtags : 10 time to prepare the origin masks : 47.20714783668518 time for calcul the mask position with numpy : 0.13498544692993164 nb_pixel_total : 2211287 time to create 1 rle with new method : 1.558887243270874 time for calcul the mask position with numpy : 0.053070783615112305 nb_pixel_total : 18710 time to create 1 rle with old method : 0.021378040313720703 time for calcul the mask position with numpy : 0.0539247989654541 nb_pixel_total : 83570 time to create 1 rle with old method : 0.09985947608947754 time for calcul the mask position with numpy : 0.052611351013183594 nb_pixel_total : 864 time to create 1 rle with old method : 0.001094818115234375 time for calcul the mask position with numpy : 0.07919669151306152 nb_pixel_total : 809617 time to create 1 rle with new method : 1.129235029220581 time for calcul the mask position with numpy : 0.05328512191772461 nb_pixel_total : 210858 time to create 1 rle with new method : 0.9902083873748779 time for calcul the mask position with numpy : 0.0510709285736084 nb_pixel_total : 16486 time to create 1 rle with old method : 0.018944501876831055 time for calcul the mask position with numpy : 0.05267786979675293 nb_pixel_total : 134832 time to create 1 rle with old method : 0.14574313163757324 time for calcul the mask position with numpy : 0.050545454025268555 nb_pixel_total : 2667 time to create 1 rle with old method : 0.003050565719604492 time for calcul the mask position with numpy : 0.05058622360229492 nb_pixel_total : 6886 time to create 1 rle with old method : 0.007759809494018555 time for calcul the mask position with numpy : 0.05189967155456543 nb_pixel_total : 47234 time to create 1 rle with old method : 0.05386781692504883 time for calcul the mask position with numpy : 0.05146670341491699 nb_pixel_total : 50441 time to create 1 rle with old method : 0.055924415588378906 time for calcul the mask position with numpy : 0.0508875846862793 nb_pixel_total : 43087 time to create 1 rle with old method : 0.04734659194946289 time for calcul the mask position with numpy : 0.2209320068359375 nb_pixel_total : 1346079 time to create 1 rle with new method : 1.2824962139129639 time for calcul the mask position with numpy : 0.05373978614807129 nb_pixel_total : 110632 time to create 1 rle with old method : 0.12998437881469727 time for calcul the mask position with numpy : 0.05478620529174805 nb_pixel_total : 222137 time to create 1 rle with new method : 1.3696446418762207 time for calcul the mask position with numpy : 0.07282423973083496 nb_pixel_total : 24700 time to create 1 rle with old method : 0.04627799987792969 time for calcul the mask position with numpy : 0.07809567451477051 nb_pixel_total : 292572 time to create 1 rle with new method : 2.8046624660491943 time for calcul the mask position with numpy : 0.058829307556152344 nb_pixel_total : 205784 time to create 1 rle with new method : 1.2182400226593018 time for calcul the mask position with numpy : 0.053777217864990234 nb_pixel_total : 69060 time to create 1 rle with old method : 0.0779721736907959 time for calcul the mask position with numpy : 0.06133460998535156 nb_pixel_total : 45971 time to create 1 rle with old method : 0.05426478385925293 time for calcul the mask position with numpy : 0.05400657653808594 nb_pixel_total : 24341 time to create 1 rle with old method : 0.027918100357055664 time for calcul the mask position with numpy : 0.22425150871276855 nb_pixel_total : 2764993 time to create 1 rle with new method : 0.8405153751373291 time for calcul the mask position with numpy : 0.05252575874328613 nb_pixel_total : 175918 time to create 1 rle with new method : 0.6066460609436035 time for calcul the mask position with numpy : 0.05319786071777344 nb_pixel_total : 29701 time to create 1 rle with old method : 0.035173892974853516 time for calcul the mask position with numpy : 0.05351090431213379 nb_pixel_total : 81240 time to create 1 rle with old method : 0.0939645767211914 time for calcul the mask position with numpy : 0.053403377532958984 nb_pixel_total : 221515 time to create 1 rle with new method : 1.2848360538482666 time for calcul the mask position with numpy : 0.05395221710205078 nb_pixel_total : 68295 time to create 1 rle with old method : 0.07984542846679688 time for calcul the mask position with numpy : 0.05171060562133789 nb_pixel_total : 27821 time to create 1 rle with old method : 0.03180718421936035 time for calcul the mask position with numpy : 0.05113482475280762 nb_pixel_total : 28512 time to create 1 rle with old method : 0.03181910514831543 time for calcul the mask position with numpy : 0.05431032180786133 nb_pixel_total : 259205 time to create 1 rle with new method : 1.0382885932922363 time for calcul the mask position with numpy : 0.05920743942260742 nb_pixel_total : 747413 time to create 1 rle with new method : 0.9099574089050293 time for calcul the mask position with numpy : 0.05289959907531738 nb_pixel_total : 60971 time to create 1 rle with old method : 0.09012389183044434 time for calcul the mask position with numpy : 0.053690195083618164 nb_pixel_total : 3059 time to create 1 rle with old method : 0.003827810287475586 time for calcul the mask position with numpy : 0.05412602424621582 nb_pixel_total : 19 time to create 1 rle with old method : 0.00010132789611816406 time for calcul the mask position with numpy : 0.06556344032287598 nb_pixel_total : 1441701 time to create 1 rle with new method : 1.1530060768127441 time for calcul the mask position with numpy : 0.05337882041931152 nb_pixel_total : 29601 time to create 1 rle with old method : 0.03441500663757324 time for calcul the mask position with numpy : 0.05399656295776367 nb_pixel_total : 81629 time to create 1 rle with old method : 0.09431838989257812 time for calcul the mask position with numpy : 0.05231952667236328 nb_pixel_total : 97815 time to create 1 rle with old method : 0.11157822608947754 time for calcul the mask position with numpy : 0.0540318489074707 nb_pixel_total : 65125 time to create 1 rle with old method : 0.09949731826782227 time for calcul the mask position with numpy : 0.053182363510131836 nb_pixel_total : 49005 time to create 1 rle with old method : 0.05417609214782715 time for calcul the mask position with numpy : 0.05482316017150879 nb_pixel_total : 581528 time to create 1 rle with new method : 1.6773786544799805 time for calcul the mask position with numpy : 0.05253458023071289 nb_pixel_total : 102603 time to create 1 rle with old method : 0.12210345268249512 time for calcul the mask position with numpy : 0.0537111759185791 nb_pixel_total : 9193 time to create 1 rle with old method : 0.01531839370727539 time for calcul the mask position with numpy : 0.05298495292663574 nb_pixel_total : 74523 time to create 1 rle with old method : 0.08562326431274414 create new chi : 23.23098397254944 time to delete rle : 0.006770133972167969 batch 1 Loaded 45 chid ids of type : 4855 Number RLEs to save : 47690 TO DO : save crop sub photo not yet done ! save time : 6.169072389602661 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 29.757023334503174 time for calcul the mask position with numpy : 0.09984207153320312 nb_pixel_total : 1524453 time to create 1 rle with new method : 1.3358373641967773 time for calcul the mask position with numpy : 0.03982090950012207 nb_pixel_total : 167835 time to create 1 rle with new method : 1.2636852264404297 time for calcul the mask position with numpy : 0.04236245155334473 nb_pixel_total : 383991 time to create 1 rle with new method : 1.5739660263061523 time for calcul the mask position with numpy : 0.04259228706359863 nb_pixel_total : 51857 time to create 1 rle with old method : 0.059188127517700195 time for calcul the mask position with numpy : 0.03837847709655762 nb_pixel_total : 173669 time to create 1 rle with new method : 1.400052547454834 time for calcul the mask position with numpy : 0.06909751892089844 nb_pixel_total : 416414 time to create 1 rle with new method : 1.0924625396728516 time for calcul the mask position with numpy : 0.07401132583618164 nb_pixel_total : 77149 time to create 1 rle with old method : 0.11259174346923828 time for calcul the mask position with numpy : 0.28203558921813965 nb_pixel_total : 2874226 time to create 1 rle with new method : 1.4102146625518799 time for calcul the mask position with numpy : 0.590472936630249 nb_pixel_total : 5200064 time to create 1 rle with new method : 1.2435126304626465 time for calcul the mask position with numpy : 0.22623515129089355 nb_pixel_total : 2109542 time to create 1 rle with new method : 1.3446125984191895 create new chi : 12.716943264007568 time to delete rle : 0.003100872039794922 batch 1 Loaded 10 chid ids of type : 4855 Number RLEs to save : 24874 TO DO : save crop sub photo not yet done ! save time : 3.288465976715088 map_output_result : {1379845997: (0.41438909286852416, 'Should be the crop_list due to order', 0.3100753290143313), 1379845977: (0.41438909286852416, 'Should be the crop_list due to order', 0.2481073337971484), 1379845594: (0.41438909286852416, 'Should be the crop_list due to order', 0.2810562018066819), 1379845574: (0.41438909286852416, 'Should be the crop_list due to order', 0.2327065997244592), 1379845557: (0.41438909286852416, 'Should be the crop_list due to order', 1.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379845997, 1379845977, 1379845594, 1379845574, 1379845557] Looping around the photos to save general results len do output : 5 /1379845997.Didn't retrieve data . /1379845977.Didn't retrieve data . /1379845594.Didn't retrieve data . /1379845574.Didn't retrieve data . /1379845557.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845997', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845977', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845594', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845574', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845557', None, None, None, None, None, '3623872') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01226949691772461 save_final save missing photos in datou_result : time spend for datou_step_exec : 419.38892579078674 time spend to save output : 0.09258365631103516 total time spend for step 5 : 419.4815094470978 step6:crop_condition Thu Aug 28 13:51:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 275 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 44 About to insert : list_path_to_insert length 44 new photo from crops ! About to upload 44 photos upload in portfolio : 3015255 init cache_photo without model_param we have 44 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756381968_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 44 photos in the portfolio 3015255 time of upload the photos Elapsed time : 12.130589723587036 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 3015255 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756382014_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 56 photos in the portfolio 3015255 time of upload the photos Elapsed time : 17.45470094680786 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3015255 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756382036_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.496847629547119 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3015255 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756382044_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.2265357971191406 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756382051_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6836097240447998 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3015255 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756382067_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 20 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.892735242843628 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3015255 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756382095_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.372025489807129 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756382106_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6405389308929443 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756382115_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.3733153343200684 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3015255 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756382184_3657302 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.020209312438965 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379845997, 1379845977, 1379845594, 1379845574, 1379845557] Looping around the photos to save general results len do output : 200 /1379874063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379874999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379875000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379875001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379875003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379875004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379875005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379875007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379875008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845997', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845977', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845594', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845574', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845557', None, None, None, None, None, '3623872') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 605 time used for this insertion : 0.12370944023132324 save_final save missing photos in datou_result : time spend for datou_step_exec : 303.54235458374023 time spend to save output : 0.14423847198486328 total time spend for step 6 : 303.6865930557251 step7:ventilate_hashtags_in_portfolio Thu Aug 28 13:56:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26292108 get user id for portfolio 26292108 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292108 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292108 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292108 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292108 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/26293657,26293658,26293659,26293660,26293661,26293666,26293668,26293669,26293670,26293671,26293672,26293673,26293675,26293676,26293677,26293678,26293679,26293680,26293681,26293682?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26292108 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379845997, 1379845977, 1379845594, 1379845574, 1379845557] Looping around the photos to save general results len do output : 1 /26292108. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845997', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845977', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845594', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845574', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845557', None, None, None, None, None, '3623872') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.017052888870239258 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.355373859405518 time spend to save output : 0.017309188842773438 total time spend for step 7 : 5.372683048248291 step8:final Thu Aug 28 13:56:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379845997: ('0.2808311243033833',), 1379845977: ('0.2808311243033833',), 1379845594: ('0.2808311243033833',), 1379845574: ('0.2808311243033833',), 1379845557: ('0.2808311243033833',)} new output for save of step final : {1379845997: ('0.2808311243033833',), 1379845977: ('0.2808311243033833',), 1379845594: ('0.2808311243033833',), 1379845574: ('0.2808311243033833',), 1379845557: ('0.2808311243033833',)} [1379845997, 1379845977, 1379845594, 1379845574, 1379845557] Looping around the photos to save general results len do output : 5 /1379845997.Didn't retrieve data . /1379845977.Didn't retrieve data . /1379845594.Didn't retrieve data . /1379845574.Didn't retrieve data . /1379845557.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845997', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845977', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845594', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845574', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845557', None, None, None, None, None, '3623872') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01267862319946289 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11567974090576172 time spend to save output : 0.01292562484741211 total time spend for step 8 : 0.12860536575317383 step9:velours_tree Thu Aug 28 13:56:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.2718505859375 time spend to save output : 5.078315734863281e-05 total time spend for step 9 : 0.27190136909484863 step10:send_mail_cod Thu Aug 28 13:56:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26292108_28-08-2025_13_56_43.pdf 26293631 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262936311756382203 26293632 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262936321756382205 26293633 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262936331756382207 26293634 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262936341756382207 26293635 change filename to text .imagette262936351756382208 26293636 imagette262936361756382208 26293637 imagette262936371756382208 26293638 imagette262936381756382208 26293639 imagette262936391756382208 26293640 imagette262936401756382208 26293641 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262936411756382208 26293642 imagette262936421756382210 26293643 imagette262936431756382210 26293644 imagette262936441756382210 26293645 imagette262936451756382210 26293646 imagette262936461756382210 26293647 imagette262936471756382210 26293648 change filename to text .imagette262936481756382210 26293649 change filename to text .change filename to text .change filename to text .change filename to text .imagette262936491756382210 26293651 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262936511756382210 26293652 imagette262936521756382213 26293653 imagette262936531756382213 26293654 imagette262936541756382213 26293655 imagette262936551756382213 26293656 imagette262936561756382213 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26292108 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26293657,26293658,26293659,26293660,26293661,26293666,26293668,26293669,26293670,26293671,26293672,26293673,26293675,26293676,26293677,26293678,26293679,26293680,26293681,26293682?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26292108 your option no_mail is active, we will not send the real mail to your client args[1379845997] : ((1379845997, 904.2086186981029, 2107751945), (1379845997, -0.3152447509526931, 496442774), '0.2808311243033833') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379845977] : ((1379845977, 1394.456051647153, 2107751945), (1379845977, -0.19498158253550044, 496442774), '0.2808311243033833') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379845594] : ((1379845594, 1204.4706771246945, 2107751945), (1379845594, -0.28079092510178283, 496442774), '0.2808311243033833') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379845574] : ((1379845574, 434.6533681510329, 492688767), (1379845574, -0.31268291600511217, 496442774), '0.2808311243033833') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379845557] : ((1379845557, 240.80867948976717, 492688767), (1379845557, -1.2646668413169415, 501862349), '0.2808311243033833') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.2808311243033833 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292108_28-08-2025_13_56_43.pdf results_Auto_P26292108_28-08-2025_13_56_43.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292108_28-08-2025_13_56_43.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','26292108','results_Auto_P26292108_28-08-2025_13_56_43.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292108_28-08-2025_13_56_43.pdf','pdf','','2.79','0.2808311243033833') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379845997, 1379845977, 1379845594, 1379845574, 1379845557] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845997', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845977', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845594', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845574', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845557', None, None, None, None, None, '3623872') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.03224349021911621 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.0638906955719 time spend to save output : 0.032488107681274414 total time spend for step 10 : 14.096378803253174 step11:split_time_score Thu Aug 28 13:56:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('40', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28082025 26292108 Nombre de photos uploadées : 5 / 23040 (0%) 28082025 26292108 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 28082025 26292108 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 1.71661376953125e-05 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00033664703369140625 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20002079010009766 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2808311243033833 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292108_28-08-2025_13_56_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292108 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292108 AND mptpi.`type`=4855 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292109 order by id desc limit 1 Qualite : 0.3235829256287251 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292110_28-08-2025_13_18_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292110 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292110 AND mptpi.`type`=4855 To do Qualite : 0.5794230840386216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292111_28-08-2025_13_42_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292111 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292111 AND mptpi.`type`=4855 To do Qualite : 0.548860349869327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292112_28-08-2025_13_04_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292112 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28082025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379845997, 1379845977, 1379845594, 1379845574, 1379845557] Looping around the photos to save general results len do output : 1 /26292108Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845997', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845977', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845594', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845574', None, None, None, None, None, '3623872') ('4741', None, None, None, None, None, None, None, '3623872') ('4741', '26292108', '1379845557', None, None, None, None, None, '3623872') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01604628562927246 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5823068618774414 time spend to save output : 0.016198396682739258 total time spend for step 11 : 1.5985052585601807 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 529.53user 586.45system 15:33.51elapsed 119%CPU (0avgtext+0avgdata 6832656maxresident)k 1388640inputs+552408outputs (22395major+45739410minor)pagefaults 0swaps