python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3769125 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['3623816'] with mtr_portfolio_ids : ['26291507'] and first list_photo_ids : [] new path : /proc/3769125/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 1.0748257637023926 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Thu Aug 28 14:21:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10379 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-28 14:21:33.949666: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-28 14:21:33.976497: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-28 14:21:33.978568: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4c9c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-28 14:21:33.978627: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-28 14:21:33.982694: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-28 14:21:34.107943: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xd1585c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-28 14:21:34.107994: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-28 14:21:34.109427: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 14:21:34.109927: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 14:21:34.113534: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 14:21:34.116573: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 14:21:34.117062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 14:21:34.119922: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 14:21:34.121260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 14:21:34.126805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 14:21:34.128247: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 14:21:34.128325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 14:21:34.129128: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 14:21:34.129145: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 14:21:34.129155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 14:21:34.130467: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9613 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-28 14:21:34.407114: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 14:21:34.407240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 14:21:34.407262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 14:21:34.407281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 14:21:34.407299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 14:21:34.407318: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 14:21:34.407336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 14:21:34.407354: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 14:21:34.408893: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 14:21:34.410442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 14:21:34.410484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 14:21:34.410503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 14:21:34.410520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 14:21:34.410566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 14:21:34.410585: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 14:21:34.410602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 14:21:34.410619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 14:21:34.412131: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 14:21:34.412179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 14:21:34.412190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 14:21:34.412199: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 14:21:34.413643: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9613 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-28 14:21:48.783501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 14:21:48.964438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.91250 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 3769400 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3676 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8965 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.005537748336791992 nb_pixel_total : 121022 time to create 1 rle with old method : 0.1745281219482422 length of segment : 376 time for calcul the mask position with numpy : 0.03341102600097656 nb_pixel_total : 264654 time to create 1 rle with new method : 0.018572330474853516 length of segment : 405 time for calcul the mask position with numpy : 0.0016293525695800781 nb_pixel_total : 58414 time to create 1 rle with old method : 0.06801199913024902 length of segment : 230 time for calcul the mask position with numpy : 0.0029315948486328125 nb_pixel_total : 113795 time to create 1 rle with old method : 0.13232111930847168 length of segment : 469 time for calcul the mask position with numpy : 0.0007691383361816406 nb_pixel_total : 33592 time to create 1 rle with old method : 0.03892230987548828 length of segment : 240 time for calcul the mask position with numpy : 0.0017926692962646484 nb_pixel_total : 61416 time to create 1 rle with old method : 0.0751810073852539 length of segment : 201 time for calcul the mask position with numpy : 0.0026133060455322266 nb_pixel_total : 138009 time to create 1 rle with old method : 0.15898370742797852 length of segment : 215 time for calcul the mask position with numpy : 0.0009915828704833984 nb_pixel_total : 45910 time to create 1 rle with old method : 0.0549013614654541 length of segment : 256 time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 8034 time to create 1 rle with old method : 0.010402917861938477 length of segment : 253 time for calcul the mask position with numpy : 0.0006434917449951172 nb_pixel_total : 17162 time to create 1 rle with old method : 0.01972198486328125 length of segment : 153 time for calcul the mask position with numpy : 0.0007562637329101562 nb_pixel_total : 9194 time to create 1 rle with old method : 0.010927915573120117 length of segment : 142 time for calcul the mask position with numpy : 0.0009808540344238281 nb_pixel_total : 41789 time to create 1 rle with old method : 0.048155784606933594 length of segment : 178 time for calcul the mask position with numpy : 0.0028905868530273438 nb_pixel_total : 114540 time to create 1 rle with old method : 0.13588786125183105 length of segment : 279 time for calcul the mask position with numpy : 0.00038909912109375 nb_pixel_total : 1889 time to create 1 rle with old method : 0.002685070037841797 length of segment : 77 time for calcul the mask position with numpy : 0.0009946823120117188 nb_pixel_total : 11623 time to create 1 rle with old method : 0.015834808349609375 length of segment : 213 time for calcul the mask position with numpy : 0.0003800392150878906 nb_pixel_total : 14943 time to create 1 rle with old method : 0.021079540252685547 length of segment : 250 time for calcul the mask position with numpy : 0.001096963882446289 nb_pixel_total : 72363 time to create 1 rle with old method : 0.09099817276000977 length of segment : 352 time for calcul the mask position with numpy : 0.006148815155029297 nb_pixel_total : 232595 time to create 1 rle with new method : 0.010714054107666016 length of segment : 859 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 25178 time to create 1 rle with old method : 0.029442787170410156 length of segment : 227 time for calcul the mask position with numpy : 0.0035784244537353516 nb_pixel_total : 83054 time to create 1 rle with old method : 0.0941011905670166 length of segment : 621 time for calcul the mask position with numpy : 0.0004475116729736328 nb_pixel_total : 14683 time to create 1 rle with old method : 0.017426013946533203 length of segment : 118 time for calcul the mask position with numpy : 0.0011038780212402344 nb_pixel_total : 49032 time to create 1 rle with old method : 0.057462453842163086 length of segment : 166 time for calcul the mask position with numpy : 0.0005981922149658203 nb_pixel_total : 13173 time to create 1 rle with old method : 0.015521049499511719 length of segment : 159 time for calcul the mask position with numpy : 0.0015435218811035156 nb_pixel_total : 69639 time to create 1 rle with old method : 0.0805666446685791 length of segment : 304 time for calcul the mask position with numpy : 0.00038051605224609375 nb_pixel_total : 12308 time to create 1 rle with old method : 0.014518260955810547 length of segment : 118 time for calcul the mask position with numpy : 0.006015777587890625 nb_pixel_total : 193362 time to create 1 rle with new method : 0.028258323669433594 length of segment : 737 time for calcul the mask position with numpy : 0.011072874069213867 nb_pixel_total : 261832 time to create 1 rle with new method : 0.3067300319671631 length of segment : 437 time for calcul the mask position with numpy : 0.007317304611206055 nb_pixel_total : 230988 time to create 1 rle with new method : 0.0194394588470459 length of segment : 439 time for calcul the mask position with numpy : 0.001004934310913086 nb_pixel_total : 29314 time to create 1 rle with old method : 0.03343915939331055 length of segment : 228 time for calcul the mask position with numpy : 0.0015254020690917969 nb_pixel_total : 55477 time to create 1 rle with old method : 0.06644225120544434 length of segment : 428 time for calcul the mask position with numpy : 0.0028159618377685547 nb_pixel_total : 147954 time to create 1 rle with old method : 0.16814255714416504 length of segment : 596 time for calcul the mask position with numpy : 0.013402462005615234 nb_pixel_total : 715697 time to create 1 rle with new method : 0.017565250396728516 length of segment : 911 time for calcul the mask position with numpy : 0.0005860328674316406 nb_pixel_total : 13174 time to create 1 rle with old method : 0.016679763793945312 length of segment : 144 time for calcul the mask position with numpy : 0.002058744430541992 nb_pixel_total : 101125 time to create 1 rle with old method : 0.11425900459289551 length of segment : 427 time for calcul the mask position with numpy : 0.0021829605102539062 nb_pixel_total : 78563 time to create 1 rle with old method : 0.08816289901733398 length of segment : 589 time for calcul the mask position with numpy : 0.002757549285888672 nb_pixel_total : 104759 time to create 1 rle with old method : 0.12280130386352539 length of segment : 298 time for calcul the mask position with numpy : 0.0020110607147216797 nb_pixel_total : 92458 time to create 1 rle with old method : 0.10482406616210938 length of segment : 321 time for calcul the mask position with numpy : 0.00021958351135253906 nb_pixel_total : 1768 time to create 1 rle with old method : 0.002364635467529297 length of segment : 47 time for calcul the mask position with numpy : 0.00039124488830566406 nb_pixel_total : 6425 time to create 1 rle with old method : 0.008199930191040039 length of segment : 205 time for calcul the mask position with numpy : 0.001413583755493164 nb_pixel_total : 92433 time to create 1 rle with old method : 0.10489869117736816 length of segment : 332 time for calcul the mask position with numpy : 0.019736528396606445 nb_pixel_total : 524550 time to create 1 rle with new method : 0.468364953994751 length of segment : 1060 time for calcul the mask position with numpy : 0.013093709945678711 nb_pixel_total : 568522 time to create 1 rle with new method : 0.2543184757232666 length of segment : 1198 time for calcul the mask position with numpy : 0.0016438961029052734 nb_pixel_total : 78407 time to create 1 rle with old method : 0.08865857124328613 length of segment : 471 time for calcul the mask position with numpy : 0.0017535686492919922 nb_pixel_total : 76183 time to create 1 rle with old method : 0.08669686317443848 length of segment : 376 time for calcul the mask position with numpy : 0.0003616809844970703 nb_pixel_total : 15653 time to create 1 rle with old method : 0.018042564392089844 length of segment : 130 time for calcul the mask position with numpy : 0.0006780624389648438 nb_pixel_total : 14447 time to create 1 rle with old method : 0.019532442092895508 length of segment : 133 time for calcul the mask position with numpy : 0.0071184635162353516 nb_pixel_total : 253257 time to create 1 rle with new method : 0.023019075393676758 length of segment : 981 time for calcul the mask position with numpy : 0.0018131732940673828 nb_pixel_total : 74204 time to create 1 rle with old method : 0.08276200294494629 length of segment : 443 time for calcul the mask position with numpy : 0.0006444454193115234 nb_pixel_total : 27517 time to create 1 rle with old method : 0.031359195709228516 length of segment : 302 time for calcul the mask position with numpy : 0.0048792362213134766 nb_pixel_total : 278626 time to create 1 rle with new method : 0.008568763732910156 length of segment : 411 time for calcul the mask position with numpy : 0.005991697311401367 nb_pixel_total : 180509 time to create 1 rle with new method : 0.014106512069702148 length of segment : 969 time for calcul the mask position with numpy : 0.0066585540771484375 nb_pixel_total : 287690 time to create 1 rle with new method : 0.012547969818115234 length of segment : 424 time for calcul the mask position with numpy : 0.7234985828399658 nb_pixel_total : 6427843 time to create 1 rle with new method : 0.3584606647491455 length of segment : 3153 time for calcul the mask position with numpy : 0.006826162338256836 nb_pixel_total : 488618 time to create 1 rle with new method : 0.02654290199279785 length of segment : 630 time spent for convertir_results : 9.668071031570435 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 54 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 48.826186180114746 time spend to save output : 0.101226806640625 total time spend for step 1 : 48.92741298675537 step2:mask_detect Thu Aug 28 14:22:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 8965 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-28 14:22:22.744198: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-28 14:22:22.772568: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-28 14:22:22.774709: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4c7c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-28 14:22:22.774770: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-28 14:22:22.779099: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-28 14:22:22.929216: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xe063f60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-28 14:22:22.929273: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-28 14:22:22.930623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 14:22:22.931052: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 14:22:22.934357: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 14:22:22.937463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 14:22:22.938040: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 14:22:22.940888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 14:22:22.942361: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 14:22:22.948247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 14:22:22.950166: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 14:22:22.950297: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 14:22:22.951201: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 14:22:22.951221: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 14:22:22.951232: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 14:22:22.952902: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8284 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-28 14:22:23.100835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 14:22:23.100955: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 14:22:23.100988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 14:22:23.101013: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 14:22:23.101051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 14:22:23.101089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 14:22:23.101125: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 14:22:23.101162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 14:22:23.102945: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 14:22:23.104956: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 14:22:23.105009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 14:22:23.105035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 14:22:23.105055: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 14:22:23.105074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 14:22:23.105094: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 14:22:23.105113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 14:22:23.105132: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 14:22:23.106426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 14:22:23.106469: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 14:22:23.106482: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 14:22:23.106493: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 14:22:23.107884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8284 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-28 14:22:34.899066: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 14:22:35.081951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.91250 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 58 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 49 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 3770920 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1313 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6602 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.01363825798034668 nb_pixel_total : 270056 time to create 1 rle with new method : 0.01844167709350586 length of segment : 447 time for calcul the mask position with numpy : 0.0019512176513671875 nb_pixel_total : 47773 time to create 1 rle with old method : 0.05945706367492676 length of segment : 416 time for calcul the mask position with numpy : 0.0031909942626953125 nb_pixel_total : 50788 time to create 1 rle with old method : 0.06594419479370117 length of segment : 538 time for calcul the mask position with numpy : 0.07028031349182129 nb_pixel_total : 1546211 time to create 1 rle with new method : 0.3172421455383301 length of segment : 1283 time for calcul the mask position with numpy : 0.04097104072570801 nb_pixel_total : 1697741 time to create 1 rle with new method : 0.28696632385253906 length of segment : 1541 time for calcul the mask position with numpy : 0.01625847816467285 nb_pixel_total : 491474 time to create 1 rle with new method : 0.08884787559509277 length of segment : 928 time for calcul the mask position with numpy : 0.0032029151916503906 nb_pixel_total : 134531 time to create 1 rle with old method : 0.15221142768859863 length of segment : 278 time for calcul the mask position with numpy : 0.004015207290649414 nb_pixel_total : 157775 time to create 1 rle with new method : 0.007421255111694336 length of segment : 602 time for calcul the mask position with numpy : 0.0008947849273681641 nb_pixel_total : 32178 time to create 1 rle with old method : 0.042168378829956055 length of segment : 136 time for calcul the mask position with numpy : 0.010454893112182617 nb_pixel_total : 395544 time to create 1 rle with new method : 0.03127145767211914 length of segment : 925 time for calcul the mask position with numpy : 0.002729654312133789 nb_pixel_total : 114694 time to create 1 rle with old method : 0.14093923568725586 length of segment : 411 time for calcul the mask position with numpy : 0.003397703170776367 nb_pixel_total : 108837 time to create 1 rle with old method : 0.13460564613342285 length of segment : 449 time for calcul the mask position with numpy : 0.01115727424621582 nb_pixel_total : 467949 time to create 1 rle with new method : 0.019480466842651367 length of segment : 642 time for calcul the mask position with numpy : 0.002274036407470703 nb_pixel_total : 60635 time to create 1 rle with old method : 0.06895756721496582 length of segment : 264 time for calcul the mask position with numpy : 0.0003323554992675781 nb_pixel_total : 13286 time to create 1 rle with old method : 0.01563286781311035 length of segment : 132 time for calcul the mask position with numpy : 0.007725238800048828 nb_pixel_total : 432097 time to create 1 rle with new method : 0.017367839813232422 length of segment : 617 time for calcul the mask position with numpy : 0.0026929378509521484 nb_pixel_total : 209254 time to create 1 rle with new method : 0.006417274475097656 length of segment : 515 time for calcul the mask position with numpy : 0.004354715347290039 nb_pixel_total : 96871 time to create 1 rle with old method : 0.11121606826782227 length of segment : 400 time for calcul the mask position with numpy : 0.0011992454528808594 nb_pixel_total : 76860 time to create 1 rle with old method : 0.08685898780822754 length of segment : 313 time for calcul the mask position with numpy : 0.0017447471618652344 nb_pixel_total : 81754 time to create 1 rle with old method : 0.09382748603820801 length of segment : 519 time for calcul the mask position with numpy : 0.0028045177459716797 nb_pixel_total : 118527 time to create 1 rle with old method : 0.15814208984375 length of segment : 534 time for calcul the mask position with numpy : 0.0016417503356933594 nb_pixel_total : 56318 time to create 1 rle with old method : 0.06413722038269043 length of segment : 184 time for calcul the mask position with numpy : 0.002068758010864258 nb_pixel_total : 97483 time to create 1 rle with old method : 0.11105704307556152 length of segment : 359 time for calcul the mask position with numpy : 0.004137516021728516 nb_pixel_total : 164662 time to create 1 rle with new method : 0.010601520538330078 length of segment : 521 time for calcul the mask position with numpy : 0.002227306365966797 nb_pixel_total : 89811 time to create 1 rle with old method : 0.10080718994140625 length of segment : 486 time for calcul the mask position with numpy : 0.0012619495391845703 nb_pixel_total : 55917 time to create 1 rle with old method : 0.06340193748474121 length of segment : 326 time for calcul the mask position with numpy : 0.003444671630859375 nb_pixel_total : 173880 time to create 1 rle with new method : 0.00657963752746582 length of segment : 312 time for calcul the mask position with numpy : 0.002785205841064453 nb_pixel_total : 108774 time to create 1 rle with old method : 0.12624192237854004 length of segment : 406 time for calcul the mask position with numpy : 0.0019364356994628906 nb_pixel_total : 66912 time to create 1 rle with old method : 0.07669472694396973 length of segment : 357 time for calcul the mask position with numpy : 0.0023107528686523438 nb_pixel_total : 160102 time to create 1 rle with new method : 0.005350589752197266 length of segment : 296 time for calcul the mask position with numpy : 0.0003578662872314453 nb_pixel_total : 14169 time to create 1 rle with old method : 0.0176541805267334 length of segment : 111 time for calcul the mask position with numpy : 0.0030705928802490234 nb_pixel_total : 151694 time to create 1 rle with new method : 0.006947040557861328 length of segment : 376 time for calcul the mask position with numpy : 0.006350040435791016 nb_pixel_total : 295968 time to create 1 rle with new method : 0.017392635345458984 length of segment : 995 time for calcul the mask position with numpy : 0.0038475990295410156 nb_pixel_total : 149182 time to create 1 rle with old method : 0.16640639305114746 length of segment : 617 time for calcul the mask position with numpy : 0.007248640060424805 nb_pixel_total : 323855 time to create 1 rle with new method : 0.018277883529663086 length of segment : 610 time for calcul the mask position with numpy : 0.000888824462890625 nb_pixel_total : 31237 time to create 1 rle with old method : 0.03573441505432129 length of segment : 239 time for calcul the mask position with numpy : 0.005689859390258789 nb_pixel_total : 284347 time to create 1 rle with new method : 0.013855457305908203 length of segment : 509 time for calcul the mask position with numpy : 0.0017771720886230469 nb_pixel_total : 66840 time to create 1 rle with old method : 0.07688522338867188 length of segment : 372 time for calcul the mask position with numpy : 0.003115415573120117 nb_pixel_total : 174436 time to create 1 rle with new method : 0.008691072463989258 length of segment : 988 time for calcul the mask position with numpy : 0.006726741790771484 nb_pixel_total : 365223 time to create 1 rle with new method : 0.01651167869567871 length of segment : 706 time for calcul the mask position with numpy : 0.0013458728790283203 nb_pixel_total : 66192 time to create 1 rle with old method : 0.07694816589355469 length of segment : 317 time for calcul the mask position with numpy : 0.009567975997924805 nb_pixel_total : 399275 time to create 1 rle with new method : 0.02654552459716797 length of segment : 862 time for calcul the mask position with numpy : 0.0021829605102539062 nb_pixel_total : 68805 time to create 1 rle with old method : 0.08191967010498047 length of segment : 368 time for calcul the mask position with numpy : 0.0006668567657470703 nb_pixel_total : 29617 time to create 1 rle with old method : 0.03478193283081055 length of segment : 276 time for calcul the mask position with numpy : 0.008111238479614258 nb_pixel_total : 334546 time to create 1 rle with new method : 0.021436691284179688 length of segment : 653 time for calcul the mask position with numpy : 0.01909637451171875 nb_pixel_total : 745036 time to create 1 rle with new method : 0.5887925624847412 length of segment : 1526 time for calcul the mask position with numpy : 0.002883434295654297 nb_pixel_total : 153317 time to create 1 rle with new method : 0.007837772369384766 length of segment : 695 time for calcul the mask position with numpy : 0.0016131401062011719 nb_pixel_total : 70854 time to create 1 rle with old method : 0.08446311950683594 length of segment : 238 time for calcul the mask position with numpy : 0.0026776790618896484 nb_pixel_total : 154346 time to create 1 rle with new method : 0.007405281066894531 length of segment : 620 time for calcul the mask position with numpy : 0.0008180141448974609 nb_pixel_total : 21868 time to create 1 rle with old method : 0.03731036186218262 length of segment : 219 time for calcul the mask position with numpy : 0.0014109611511230469 nb_pixel_total : 67029 time to create 1 rle with old method : 0.07820963859558105 length of segment : 366 time for calcul the mask position with numpy : 0.002705097198486328 nb_pixel_total : 141894 time to create 1 rle with old method : 0.15859460830688477 length of segment : 448 time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 25926 time to create 1 rle with old method : 0.029901504516601562 length of segment : 271 time for calcul the mask position with numpy : 0.0006616115570068359 nb_pixel_total : 23365 time to create 1 rle with old method : 0.02769184112548828 length of segment : 206 time for calcul the mask position with numpy : 0.000888824462890625 nb_pixel_total : 38094 time to create 1 rle with old method : 0.04361152648925781 length of segment : 239 time for calcul the mask position with numpy : 0.002995729446411133 nb_pixel_total : 150947 time to create 1 rle with new method : 0.009264945983886719 length of segment : 738 time for calcul the mask position with numpy : 0.0014171600341796875 nb_pixel_total : 78450 time to create 1 rle with old method : 0.08935284614562988 length of segment : 308 time for calcul the mask position with numpy : 0.0009136199951171875 nb_pixel_total : 42264 time to create 1 rle with old method : 0.04862618446350098 length of segment : 284 time for calcul the mask position with numpy : 0.00042128562927246094 nb_pixel_total : 15225 time to create 1 rle with old method : 0.01792168617248535 length of segment : 134 time for calcul the mask position with numpy : 0.0018274784088134766 nb_pixel_total : 106556 time to create 1 rle with old method : 0.11919474601745605 length of segment : 445 time for calcul the mask position with numpy : 0.0024662017822265625 nb_pixel_total : 59677 time to create 1 rle with old method : 0.08275604248046875 length of segment : 503 time for calcul the mask position with numpy : 0.0021796226501464844 nb_pixel_total : 66191 time to create 1 rle with old method : 0.07912921905517578 length of segment : 569 time for calcul the mask position with numpy : 0.0010302066802978516 nb_pixel_total : 45284 time to create 1 rle with old method : 0.05255913734436035 length of segment : 192 time for calcul the mask position with numpy : 0.0017037391662597656 nb_pixel_total : 33245 time to create 1 rle with old method : 0.03924226760864258 length of segment : 331 time for calcul the mask position with numpy : 0.004439592361450195 nb_pixel_total : 283045 time to create 1 rle with new method : 0.014751911163330078 length of segment : 889 time for calcul the mask position with numpy : 0.004654645919799805 nb_pixel_total : 180545 time to create 1 rle with new method : 0.014645576477050781 length of segment : 692 time for calcul the mask position with numpy : 0.010954141616821289 nb_pixel_total : 642921 time to create 1 rle with new method : 0.20716595649719238 length of segment : 787 time for calcul the mask position with numpy : 0.0005433559417724609 nb_pixel_total : 14320 time to create 1 rle with old method : 0.01790142059326172 length of segment : 175 time for calcul the mask position with numpy : 0.009700536727905273 nb_pixel_total : 503928 time to create 1 rle with new method : 0.02509284019470215 length of segment : 1017 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 29849 time to create 1 rle with old method : 0.03444862365722656 length of segment : 218 time for calcul the mask position with numpy : 0.0012679100036621094 nb_pixel_total : 82710 time to create 1 rle with old method : 0.09533262252807617 length of segment : 340 time for calcul the mask position with numpy : 0.017850637435913086 nb_pixel_total : 945729 time to create 1 rle with new method : 0.08242082595825195 length of segment : 1012 time for calcul the mask position with numpy : 0.0007734298706054688 nb_pixel_total : 44495 time to create 1 rle with old method : 0.05077195167541504 length of segment : 193 time for calcul the mask position with numpy : 0.001104116439819336 nb_pixel_total : 38720 time to create 1 rle with old method : 0.04503822326660156 length of segment : 205 time for calcul the mask position with numpy : 0.004722118377685547 nb_pixel_total : 247406 time to create 1 rle with new method : 0.014487266540527344 length of segment : 946 time for calcul the mask position with numpy : 0.022858858108520508 nb_pixel_total : 982847 time to create 1 rle with new method : 0.09766077995300293 length of segment : 1132 time for calcul the mask position with numpy : 0.002177715301513672 nb_pixel_total : 82286 time to create 1 rle with old method : 0.09382104873657227 length of segment : 414 time for calcul the mask position with numpy : 0.005650043487548828 nb_pixel_total : 273292 time to create 1 rle with new method : 0.01776289939880371 length of segment : 1072 time for calcul the mask position with numpy : 0.0009467601776123047 nb_pixel_total : 47697 time to create 1 rle with old method : 0.05498147010803223 length of segment : 198 time for calcul the mask position with numpy : 0.0006985664367675781 nb_pixel_total : 38694 time to create 1 rle with old method : 0.04505276679992676 length of segment : 238 time for calcul the mask position with numpy : 0.005190134048461914 nb_pixel_total : 293597 time to create 1 rle with new method : 0.016436100006103516 length of segment : 2008 time for calcul the mask position with numpy : 0.0049991607666015625 nb_pixel_total : 121649 time to create 1 rle with old method : 0.1363818645477295 length of segment : 1056 time for calcul the mask position with numpy : 0.010281085968017578 nb_pixel_total : 591974 time to create 1 rle with new method : 0.18993258476257324 length of segment : 1093 time for calcul the mask position with numpy : 0.007537364959716797 nb_pixel_total : 454606 time to create 1 rle with new method : 0.020029544830322266 length of segment : 780 time for calcul the mask position with numpy : 0.0022287368774414062 nb_pixel_total : 77099 time to create 1 rle with old method : 0.08775138854980469 length of segment : 313 time for calcul the mask position with numpy : 0.0035247802734375 nb_pixel_total : 160906 time to create 1 rle with new method : 0.009979724884033203 length of segment : 572 time for calcul the mask position with numpy : 0.008831501007080078 nb_pixel_total : 443572 time to create 1 rle with new method : 0.023967266082763672 length of segment : 786 time for calcul the mask position with numpy : 0.003350496292114258 nb_pixel_total : 175545 time to create 1 rle with new method : 0.009694814682006836 length of segment : 566 time for calcul the mask position with numpy : 0.0007479190826416016 nb_pixel_total : 38049 time to create 1 rle with old method : 0.043166160583496094 length of segment : 235 time for calcul the mask position with numpy : 0.022965192794799805 nb_pixel_total : 1347132 time to create 1 rle with new method : 0.0986638069152832 length of segment : 1850 time for calcul the mask position with numpy : 0.004096031188964844 nb_pixel_total : 249483 time to create 1 rle with new method : 0.011041879653930664 length of segment : 736 time for calcul the mask position with numpy : 0.003480195999145508 nb_pixel_total : 169341 time to create 1 rle with new method : 0.010025978088378906 length of segment : 646 time for calcul the mask position with numpy : 0.016484975814819336 nb_pixel_total : 906939 time to create 1 rle with new method : 0.07852983474731445 length of segment : 881 time for calcul the mask position with numpy : 0.0037288665771484375 nb_pixel_total : 193743 time to create 1 rle with new method : 0.010011911392211914 length of segment : 565 time for calcul the mask position with numpy : 0.0016353130340576172 nb_pixel_total : 57762 time to create 1 rle with old method : 0.06582403182983398 length of segment : 393 time for calcul the mask position with numpy : 0.003072023391723633 nb_pixel_total : 137276 time to create 1 rle with old method : 0.15067505836486816 length of segment : 679 time for calcul the mask position with numpy : 0.0011305809020996094 nb_pixel_total : 47948 time to create 1 rle with old method : 0.053965091705322266 length of segment : 289 time for calcul the mask position with numpy : 0.0018353462219238281 nb_pixel_total : 115993 time to create 1 rle with old method : 0.13063335418701172 length of segment : 466 time for calcul the mask position with numpy : 0.0014150142669677734 nb_pixel_total : 52844 time to create 1 rle with old method : 0.08190703392028809 length of segment : 292 time for calcul the mask position with numpy : 0.01800060272216797 nb_pixel_total : 867829 time to create 1 rle with new method : 0.31645703315734863 length of segment : 1346 time for calcul the mask position with numpy : 0.0006909370422363281 nb_pixel_total : 26108 time to create 1 rle with old method : 0.034136295318603516 length of segment : 230 time for calcul the mask position with numpy : 0.001569509506225586 nb_pixel_total : 68891 time to create 1 rle with old method : 0.07655119895935059 length of segment : 445 time for calcul the mask position with numpy : 0.014122962951660156 nb_pixel_total : 441575 time to create 1 rle with new method : 0.06115269660949707 length of segment : 1027 time for calcul the mask position with numpy : 0.0026404857635498047 nb_pixel_total : 154067 time to create 1 rle with new method : 0.007420063018798828 length of segment : 458 time for calcul the mask position with numpy : 0.00445556640625 nb_pixel_total : 224344 time to create 1 rle with new method : 0.013905763626098633 length of segment : 708 time for calcul the mask position with numpy : 0.001993417739868164 nb_pixel_total : 131398 time to create 1 rle with old method : 0.151627779006958 length of segment : 510 time for calcul the mask position with numpy : 0.0013914108276367188 nb_pixel_total : 80694 time to create 1 rle with old method : 0.09213399887084961 length of segment : 415 time for calcul the mask position with numpy : 0.00974726676940918 nb_pixel_total : 512353 time to create 1 rle with new method : 0.028339862823486328 length of segment : 1104 time for calcul the mask position with numpy : 0.004895687103271484 nb_pixel_total : 290526 time to create 1 rle with new method : 0.014639139175415039 length of segment : 559 time for calcul the mask position with numpy : 0.0019376277923583984 nb_pixel_total : 35329 time to create 1 rle with old method : 0.040857553482055664 length of segment : 355 time for calcul the mask position with numpy : 0.000990152359008789 nb_pixel_total : 44367 time to create 1 rle with old method : 0.04972100257873535 length of segment : 348 time for calcul the mask position with numpy : 0.026180267333984375 nb_pixel_total : 1402348 time to create 1 rle with new method : 0.23505043983459473 length of segment : 1907 time for calcul the mask position with numpy : 0.0017058849334716797 nb_pixel_total : 94662 time to create 1 rle with old method : 0.10612773895263672 length of segment : 492 time for calcul the mask position with numpy : 0.003255605697631836 nb_pixel_total : 185136 time to create 1 rle with new method : 0.00975489616394043 length of segment : 789 time for calcul the mask position with numpy : 0.0027735233306884766 nb_pixel_total : 137018 time to create 1 rle with old method : 0.15283513069152832 length of segment : 438 time for calcul the mask position with numpy : 0.0021953582763671875 nb_pixel_total : 107405 time to create 1 rle with old method : 0.12169742584228516 length of segment : 383 time for calcul the mask position with numpy : 0.00063323974609375 nb_pixel_total : 17476 time to create 1 rle with old method : 0.020741701126098633 length of segment : 211 time for calcul the mask position with numpy : 0.0009584426879882812 nb_pixel_total : 40536 time to create 1 rle with old method : 0.046961069107055664 length of segment : 312 time for calcul the mask position with numpy : 0.00244140625 nb_pixel_total : 140949 time to create 1 rle with old method : 0.16478681564331055 length of segment : 372 time for calcul the mask position with numpy : 0.002192974090576172 nb_pixel_total : 114750 time to create 1 rle with old method : 0.12812495231628418 length of segment : 475 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 28805 time to create 1 rle with old method : 0.033417701721191406 length of segment : 232 time for calcul the mask position with numpy : 0.004304409027099609 nb_pixel_total : 245792 time to create 1 rle with new method : 0.013342618942260742 length of segment : 625 time for calcul the mask position with numpy : 0.002702474594116211 nb_pixel_total : 126303 time to create 1 rle with old method : 0.1438288688659668 length of segment : 426 time for calcul the mask position with numpy : 0.0009877681732177734 nb_pixel_total : 60099 time to create 1 rle with old method : 0.06810474395751953 length of segment : 161 time for calcul the mask position with numpy : 0.005988359451293945 nb_pixel_total : 299411 time to create 1 rle with new method : 0.026903629302978516 length of segment : 724 time for calcul the mask position with numpy : 0.0011188983917236328 nb_pixel_total : 19455 time to create 1 rle with old method : 0.02258896827697754 length of segment : 280 time for calcul the mask position with numpy : 0.0021009445190429688 nb_pixel_total : 95575 time to create 1 rle with old method : 0.10899567604064941 length of segment : 400 time for calcul the mask position with numpy : 0.0017862319946289062 nb_pixel_total : 110207 time to create 1 rle with old method : 0.13486433029174805 length of segment : 481 time for calcul the mask position with numpy : 0.0021157264709472656 nb_pixel_total : 93900 time to create 1 rle with old method : 0.10572576522827148 length of segment : 503 time for calcul the mask position with numpy : 0.0023102760314941406 nb_pixel_total : 121437 time to create 1 rle with old method : 0.13713622093200684 length of segment : 454 time for calcul the mask position with numpy : 0.0013003349304199219 nb_pixel_total : 75511 time to create 1 rle with old method : 0.08433079719543457 length of segment : 570 time for calcul the mask position with numpy : 0.01112508773803711 nb_pixel_total : 558572 time to create 1 rle with new method : 0.2756307125091553 length of segment : 1069 time for calcul the mask position with numpy : 0.0027251243591308594 nb_pixel_total : 112345 time to create 1 rle with old method : 0.12366151809692383 length of segment : 428 time for calcul the mask position with numpy : 0.0037360191345214844 nb_pixel_total : 177504 time to create 1 rle with new method : 0.012866735458374023 length of segment : 564 time for calcul the mask position with numpy : 0.02347111701965332 nb_pixel_total : 1365558 time to create 1 rle with new method : 0.499255895614624 length of segment : 1847 time for calcul the mask position with numpy : 0.008160829544067383 nb_pixel_total : 299288 time to create 1 rle with new method : 0.03615522384643555 length of segment : 786 time for calcul the mask position with numpy : 0.006933450698852539 nb_pixel_total : 333754 time to create 1 rle with new method : 0.019109725952148438 length of segment : 665 time for calcul the mask position with numpy : 0.0024156570434570312 nb_pixel_total : 115487 time to create 1 rle with old method : 0.1271040439605713 length of segment : 588 time for calcul the mask position with numpy : 0.0011370182037353516 nb_pixel_total : 46021 time to create 1 rle with old method : 0.05229544639587402 length of segment : 245 time for calcul the mask position with numpy : 0.0038826465606689453 nb_pixel_total : 155975 time to create 1 rle with new method : 0.009808778762817383 length of segment : 482 time for calcul the mask position with numpy : 0.00078582763671875 nb_pixel_total : 32954 time to create 1 rle with old method : 0.038414955139160156 length of segment : 229 time for calcul the mask position with numpy : 0.0007150173187255859 nb_pixel_total : 35267 time to create 1 rle with old method : 0.041585683822631836 length of segment : 168 time for calcul the mask position with numpy : 0.001125335693359375 nb_pixel_total : 52539 time to create 1 rle with old method : 0.06106734275817871 length of segment : 365 time for calcul the mask position with numpy : 0.007057905197143555 nb_pixel_total : 314821 time to create 1 rle with new method : 0.016223669052124023 length of segment : 955 time for calcul the mask position with numpy : 0.004174232482910156 nb_pixel_total : 162127 time to create 1 rle with new method : 0.011151552200317383 length of segment : 602 time for calcul the mask position with numpy : 0.009074687957763672 nb_pixel_total : 389723 time to create 1 rle with new method : 0.026025056838989258 length of segment : 742 time for calcul the mask position with numpy : 0.002919912338256836 nb_pixel_total : 107490 time to create 1 rle with old method : 0.11859536170959473 length of segment : 498 time for calcul the mask position with numpy : 0.013924360275268555 nb_pixel_total : 622553 time to create 1 rle with new method : 0.05620121955871582 length of segment : 1077 time for calcul the mask position with numpy : 0.0011436939239501953 nb_pixel_total : 67626 time to create 1 rle with old method : 0.07522058486938477 length of segment : 285 time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 15363 time to create 1 rle with old method : 0.017757415771484375 length of segment : 131 time for calcul the mask position with numpy : 0.0011925697326660156 nb_pixel_total : 52536 time to create 1 rle with old method : 0.06163287162780762 length of segment : 219 time for calcul the mask position with numpy : 0.010331392288208008 nb_pixel_total : 418333 time to create 1 rle with new method : 0.028807401657104492 length of segment : 644 time for calcul the mask position with numpy : 0.0020716190338134766 nb_pixel_total : 87535 time to create 1 rle with old method : 0.09853124618530273 length of segment : 314 time for calcul the mask position with numpy : 0.03575444221496582 nb_pixel_total : 1580341 time to create 1 rle with new method : 0.5335237979888916 length of segment : 1507 time for calcul the mask position with numpy : 0.00313568115234375 nb_pixel_total : 106429 time to create 1 rle with old method : 0.12162971496582031 length of segment : 439 time for calcul the mask position with numpy : 0.0013279914855957031 nb_pixel_total : 69302 time to create 1 rle with old method : 0.07982230186462402 length of segment : 330 time for calcul the mask position with numpy : 0.0006494522094726562 nb_pixel_total : 21138 time to create 1 rle with old method : 0.024112224578857422 length of segment : 170 time for calcul the mask position with numpy : 0.0011363029479980469 nb_pixel_total : 66977 time to create 1 rle with old method : 0.07921719551086426 length of segment : 372 time for calcul the mask position with numpy : 0.001039266586303711 nb_pixel_total : 43263 time to create 1 rle with old method : 0.050208091735839844 length of segment : 170 time for calcul the mask position with numpy : 0.0015499591827392578 nb_pixel_total : 50027 time to create 1 rle with old method : 0.056485891342163086 length of segment : 364 time for calcul the mask position with numpy : 0.0008983612060546875 nb_pixel_total : 40540 time to create 1 rle with old method : 0.05292105674743652 length of segment : 316 time for calcul the mask position with numpy : 0.0027518272399902344 nb_pixel_total : 56500 time to create 1 rle with old method : 0.07466244697570801 length of segment : 677 time for calcul the mask position with numpy : 0.0018024444580078125 nb_pixel_total : 77944 time to create 1 rle with old method : 0.08915448188781738 length of segment : 293 time for calcul the mask position with numpy : 0.001825571060180664 nb_pixel_total : 91530 time to create 1 rle with old method : 0.10262894630432129 length of segment : 299 time for calcul the mask position with numpy : 0.0009887218475341797 nb_pixel_total : 42326 time to create 1 rle with old method : 0.04855608940124512 length of segment : 288 time for calcul the mask position with numpy : 0.0008258819580078125 nb_pixel_total : 36004 time to create 1 rle with old method : 0.042206525802612305 length of segment : 169 time for calcul the mask position with numpy : 0.0016088485717773438 nb_pixel_total : 50684 time to create 1 rle with old method : 0.05676531791687012 length of segment : 181 time for calcul the mask position with numpy : 0.0012326240539550781 nb_pixel_total : 54184 time to create 1 rle with old method : 0.05979466438293457 length of segment : 519 time for calcul the mask position with numpy : 0.0013468265533447266 nb_pixel_total : 53148 time to create 1 rle with old method : 0.06049060821533203 length of segment : 251 time for calcul the mask position with numpy : 0.0012879371643066406 nb_pixel_total : 48643 time to create 1 rle with old method : 0.055022239685058594 length of segment : 244 time for calcul the mask position with numpy : 0.003425121307373047 nb_pixel_total : 209505 time to create 1 rle with new method : 0.009296894073486328 length of segment : 467 time for calcul the mask position with numpy : 0.0014200210571289062 nb_pixel_total : 72352 time to create 1 rle with old method : 0.0798337459564209 length of segment : 288 time for calcul the mask position with numpy : 0.0036551952362060547 nb_pixel_total : 228906 time to create 1 rle with new method : 0.008971214294433594 length of segment : 432 time for calcul the mask position with numpy : 0.0002715587615966797 nb_pixel_total : 9113 time to create 1 rle with old method : 0.010566234588623047 length of segment : 181 time for calcul the mask position with numpy : 0.0013360977172851562 nb_pixel_total : 54331 time to create 1 rle with old method : 0.061177730560302734 length of segment : 339 time for calcul the mask position with numpy : 0.00494837760925293 nb_pixel_total : 191587 time to create 1 rle with new method : 0.015589714050292969 length of segment : 651 time for calcul the mask position with numpy : 0.005772113800048828 nb_pixel_total : 228171 time to create 1 rle with new method : 0.016378164291381836 length of segment : 731 time for calcul the mask position with numpy : 0.006921052932739258 nb_pixel_total : 227840 time to create 1 rle with new method : 0.023574113845825195 length of segment : 1174 time for calcul the mask position with numpy : 0.019396543502807617 nb_pixel_total : 1192399 time to create 1 rle with new method : 0.2955970764160156 length of segment : 1000 time for calcul the mask position with numpy : 0.005224704742431641 nb_pixel_total : 282853 time to create 1 rle with new method : 0.013142108917236328 length of segment : 436 time for calcul the mask position with numpy : 0.0042722225189208984 nb_pixel_total : 257080 time to create 1 rle with new method : 0.01102137565612793 length of segment : 550 time for calcul the mask position with numpy : 0.0021271705627441406 nb_pixel_total : 77565 time to create 1 rle with old method : 0.08582210540771484 length of segment : 368 time for calcul the mask position with numpy : 0.0009720325469970703 nb_pixel_total : 46361 time to create 1 rle with old method : 0.052093505859375 length of segment : 206 time for calcul the mask position with numpy : 0.003912925720214844 nb_pixel_total : 233967 time to create 1 rle with new method : 0.011506319046020508 length of segment : 729 time for calcul the mask position with numpy : 0.0004200935363769531 nb_pixel_total : 19146 time to create 1 rle with old method : 0.021579980850219727 length of segment : 177 time for calcul the mask position with numpy : 0.0015559196472167969 nb_pixel_total : 94527 time to create 1 rle with old method : 0.13251399993896484 length of segment : 353 time for calcul the mask position with numpy : 0.0012445449829101562 nb_pixel_total : 35167 time to create 1 rle with old method : 0.04023480415344238 length of segment : 257 time for calcul the mask position with numpy : 0.0007588863372802734 nb_pixel_total : 24673 time to create 1 rle with old method : 0.029041528701782227 length of segment : 155 time for calcul the mask position with numpy : 0.009536981582641602 nb_pixel_total : 304955 time to create 1 rle with new method : 0.03428030014038086 length of segment : 563 time for calcul the mask position with numpy : 0.004102230072021484 nb_pixel_total : 121149 time to create 1 rle with old method : 0.13321256637573242 length of segment : 394 time for calcul the mask position with numpy : 0.002826213836669922 nb_pixel_total : 44384 time to create 1 rle with old method : 0.04858756065368652 length of segment : 267 time for calcul the mask position with numpy : 0.0007951259613037109 nb_pixel_total : 29153 time to create 1 rle with old method : 0.033026933670043945 length of segment : 128 time for calcul the mask position with numpy : 0.001417398452758789 nb_pixel_total : 59787 time to create 1 rle with old method : 0.0655663013458252 length of segment : 245 time for calcul the mask position with numpy : 0.0020189285278320312 nb_pixel_total : 83958 time to create 1 rle with old method : 0.09208321571350098 length of segment : 360 time for calcul the mask position with numpy : 0.0014126300811767578 nb_pixel_total : 61005 time to create 1 rle with old method : 0.0663607120513916 length of segment : 243 time for calcul the mask position with numpy : 0.0039000511169433594 nb_pixel_total : 180757 time to create 1 rle with new method : 0.011542558670043945 length of segment : 463 time for calcul the mask position with numpy : 0.009919881820678711 nb_pixel_total : 359868 time to create 1 rle with new method : 0.031757354736328125 length of segment : 525 time for calcul the mask position with numpy : 0.014077901840209961 nb_pixel_total : 472440 time to create 1 rle with new method : 0.10294151306152344 length of segment : 1728 time for calcul the mask position with numpy : 0.021483421325683594 nb_pixel_total : 1158959 time to create 1 rle with new method : 0.13466858863830566 length of segment : 964 time for calcul the mask position with numpy : 0.007334232330322266 nb_pixel_total : 254107 time to create 1 rle with new method : 0.03662919998168945 length of segment : 1853 time for calcul the mask position with numpy : 0.0030210018157958984 nb_pixel_total : 144712 time to create 1 rle with old method : 0.16135954856872559 length of segment : 403 time for calcul the mask position with numpy : 0.0009913444519042969 nb_pixel_total : 50865 time to create 1 rle with old method : 0.056719303131103516 length of segment : 176 time for calcul the mask position with numpy : 0.03700590133666992 nb_pixel_total : 1546854 time to create 1 rle with new method : 0.7248685359954834 length of segment : 1526 time for calcul the mask position with numpy : 0.0033445358276367188 nb_pixel_total : 175615 time to create 1 rle with new method : 0.009309530258178711 length of segment : 465 time for calcul the mask position with numpy : 0.007992029190063477 nb_pixel_total : 367510 time to create 1 rle with new method : 0.01929163932800293 length of segment : 554 time for calcul the mask position with numpy : 1.2368767261505127 nb_pixel_total : 9624027 time to create 1 rle with new method : 1.4219775199890137 length of segment : 4932 time for calcul the mask position with numpy : 0.0009284019470214844 nb_pixel_total : 39571 time to create 1 rle with old method : 0.09435081481933594 length of segment : 243 time for calcul the mask position with numpy : 0.00817251205444336 nb_pixel_total : 619899 time to create 1 rle with new method : 0.01483917236328125 length of segment : 678 time for calcul the mask position with numpy : 0.003225088119506836 nb_pixel_total : 265946 time to create 1 rle with new method : 0.0077555179595947266 length of segment : 584 time for calcul the mask position with numpy : 0.003188610076904297 nb_pixel_total : 262296 time to create 1 rle with new method : 0.0071527957916259766 length of segment : 638 time spent for convertir_results : 43.69823908805847 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 264 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 121.71915578842163 time spend to save output : 0.1486353874206543 total time spend for step 2 : 121.86779117584229 step3:blur_detection Thu Aug 28 14:24:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 754.3929914496592 (4160, 3120) 864.5076092871209 (4160, 3120) 651.891588722836 (4160, 3120) 1790.7883973240585 (4160, 3120) 99.77327647138509 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.014636516571044922 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.013780355453491211 save missing photos in datou_result : time spend for datou_step_exec : 2.6347107887268066 time spend to save output : 0.03343701362609863 total time spend for step 3 : 2.6681478023529053 step4:brightness Thu Aug 28 14:24:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756383689_3769125_1379845325_919a343e54aa49b3a331faec13e139bf.jpg treat image : temp/1756383689_3769125_1379845307_7273c9cd461c3308d255e029411f3261.jpg treat image : temp/1756383689_3769125_1379845305_59947c1fea071706b206856a7d7f3a77.jpg treat image : temp/1756383689_3769125_1379845304_4702772f4f81ce1a306a602709fb3182.jpg treat image : temp/1756383689_3769125_1379845302_4a1701f7836e304328999f0aa438a16e.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.014255285263061523 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.01382136344909668 save missing photos in datou_result : time spend for datou_step_exec : 8.940131902694702 time spend to save output : 0.033089637756347656 total time spend for step 4 : 8.97322154045105 step5:rle_unique_nms_with_priority Thu Aug 28 14:24:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 264 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 46 nb_hashtags : 9 time to prepare the origin masks : 37.04496216773987 time for calcul the mask position with numpy : 0.4964768886566162 nb_pixel_total : 5354061 time to create 1 rle with new method : 1.7029423713684082 time for calcul the mask position with numpy : 0.05338573455810547 nb_pixel_total : 134274 time to create 1 rle with old method : 0.14331531524658203 time for calcul the mask position with numpy : 0.051763296127319336 nb_pixel_total : 61085 time to create 1 rle with old method : 0.06539154052734375 time for calcul the mask position with numpy : 0.05657339096069336 nb_pixel_total : 264172 time to create 1 rle with new method : 1.2745161056518555 time for calcul the mask position with numpy : 0.05149054527282715 nb_pixel_total : 4668 time to create 1 rle with old method : 0.005350828170776367 time for calcul the mask position with numpy : 0.050699710845947266 nb_pixel_total : 55287 time to create 1 rle with old method : 0.05813002586364746 time for calcul the mask position with numpy : 0.05276083946228027 nb_pixel_total : 58147 time to create 1 rle with old method : 0.06365251541137695 time for calcul the mask position with numpy : 0.056646108627319336 nb_pixel_total : 396115 time to create 1 rle with new method : 1.2178077697753906 time for calcul the mask position with numpy : 0.052184343338012695 nb_pixel_total : 158085 time to create 1 rle with new method : 1.2133963108062744 time for calcul the mask position with numpy : 0.055808067321777344 nb_pixel_total : 428512 time to create 1 rle with new method : 1.080456256866455 time for calcul the mask position with numpy : 0.05256366729736328 nb_pixel_total : 11436 time to create 1 rle with old method : 0.012688398361206055 time for calcul the mask position with numpy : 0.05240583419799805 nb_pixel_total : 50772 time to create 1 rle with old method : 0.05623269081115723 time for calcul the mask position with numpy : 0.05459737777709961 nb_pixel_total : 120627 time to create 1 rle with old method : 0.13334012031555176 time for calcul the mask position with numpy : 0.05375337600708008 nb_pixel_total : 32045 time to create 1 rle with old method : 0.035976409912109375 time for calcul the mask position with numpy : 0.05380702018737793 nb_pixel_total : 358650 time to create 1 rle with new method : 1.3026211261749268 time for calcul the mask position with numpy : 0.052126169204711914 nb_pixel_total : 8656 time to create 1 rle with old method : 0.009447574615478516 time for calcul the mask position with numpy : 0.05201005935668945 nb_pixel_total : 89700 time to create 1 rle with old method : 0.10075926780700684 time for calcul the mask position with numpy : 0.05460548400878906 nb_pixel_total : 51406 time to create 1 rle with old method : 0.057325124740600586 time for calcul the mask position with numpy : 0.052834272384643555 nb_pixel_total : 97294 time to create 1 rle with old method : 0.10625100135803223 time for calcul the mask position with numpy : 0.05190420150756836 nb_pixel_total : 48823 time to create 1 rle with old method : 0.056336402893066406 time for calcul the mask position with numpy : 0.05991935729980469 nb_pixel_total : 113430 time to create 1 rle with old method : 0.12668251991271973 time for calcul the mask position with numpy : 0.05205821990966797 nb_pixel_total : 53907 time to create 1 rle with old method : 0.061272382736206055 time for calcul the mask position with numpy : 0.05348706245422363 nb_pixel_total : 96405 time to create 1 rle with old method : 0.10828280448913574 time for calcul the mask position with numpy : 0.051100730895996094 nb_pixel_total : 4688 time to create 1 rle with old method : 0.0056154727935791016 time for calcul the mask position with numpy : 0.05120038986206055 nb_pixel_total : 11493 time to create 1 rle with old method : 0.012475728988647461 time for calcul the mask position with numpy : 0.051458120346069336 nb_pixel_total : 56831 time to create 1 rle with old method : 0.06197714805603027 time for calcul the mask position with numpy : 0.052344322204589844 nb_pixel_total : 33517 time to create 1 rle with old method : 0.03688240051269531 time for calcul the mask position with numpy : 0.053037405014038086 nb_pixel_total : 108391 time to create 1 rle with old method : 0.11815571784973145 time for calcul the mask position with numpy : 0.05260777473449707 nb_pixel_total : 77656 time to create 1 rle with old method : 0.0845646858215332 time for calcul the mask position with numpy : 0.05134773254394531 nb_pixel_total : 114446 time to create 1 rle with old method : 0.12592864036560059 time for calcul the mask position with numpy : 0.05404019355773926 nb_pixel_total : 107268 time to create 1 rle with old method : 0.12312102317810059 time for calcul the mask position with numpy : 0.05780029296875 nb_pixel_total : 351 time to create 1 rle with old method : 0.0005166530609130859 time for calcul the mask position with numpy : 0.08710694313049316 nb_pixel_total : 1694408 time to create 1 rle with new method : 1.6563653945922852 time for calcul the mask position with numpy : 0.056264400482177734 nb_pixel_total : 470665 time to create 1 rle with new method : 1.3524911403656006 time for calcul the mask position with numpy : 0.05528450012207031 nb_pixel_total : 114424 time to create 1 rle with old method : 0.24390101432800293 time for calcul the mask position with numpy : 0.060533761978149414 nb_pixel_total : 13235 time to create 1 rle with old method : 0.016039371490478516 time for calcul the mask position with numpy : 0.06514549255371094 nb_pixel_total : 1536735 time to create 1 rle with new method : 1.6326663494110107 time for calcul the mask position with numpy : 0.05545783042907715 nb_pixel_total : 5809 time to create 1 rle with old method : 0.009593009948730469 time for calcul the mask position with numpy : 0.06072592735290527 nb_pixel_total : 47654 time to create 1 rle with old method : 0.05401945114135742 time for calcul the mask position with numpy : 0.05370187759399414 nb_pixel_total : 4921 time to create 1 rle with old method : 0.006223201751708984 time for calcul the mask position with numpy : 0.05556917190551758 nb_pixel_total : 173325 time to create 1 rle with new method : 1.3216361999511719 time for calcul the mask position with numpy : 0.05380892753601074 nb_pixel_total : 1869 time to create 1 rle with old method : 0.002148151397705078 time for calcul the mask position with numpy : 0.05412769317626953 nb_pixel_total : 269034 time to create 1 rle with new method : 1.0251612663269043 time for calcul the mask position with numpy : 0.05678534507751465 nb_pixel_total : 7573 time to create 1 rle with old method : 0.00856471061706543 time for calcul the mask position with numpy : 0.05324864387512207 nb_pixel_total : 76715 time to create 1 rle with old method : 0.08937692642211914 time for calcul the mask position with numpy : 0.05866575241088867 nb_pixel_total : 600 time to create 1 rle with old method : 0.0007512569427490234 time for calcul the mask position with numpy : 0.05538654327392578 nb_pixel_total : 35 time to create 1 rle with old method : 9.250640869140625e-05 create new chi : 20.46689200401306 time to delete rle : 0.03591012954711914 batch 1 Loaded 47 chid ids of type : 4855 Number RLEs to save : 37100 TO DO : save crop sub photo not yet done ! save time : 2.0842278003692627 nb_obj : 70 nb_hashtags : 9 time to prepare the origin masks : 63.0010507106781 time for calcul the mask position with numpy : 0.9663610458374023 nb_pixel_total : 3686961 time to create 1 rle with new method : 1.6792833805084229 time for calcul the mask position with numpy : 0.05879688262939453 nb_pixel_total : 3185 time to create 1 rle with old method : 0.00401759147644043 time for calcul the mask position with numpy : 0.05498647689819336 nb_pixel_total : 14040 time to create 1 rle with old method : 0.016553878784179688 time for calcul the mask position with numpy : 0.055486440658569336 nb_pixel_total : 69893 time to create 1 rle with old method : 0.0778050422668457 time for calcul the mask position with numpy : 0.1510932445526123 nb_pixel_total : 547251 time to create 1 rle with new method : 1.7504041194915771 time for calcul the mask position with numpy : 0.05601096153259277 nb_pixel_total : 13105 time to create 1 rle with old method : 0.014932394027709961 time for calcul the mask position with numpy : 0.05501103401184082 nb_pixel_total : 60182 time to create 1 rle with old method : 0.06777286529541016 time for calcul the mask position with numpy : 0.05417776107788086 nb_pixel_total : 29576 time to create 1 rle with old method : 0.03391289710998535 time for calcul the mask position with numpy : 0.05418539047241211 nb_pixel_total : 30525 time to create 1 rle with old method : 0.042685747146606445 time for calcul the mask position with numpy : 0.05515694618225098 nb_pixel_total : 34637 time to create 1 rle with old method : 0.0384211540222168 time for calcul the mask position with numpy : 0.05674099922180176 nb_pixel_total : 364859 time to create 1 rle with new method : 1.2229704856872559 time for calcul the mask position with numpy : 0.05482339859008789 nb_pixel_total : 66709 time to create 1 rle with old method : 0.07498431205749512 time for calcul the mask position with numpy : 0.053418636322021484 nb_pixel_total : 29785 time to create 1 rle with old method : 0.03319144248962402 time for calcul the mask position with numpy : 0.05481863021850586 nb_pixel_total : 149052 time to create 1 rle with old method : 0.1656646728515625 time for calcul the mask position with numpy : 0.06201338768005371 nb_pixel_total : 150705 time to create 1 rle with new method : 1.555069923400879 time for calcul the mask position with numpy : 0.0552065372467041 nb_pixel_total : 8087 time to create 1 rle with old method : 0.010913372039794922 time for calcul the mask position with numpy : 0.05781102180480957 nb_pixel_total : 68837 time to create 1 rle with old method : 0.08322000503540039 time for calcul the mask position with numpy : 0.054418325424194336 nb_pixel_total : 31317 time to create 1 rle with old method : 0.03491568565368652 time for calcul the mask position with numpy : 0.05348467826843262 nb_pixel_total : 82907 time to create 1 rle with old method : 0.09106302261352539 time for calcul the mask position with numpy : 0.052181243896484375 nb_pixel_total : 82223 time to create 1 rle with old method : 0.09052729606628418 time for calcul the mask position with numpy : 0.0514826774597168 nb_pixel_total : 14256 time to create 1 rle with old method : 0.015424966812133789 time for calcul the mask position with numpy : 0.0557248592376709 nb_pixel_total : 323248 time to create 1 rle with new method : 1.5991404056549072 time for calcul the mask position with numpy : 0.05491352081298828 nb_pixel_total : 398574 time to create 1 rle with new method : 2.2768607139587402 time for calcul the mask position with numpy : 0.05395245552062988 nb_pixel_total : 12242 time to create 1 rle with old method : 0.014389276504516602 time for calcul the mask position with numpy : 0.057151079177856445 nb_pixel_total : 33116 time to create 1 rle with old method : 0.04340624809265137 time for calcul the mask position with numpy : 0.054627418518066406 nb_pixel_total : 33550 time to create 1 rle with old method : 0.03906536102294922 time for calcul the mask position with numpy : 0.05974316596984863 nb_pixel_total : 141692 time to create 1 rle with old method : 0.16525006294250488 time for calcul the mask position with numpy : 0.05547022819519043 nb_pixel_total : 25854 time to create 1 rle with old method : 0.03124523162841797 time for calcul the mask position with numpy : 0.05482172966003418 nb_pixel_total : 47451 time to create 1 rle with old method : 0.053704023361206055 time for calcul the mask position with numpy : 0.05818486213684082 nb_pixel_total : 75701 time to create 1 rle with old method : 0.0890045166015625 time for calcul the mask position with numpy : 0.05917048454284668 nb_pixel_total : 179183 time to create 1 rle with new method : 1.1642796993255615 time for calcul the mask position with numpy : 0.054116010665893555 nb_pixel_total : 38567 time to create 1 rle with old method : 0.04367852210998535 time for calcul the mask position with numpy : 0.0558018684387207 nb_pixel_total : 104742 time to create 1 rle with old method : 0.12207722663879395 time for calcul the mask position with numpy : 0.054804086685180664 nb_pixel_total : 180392 time to create 1 rle with new method : 1.4304335117340088 time for calcul the mask position with numpy : 0.06481432914733887 nb_pixel_total : 746712 time to create 1 rle with new method : 2.395331382751465 time for calcul the mask position with numpy : 0.055117130279541016 nb_pixel_total : 85894 time to create 1 rle with old method : 0.09779024124145508 time for calcul the mask position with numpy : 0.05434274673461914 nb_pixel_total : 68689 time to create 1 rle with old method : 0.07723426818847656 time for calcul the mask position with numpy : 0.05474591255187988 nb_pixel_total : 21034 time to create 1 rle with old method : 0.023726463317871094 time for calcul the mask position with numpy : 0.054135799407958984 nb_pixel_total : 37983 time to create 1 rle with old method : 0.04279494285583496 time for calcul the mask position with numpy : 0.05535626411437988 nb_pixel_total : 174253 time to create 1 rle with new method : 1.9374523162841797 time for calcul the mask position with numpy : 0.05437016487121582 nb_pixel_total : 17278 time to create 1 rle with old method : 0.019969463348388672 time for calcul the mask position with numpy : 0.05593562126159668 nb_pixel_total : 247076 time to create 1 rle with new method : 1.6100084781646729 time for calcul the mask position with numpy : 0.06371116638183594 nb_pixel_total : 659244 time to create 1 rle with new method : 1.4758565425872803 time for calcul the mask position with numpy : 0.05388617515563965 nb_pixel_total : 3351 time to create 1 rle with old method : 0.004134416580200195 time for calcul the mask position with numpy : 0.052643537521362305 nb_pixel_total : 15070 time to create 1 rle with old method : 0.016496896743774414 time for calcul the mask position with numpy : 0.05197262763977051 nb_pixel_total : 31231 time to create 1 rle with old method : 0.049809932708740234 time for calcul the mask position with numpy : 0.05379366874694824 nb_pixel_total : 201 time to create 1 rle with old method : 0.00031566619873046875 time for calcul the mask position with numpy : 0.05446147918701172 nb_pixel_total : 48920 time to create 1 rle with old method : 0.05527019500732422 time for calcul the mask position with numpy : 0.06554388999938965 nb_pixel_total : 72151 time to create 1 rle with old method : 0.10042405128479004 time for calcul the mask position with numpy : 0.057819366455078125 nb_pixel_total : 81938 time to create 1 rle with old method : 0.09195423126220703 time for calcul the mask position with numpy : 0.05439901351928711 nb_pixel_total : 42185 time to create 1 rle with old method : 0.047260284423828125 time for calcul the mask position with numpy : 0.055382728576660156 nb_pixel_total : 193855 time to create 1 rle with new method : 1.9366481304168701 time for calcul the mask position with numpy : 0.05504560470581055 nb_pixel_total : 52129 time to create 1 rle with old method : 0.06020331382751465 time for calcul the mask position with numpy : 0.056066036224365234 nb_pixel_total : 252787 time to create 1 rle with new method : 1.0785737037658691 time for calcul the mask position with numpy : 0.056264400482177734 nb_pixel_total : 210131 time to create 1 rle with new method : 1.130368709564209 time for calcul the mask position with numpy : 0.05602836608886719 nb_pixel_total : 64533 time to create 1 rle with old method : 0.07315707206726074 time for calcul the mask position with numpy : 0.054239511489868164 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0022237300872802734 time for calcul the mask position with numpy : 0.05543661117553711 nb_pixel_total : 232543 time to create 1 rle with new method : 1.1885716915130615 time for calcul the mask position with numpy : 0.06453418731689453 nb_pixel_total : 975808 time to create 1 rle with new method : 1.2546019554138184 time for calcul the mask position with numpy : 0.05589437484741211 nb_pixel_total : 333746 time to create 1 rle with new method : 0.8284251689910889 time for calcul the mask position with numpy : 0.05556011199951172 nb_pixel_total : 498542 time to create 1 rle with new method : 1.3375730514526367 time for calcul the mask position with numpy : 0.05488133430480957 nb_pixel_total : 66089 time to create 1 rle with old method : 0.07496380805969238 time for calcul the mask position with numpy : 0.055388450622558594 nb_pixel_total : 94662 time to create 1 rle with old method : 0.11080598831176758 time for calcul the mask position with numpy : 0.05384683609008789 nb_pixel_total : 470 time to create 1 rle with old method : 0.0009191036224365234 time for calcul the mask position with numpy : 0.056160926818847656 nb_pixel_total : 283538 time to create 1 rle with new method : 1.3137431144714355 time for calcul the mask position with numpy : 0.05707383155822754 nb_pixel_total : 11254 time to create 1 rle with old method : 0.018662691116333008 time for calcul the mask position with numpy : 0.05818772315979004 nb_pixel_total : 151527 time to create 1 rle with new method : 2.3579626083374023 time for calcul the mask position with numpy : 0.05305147171020508 nb_pixel_total : 45223 time to create 1 rle with old method : 0.048980712890625 time for calcul the mask position with numpy : 0.05242443084716797 nb_pixel_total : 320 time to create 1 rle with old method : 0.0006251335144042969 time for calcul the mask position with numpy : 0.052651166915893555 nb_pixel_total : 9 time to create 1 rle with old method : 4.458427429199219e-05 time for calcul the mask position with numpy : 0.05275726318359375 nb_pixel_total : 25118 time to create 1 rle with old method : 0.027510881423950195 create new chi : 40.981497049331665 time to delete rle : 0.007955074310302734 batch 1 Loaded 71 chid ids of type : 4855 Number RLEs to save : 62691 TO DO : save crop sub photo not yet done ! save time : 3.3858749866485596 nb_obj : 61 nb_hashtags : 10 time to prepare the origin masks : 49.32055163383484 time for calcul the mask position with numpy : 0.35141873359680176 nb_pixel_total : 3501195 time to create 1 rle with new method : 1.3052821159362793 time for calcul the mask position with numpy : 0.05619311332702637 nb_pixel_total : 222674 time to create 1 rle with new method : 0.8891148567199707 time for calcul the mask position with numpy : 0.08073973655700684 nb_pixel_total : 905772 time to create 1 rle with new method : 0.9153847694396973 time for calcul the mask position with numpy : 0.053128957748413086 nb_pixel_total : 59992 time to create 1 rle with old method : 0.06386756896972656 time for calcul the mask position with numpy : 0.05234980583190918 nb_pixel_total : 40442 time to create 1 rle with old method : 0.04318571090698242 time for calcul the mask position with numpy : 0.05169677734375 nb_pixel_total : 37981 time to create 1 rle with old method : 0.04069089889526367 time for calcul the mask position with numpy : 0.07480120658874512 nb_pixel_total : 1400556 time to create 1 rle with new method : 0.8573324680328369 time for calcul the mask position with numpy : 0.05274558067321777 nb_pixel_total : 26656 time to create 1 rle with old method : 0.028929948806762695 time for calcul the mask position with numpy : 0.05196571350097656 nb_pixel_total : 14269 time to create 1 rle with old method : 0.016900300979614258 time for calcul the mask position with numpy : 0.05273866653442383 nb_pixel_total : 57547 time to create 1 rle with old method : 0.06351304054260254 time for calcul the mask position with numpy : 0.053679704666137695 nb_pixel_total : 290125 time to create 1 rle with new method : 0.7188301086425781 time for calcul the mask position with numpy : 0.05306291580200195 nb_pixel_total : 7564 time to create 1 rle with old method : 0.008469343185424805 time for calcul the mask position with numpy : 0.05302572250366211 nb_pixel_total : 40547 time to create 1 rle with old method : 0.04505634307861328 time for calcul the mask position with numpy : 0.05226302146911621 nb_pixel_total : 52647 time to create 1 rle with old method : 0.06101870536804199 time for calcul the mask position with numpy : 0.053304433822631836 nb_pixel_total : 55357 time to create 1 rle with old method : 0.060832977294921875 time for calcul the mask position with numpy : 0.06068563461303711 nb_pixel_total : 169059 time to create 1 rle with new method : 0.8099339008331299 time for calcul the mask position with numpy : 0.054799556732177734 nb_pixel_total : 2008 time to create 1 rle with old method : 0.002545595169067383 time for calcul the mask position with numpy : 0.0535893440246582 nb_pixel_total : 21961 time to create 1 rle with old method : 0.025643587112426758 time for calcul the mask position with numpy : 0.05309295654296875 nb_pixel_total : 25520 time to create 1 rle with old method : 0.030481338500976562 time for calcul the mask position with numpy : 0.057311058044433594 nb_pixel_total : 136626 time to create 1 rle with old method : 0.15398287773132324 time for calcul the mask position with numpy : 0.05487704277038574 nb_pixel_total : 299037 time to create 1 rle with new method : 0.7569606304168701 time for calcul the mask position with numpy : 0.05348634719848633 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0020868778228759766 time for calcul the mask position with numpy : 0.05196118354797363 nb_pixel_total : 47851 time to create 1 rle with old method : 0.05200314521789551 time for calcul the mask position with numpy : 0.05279541015625 nb_pixel_total : 249105 time to create 1 rle with new method : 0.6800830364227295 time for calcul the mask position with numpy : 0.06116676330566406 nb_pixel_total : 866962 time to create 1 rle with new method : 0.8193562030792236 time for calcul the mask position with numpy : 0.0549321174621582 nb_pixel_total : 115881 time to create 1 rle with old method : 0.1347031593322754 time for calcul the mask position with numpy : 0.054476022720336914 nb_pixel_total : 62407 time to create 1 rle with old method : 0.0740509033203125 time for calcul the mask position with numpy : 0.057613372802734375 nb_pixel_total : 19162 time to create 1 rle with old method : 0.04853343963623047 time for calcul the mask position with numpy : 0.06187629699707031 nb_pixel_total : 213206 time to create 1 rle with new method : 1.6666295528411865 time for calcul the mask position with numpy : 0.05376434326171875 nb_pixel_total : 2825 time to create 1 rle with old method : 0.004021406173706055 time for calcul the mask position with numpy : 0.053765058517456055 nb_pixel_total : 15812 time to create 1 rle with old method : 0.018035173416137695 time for calcul the mask position with numpy : 0.053594112396240234 nb_pixel_total : 4281 time to create 1 rle with old method : 0.004993438720703125 time for calcul the mask position with numpy : 0.059198617935180664 nb_pixel_total : 439596 time to create 1 rle with new method : 1.443640947341919 time for calcul the mask position with numpy : 0.06327033042907715 nb_pixel_total : 194592 time to create 1 rle with new method : 1.467597484588623 time for calcul the mask position with numpy : 0.06091928482055664 nb_pixel_total : 134495 time to create 1 rle with old method : 0.1582331657409668 time for calcul the mask position with numpy : 0.05547499656677246 nb_pixel_total : 137188 time to create 1 rle with old method : 0.15506815910339355 time for calcul the mask position with numpy : 0.05347108840942383 nb_pixel_total : 68944 time to create 1 rle with old method : 0.07670879364013672 time for calcul the mask position with numpy : 0.0552215576171875 nb_pixel_total : 131064 time to create 1 rle with old method : 0.2033829689025879 time for calcul the mask position with numpy : 0.05463123321533203 nb_pixel_total : 80492 time to create 1 rle with old method : 0.13232755661010742 time for calcul the mask position with numpy : 0.05372881889343262 nb_pixel_total : 22752 time to create 1 rle with old method : 0.02654886245727539 time for calcul the mask position with numpy : 0.05858659744262695 nb_pixel_total : 718201 time to create 1 rle with new method : 1.4170734882354736 time for calcul the mask position with numpy : 0.06966257095336914 nb_pixel_total : 11626 time to create 1 rle with old method : 0.01353144645690918 time for calcul the mask position with numpy : 0.05396437644958496 nb_pixel_total : 79446 time to create 1 rle with old method : 0.08661508560180664 time for calcul the mask position with numpy : 0.055589914321899414 nb_pixel_total : 108781 time to create 1 rle with old method : 0.12126040458679199 time for calcul the mask position with numpy : 0.059914350509643555 nb_pixel_total : 511624 time to create 1 rle with new method : 1.1283776760101318 time for calcul the mask position with numpy : 0.05488729476928711 nb_pixel_total : 164 time to create 1 rle with old method : 0.00046896934509277344 time for calcul the mask position with numpy : 0.05466961860656738 nb_pixel_total : 14541 time to create 1 rle with old method : 0.01685500144958496 time for calcul the mask position with numpy : 0.05490255355834961 nb_pixel_total : 100972 time to create 1 rle with old method : 0.11362981796264648 time for calcul the mask position with numpy : 0.053783416748046875 nb_pixel_total : 35148 time to create 1 rle with old method : 0.03799605369567871 time for calcul the mask position with numpy : 0.051192522048950195 nb_pixel_total : 1154 time to create 1 rle with old method : 0.0015299320220947266 time for calcul the mask position with numpy : 0.061395883560180664 nb_pixel_total : 714896 time to create 1 rle with new method : 0.6707713603973389 time for calcul the mask position with numpy : 0.05399680137634277 nb_pixel_total : 1637 time to create 1 rle with old method : 0.002163410186767578 time for calcul the mask position with numpy : 0.05694770812988281 nb_pixel_total : 78463 time to create 1 rle with old method : 0.08728671073913574 time for calcul the mask position with numpy : 0.052527666091918945 nb_pixel_total : 5062 time to create 1 rle with old method : 0.0058100223541259766 time for calcul the mask position with numpy : 0.053932905197143555 nb_pixel_total : 131394 time to create 1 rle with old method : 0.14493274688720703 time for calcul the mask position with numpy : 0.05330991744995117 nb_pixel_total : 111168 time to create 1 rle with old method : 0.15098023414611816 time for calcul the mask position with numpy : 0.054369449615478516 nb_pixel_total : 7499 time to create 1 rle with old method : 0.011654138565063477 time for calcul the mask position with numpy : 0.0616757869720459 nb_pixel_total : 26045 time to create 1 rle with old method : 0.03383040428161621 time for calcul the mask position with numpy : 0.054784297943115234 nb_pixel_total : 610 time to create 1 rle with old method : 0.0007114410400390625 time for calcul the mask position with numpy : 0.05292963981628418 nb_pixel_total : 2253 time to create 1 rle with old method : 0.0026731491088867188 time for calcul the mask position with numpy : 0.05340075492858887 nb_pixel_total : 38145 time to create 1 rle with old method : 0.04267120361328125 time for calcul the mask position with numpy : 0.054244279861450195 nb_pixel_total : 104475 time to create 1 rle with old method : 0.11759066581726074 create new chi : 22.787203311920166 time to delete rle : 0.005806922912597656 batch 1 Loaded 62 chid ids of type : 4855 Number RLEs to save : 56721 TO DO : save crop sub photo not yet done ! save time : 3.355055332183838 nb_obj : 77 nb_hashtags : 10 time to prepare the origin masks : 53.46958565711975 time for calcul the mask position with numpy : 0.8847365379333496 nb_pixel_total : 3960675 time to create 1 rle with new method : 1.3584692478179932 time for calcul the mask position with numpy : 0.052937984466552734 nb_pixel_total : 50549 time to create 1 rle with old method : 0.05664205551147461 time for calcul the mask position with numpy : 0.05796194076538086 nb_pixel_total : 78359 time to create 1 rle with old method : 0.08917641639709473 time for calcul the mask position with numpy : 0.0807793140411377 nb_pixel_total : 1190506 time to create 1 rle with new method : 0.7967708110809326 time for calcul the mask position with numpy : 0.05033731460571289 nb_pixel_total : 5067 time to create 1 rle with old method : 0.005693197250366211 time for calcul the mask position with numpy : 0.051618337631225586 nb_pixel_total : 77614 time to create 1 rle with old method : 0.08308625221252441 time for calcul the mask position with numpy : 0.05121970176696777 nb_pixel_total : 4061 time to create 1 rle with old method : 0.005972385406494141 time for calcul the mask position with numpy : 0.05312228202819824 nb_pixel_total : 387952 time to create 1 rle with new method : 0.7738726139068604 time for calcul the mask position with numpy : 0.05173158645629883 nb_pixel_total : 51271 time to create 1 rle with old method : 0.05634903907775879 time for calcul the mask position with numpy : 0.05199027061462402 nb_pixel_total : 6847 time to create 1 rle with old method : 0.007597208023071289 time for calcul the mask position with numpy : 0.05155444145202637 nb_pixel_total : 417157 time to create 1 rle with new method : 0.81661057472229 time for calcul the mask position with numpy : 0.05203413963317871 nb_pixel_total : 681 time to create 1 rle with old method : 0.0012137889862060547 time for calcul the mask position with numpy : 0.06105637550354004 nb_pixel_total : 44666 time to create 1 rle with old method : 0.050580739974975586 time for calcul the mask position with numpy : 0.05375242233276367 nb_pixel_total : 40432 time to create 1 rle with old method : 0.05224299430847168 time for calcul the mask position with numpy : 0.060652971267700195 nb_pixel_total : 42134 time to create 1 rle with old method : 0.04575014114379883 time for calcul the mask position with numpy : 0.051770925521850586 nb_pixel_total : 994 time to create 1 rle with old method : 0.0017018318176269531 time for calcul the mask position with numpy : 0.053972721099853516 nb_pixel_total : 80139 time to create 1 rle with old method : 0.08876419067382812 time for calcul the mask position with numpy : 0.05506396293640137 nb_pixel_total : 277886 time to create 1 rle with new method : 0.8541254997253418 time for calcul the mask position with numpy : 0.052930593490600586 nb_pixel_total : 83541 time to create 1 rle with old method : 0.0884549617767334 time for calcul the mask position with numpy : 0.05058550834655762 nb_pixel_total : 27925 time to create 1 rle with old method : 0.030077457427978516 time for calcul the mask position with numpy : 0.05022430419921875 nb_pixel_total : 52428 time to create 1 rle with old method : 0.05456876754760742 time for calcul the mask position with numpy : 0.05302166938781738 nb_pixel_total : 558 time to create 1 rle with old method : 0.0009477138519287109 time for calcul the mask position with numpy : 0.05171060562133789 nb_pixel_total : 42756 time to create 1 rle with old method : 0.04506039619445801 time for calcul the mask position with numpy : 0.04926586151123047 nb_pixel_total : 6 time to create 1 rle with old method : 3.528594970703125e-05 time for calcul the mask position with numpy : 0.0516514778137207 nb_pixel_total : 191348 time to create 1 rle with new method : 0.7785961627960205 time for calcul the mask position with numpy : 0.05263805389404297 nb_pixel_total : 56075 time to create 1 rle with old method : 0.0614469051361084 time for calcul the mask position with numpy : 0.05158090591430664 nb_pixel_total : 87306 time to create 1 rle with old method : 0.09519147872924805 time for calcul the mask position with numpy : 0.05358386039733887 nb_pixel_total : 118994 time to create 1 rle with old method : 0.12774252891540527 time for calcul the mask position with numpy : 0.0522921085357666 nb_pixel_total : 10131 time to create 1 rle with old method : 0.011179208755493164 time for calcul the mask position with numpy : 0.05161166191101074 nb_pixel_total : 72124 time to create 1 rle with old method : 0.07429814338684082 time for calcul the mask position with numpy : 0.05002164840698242 nb_pixel_total : 14312 time to create 1 rle with old method : 0.015178918838500977 time for calcul the mask position with numpy : 0.05060434341430664 nb_pixel_total : 277 time to create 1 rle with old method : 0.00042057037353515625 time for calcul the mask position with numpy : 0.05312037467956543 nb_pixel_total : 281842 time to create 1 rle with new method : 0.7758104801177979 time for calcul the mask position with numpy : 0.057097434997558594 nb_pixel_total : 155808 time to create 1 rle with new method : 0.7833406925201416 time for calcul the mask position with numpy : 0.053931474685668945 nb_pixel_total : 565 time to create 1 rle with old method : 0.0013155937194824219 time for calcul the mask position with numpy : 0.053084611892700195 nb_pixel_total : 52351 time to create 1 rle with old method : 0.056351661682128906 time for calcul the mask position with numpy : 0.054743051528930664 nb_pixel_total : 176592 time to create 1 rle with new method : 1.1892304420471191 time for calcul the mask position with numpy : 0.05357551574707031 nb_pixel_total : 400823 time to create 1 rle with new method : 0.8531336784362793 time for calcul the mask position with numpy : 0.052961111068725586 nb_pixel_total : 77391 time to create 1 rle with old method : 0.08355832099914551 time for calcul the mask position with numpy : 0.053481101989746094 nb_pixel_total : 32858 time to create 1 rle with old method : 0.04946732521057129 time for calcul the mask position with numpy : 0.05816459655761719 nb_pixel_total : 48396 time to create 1 rle with old method : 0.05903506278991699 time for calcul the mask position with numpy : 0.0531611442565918 nb_pixel_total : 105902 time to create 1 rle with old method : 0.11298394203186035 time for calcul the mask position with numpy : 0.050464630126953125 nb_pixel_total : 24578 time to create 1 rle with old method : 0.026535511016845703 time for calcul the mask position with numpy : 0.052294015884399414 nb_pixel_total : 161647 time to create 1 rle with new method : 0.7795536518096924 time for calcul the mask position with numpy : 0.05227088928222656 nb_pixel_total : 45889 time to create 1 rle with old method : 0.07374978065490723 time for calcul the mask position with numpy : 0.05415511131286621 nb_pixel_total : 1185 time to create 1 rle with old method : 0.0016503334045410156 time for calcul the mask position with numpy : 0.05433511734008789 nb_pixel_total : 21695 time to create 1 rle with old method : 0.02477264404296875 time for calcul the mask position with numpy : 0.07207632064819336 nb_pixel_total : 1575205 time to create 1 rle with new method : 0.8948025703430176 time for calcul the mask position with numpy : 0.050423383712768555 nb_pixel_total : 36817 time to create 1 rle with old method : 0.0411829948425293 time for calcul the mask position with numpy : 0.050900936126708984 nb_pixel_total : 19124 time to create 1 rle with old method : 0.020294666290283203 time for calcul the mask position with numpy : 0.05208230018615723 nb_pixel_total : 226899 time to create 1 rle with new method : 0.7013547420501709 time for calcul the mask position with numpy : 0.052826642990112305 nb_pixel_total : 314464 time to create 1 rle with new method : 0.9753479957580566 time for calcul the mask position with numpy : 0.05149412155151367 nb_pixel_total : 447 time to create 1 rle with old method : 0.0006635189056396484 time for calcul the mask position with numpy : 0.05070805549621582 nb_pixel_total : 12687 time to create 1 rle with old method : 0.014160871505737305 time for calcul the mask position with numpy : 0.04952812194824219 nb_pixel_total : 53717 time to create 1 rle with old method : 0.05961108207702637 time for calcul the mask position with numpy : 0.05434012413024902 nb_pixel_total : 551819 time to create 1 rle with new method : 0.7736506462097168 time for calcul the mask position with numpy : 0.050711870193481445 nb_pixel_total : 13051 time to create 1 rle with old method : 0.014141082763671875 time for calcul the mask position with numpy : 0.04980731010437012 nb_pixel_total : 76091 time to create 1 rle with old method : 0.08057498931884766 time for calcul the mask position with numpy : 0.04963183403015137 nb_pixel_total : 24 time to create 1 rle with old method : 5.221366882324219e-05 time for calcul the mask position with numpy : 0.049337148666381836 nb_pixel_total : 49594 time to create 1 rle with old method : 0.051218509674072266 time for calcul the mask position with numpy : 0.049991607666015625 nb_pixel_total : 35195 time to create 1 rle with old method : 0.036127567291259766 time for calcul the mask position with numpy : 0.05001544952392578 nb_pixel_total : 144374 time to create 1 rle with old method : 0.15016388893127441 time for calcul the mask position with numpy : 0.05173349380493164 nb_pixel_total : 63508 time to create 1 rle with old method : 0.0664680004119873 time for calcul the mask position with numpy : 0.04964280128479004 nb_pixel_total : 107409 time to create 1 rle with old method : 0.11151623725891113 time for calcul the mask position with numpy : 0.05052804946899414 nb_pixel_total : 115408 time to create 1 rle with old method : 0.11796092987060547 time for calcul the mask position with numpy : 0.04938220977783203 nb_pixel_total : 15791 time to create 1 rle with old method : 0.016385555267333984 time for calcul the mask position with numpy : 0.0585024356842041 nb_pixel_total : 116 time to create 1 rle with old method : 0.0004086494445800781 time for calcul the mask position with numpy : 0.053200721740722656 nb_pixel_total : 180008 time to create 1 rle with new method : 0.8287820816040039 time for calcul the mask position with numpy : 0.04997706413269043 nb_pixel_total : 1462 time to create 1 rle with old method : 0.0021638870239257812 time for calcul the mask position with numpy : 0.04993247985839844 nb_pixel_total : 35123 time to create 1 rle with old method : 0.03638291358947754 time for calcul the mask position with numpy : 0.049048662185668945 nb_pixel_total : 534 time to create 1 rle with old method : 0.0006136894226074219 time for calcul the mask position with numpy : 0.0494534969329834 nb_pixel_total : 70624 time to create 1 rle with old method : 0.07329797744750977 time for calcul the mask position with numpy : 0.05025601387023926 nb_pixel_total : 46236 time to create 1 rle with old method : 0.04793667793273926 time for calcul the mask position with numpy : 0.054169416427612305 nb_pixel_total : 66324 time to create 1 rle with old method : 0.07369852066040039 time for calcul the mask position with numpy : 0.053854942321777344 nb_pixel_total : 52860 time to create 1 rle with old method : 0.05906820297241211 time for calcul the mask position with numpy : 0.053800344467163086 nb_pixel_total : 35807 time to create 1 rle with old method : 0.04179954528808594 time for calcul the mask position with numpy : 0.05378890037536621 nb_pixel_total : 572 time to create 1 rle with old method : 0.0007398128509521484 time for calcul the mask position with numpy : 0.05233359336853027 nb_pixel_total : 15617 time to create 1 rle with old method : 0.01652812957763672 create new chi : 22.553210258483887 time to delete rle : 0.004698514938354492 batch 1 Loaded 78 chid ids of type : 4855 Number RLEs to save : 57429 TO DO : save crop sub photo not yet done ! save time : 3.0175726413726807 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 9.25879693031311 time for calcul the mask position with numpy : 0.08839702606201172 nb_pixel_total : 1906783 time to create 1 rle with new method : 1.1556925773620605 time for calcul the mask position with numpy : 0.04018902778625488 nb_pixel_total : 3817 time to create 1 rle with old method : 0.006659507751464844 time for calcul the mask position with numpy : 0.04085278511047363 nb_pixel_total : 177906 time to create 1 rle with new method : 1.0535640716552734 time for calcul the mask position with numpy : 0.040300846099853516 nb_pixel_total : 105450 time to create 1 rle with old method : 0.12131571769714355 time for calcul the mask position with numpy : 0.0501708984375 nb_pixel_total : 280562 time to create 1 rle with new method : 0.860358715057373 time for calcul the mask position with numpy : 0.043585777282714844 nb_pixel_total : 655013 time to create 1 rle with new method : 0.938910961151123 time for calcul the mask position with numpy : 0.036452531814575195 nb_pixel_total : 39495 time to create 1 rle with old method : 0.042882680892944336 time for calcul the mask position with numpy : 0.7523555755615234 nb_pixel_total : 9810174 time to create 1 rle with new method : 0.940955638885498 create new chi : 6.445260763168335 time to delete rle : 0.0021135807037353516 batch 1 Loaded 8 chid ids of type : 4855 Number RLEs to save : 16658 TO DO : save crop sub photo not yet done ! save time : 0.8986082077026367 map_output_result : {1379845325: (0.3042699611362151, 'Should be the crop_list due to order', 0.1241467772165446), 1379845307: (0.3042699611362151, 'Should be the crop_list due to order', 0.28297496481613865), 1379845305: (0.3042699611362151, 'Should be the crop_list due to order', 0.40947600773418585), 1379845304: (0.3042699611362151, 'Should be the crop_list due to order', 0.16014407472229295), 1379845302: (0.3042699611362151, 'Should be the crop_list due to order', 0.5446079811919134)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379845325, 1379845307, 1379845305, 1379845304, 1379845302] Looping around the photos to save general results len do output : 5 /1379845325.Didn't retrieve data . /1379845307.Didn't retrieve data . /1379845305.Didn't retrieve data . /1379845304.Didn't retrieve data . /1379845302.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845325', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845307', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845305', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845304', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845302', None, None, None, None, None, '3623816') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013881683349609375 save_final save missing photos in datou_result : time spend for datou_step_exec : 339.7817680835724 time spend to save output : 0.01665496826171875 total time spend for step 5 : 339.7984230518341 step6:crop_condition Thu Aug 28 14:30:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 266 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3015255 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384269_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 40 photos in the portfolio 3015255 time of upload the photos Elapsed time : 11.361175537109375 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 3015255 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384332_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 52 photos in the portfolio 3015255 time of upload the photos Elapsed time : 13.988246440887451 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3015255 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384351_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.568202018737793 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3015255 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384358_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.3138890266418457 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3015255 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384370_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.616778612136841 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384378_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.6940462589263916 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3015255 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384403_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.899936199188232 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384412_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.1900322437286377 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3015255 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384418_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.1541483402252197 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3015255 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756384510_3769125 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.701472759246826 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379845325, 1379845307, 1379845305, 1379845304, 1379845302] Looping around the photos to save general results len do output : 184 /1379882294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379882867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845325', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845307', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845305', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845304', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845302', None, None, None, None, None, '3623816') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 557 time used for this insertion : 0.05852079391479492 save_final save missing photos in datou_result : time spend for datou_step_exec : 309.0632874965668 time spend to save output : 0.06233406066894531 total time spend for step 6 : 309.1256215572357 step7:ventilate_hashtags_in_portfolio Thu Aug 28 14:35:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26291507 get user id for portfolio 26291507 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26291507 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26291507 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26291507 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26291507 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/26294454,26294455,26294456,26294457,26294458,26294463,26294465,26294466,26294467,26294468,26294469,26294470,26294472,26294473,26294474,26294475,26294476,26294477,26294478,26294479?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26291507 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379845325, 1379845307, 1379845305, 1379845304, 1379845302] Looping around the photos to save general results len do output : 1 /26291507. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845325', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845307', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845305', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845304', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845302', None, None, None, None, None, '3623816') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013451576232910156 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.45134711265564 time spend to save output : 0.013727664947509766 total time spend for step 7 : 4.465074777603149 step8:final Thu Aug 28 14:35:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379845325: ('0.2567984737532319',), 1379845307: ('0.2567984737532319',), 1379845305: ('0.2567984737532319',), 1379845304: ('0.2567984737532319',), 1379845302: ('0.2567984737532319',)} new output for save of step final : {1379845325: ('0.2567984737532319',), 1379845307: ('0.2567984737532319',), 1379845305: ('0.2567984737532319',), 1379845304: ('0.2567984737532319',), 1379845302: ('0.2567984737532319',)} [1379845325, 1379845307, 1379845305, 1379845304, 1379845302] Looping around the photos to save general results len do output : 5 /1379845325.Didn't retrieve data . /1379845307.Didn't retrieve data . /1379845305.Didn't retrieve data . /1379845304.Didn't retrieve data . /1379845302.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845325', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845307', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845305', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845304', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845302', None, None, None, None, None, '3623816') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.04546308517456055 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12067270278930664 time spend to save output : 0.045881032943725586 total time spend for step 8 : 0.16655373573303223 step9:velours_tree Thu Aug 28 14:35:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.1157472133636475 time spend to save output : 4.00543212890625e-05 total time spend for step 9 : 1.1157872676849365 step10:send_mail_cod Thu Aug 28 14:35:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26291507_28-08-2025_14_35_28.pdf 26294427 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262944271756384528 26294428 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262944281756384529 26294429 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262944291756384531 26294430 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262944301756384532 26294431 imagette262944311756384532 26294432 imagette262944321756384532 26294433 imagette262944331756384532 26294434 imagette262944341756384532 26294435 imagette262944351756384532 26294436 imagette262944361756384532 26294437 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262944371756384532 26294438 change filename to text .change filename to text .change filename to text .change filename to text .imagette262944381756384533 26294439 imagette262944391756384534 26294440 imagette262944401756384534 26294441 imagette262944411756384534 26294442 imagette262944421756384534 26294443 imagette262944431756384534 26294444 change filename to text .imagette262944441756384534 26294445 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262944451756384534 26294447 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262944471756384534 26294448 imagette262944481756384536 26294449 imagette262944491756384536 26294450 imagette262944501756384536 26294451 imagette262944511756384536 26294452 imagette262944521756384536 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26291507 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26294454,26294455,26294456,26294457,26294458,26294463,26294465,26294466,26294467,26294468,26294469,26294470,26294472,26294473,26294474,26294475,26294476,26294477,26294478,26294479?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26291507 your option no_mail is active, we will not send the real mail to your client args[1379845325] : ((1379845325, 754.3929914496592, 492688767), (1379845325, -0.21515406892688782, 496442774), '0.2567984737532319') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379845307] : ((1379845307, 864.5076092871209, 2107751945), (1379845307, -0.1921888761088111, 496442774), '0.2567984737532319') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379845305] : ((1379845305, 651.891588722836, 492688767), (1379845305, -0.47874568264005013, 496442774), '0.2567984737532319') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379845304] : ((1379845304, 1790.7883973240585, 2107751945), (1379845304, -0.47035065996456743, 496442774), '0.2567984737532319') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379845302] : ((1379845302, 99.77327647138509, 492688767), (1379845302, 0.11625136051348782, 2107752395), '0.2567984737532319') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.2567984737532319 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26291507_28-08-2025_14_35_28.pdf results_Auto_P26291507_28-08-2025_14_35_28.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26291507_28-08-2025_14_35_28.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','26291507','results_Auto_P26291507_28-08-2025_14_35_28.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26291507_28-08-2025_14_35_28.pdf','pdf','','2.43','0.2567984737532319') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379845325, 1379845307, 1379845305, 1379845304, 1379845302] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845325', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845307', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845305', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845304', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845302', None, None, None, None, None, '3623816') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013356685638427734 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.035760641098022 time spend to save output : 0.013623952865600586 total time spend for step 10 : 12.049384593963623 step11:split_time_score Thu Aug 28 14:35:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('59', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26082025 26291507 Nombre de photos uploadées : 5 / 23040 (0%) 26082025 26291507 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 26082025 26291507 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.0003085136413574219 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2129828929901123 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26291504 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26291505 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26291506 order by id desc limit 1 Qualite : 0.2567984737532319 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26291507_28-08-2025_14_35_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26291507 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26291507 AND mptpi.`type`=4855 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26291508 order by id desc limit 1 Qualite : 0.44521359328707644 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26291509_28-08-2025_14_18_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26291509 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26291509 AND mptpi.`type`=4855 To do Qualite : 0.5227519267425498 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26291510_28-08-2025_12_42_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26291510 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26291510 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26082025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379845325, 1379845307, 1379845305, 1379845304, 1379845302] Looping around the photos to save general results len do output : 1 /26291507Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845325', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845307', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845305', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845304', None, None, None, None, None, '3623816') ('4741', None, None, None, None, None, None, None, '3623816') ('4741', '26291507', '1379845302', None, None, None, None, None, '3623816') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015878677368164062 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.285465478897095 time spend to save output : 0.016063451766967773 total time spend for step 11 : 4.3015289306640625 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 546.37user 258.94system 14:19.47elapsed 93%CPU (0avgtext+0avgdata 6306960maxresident)k 1237192inputs+587280outputs (13270major+44060998minor)pagefaults 0swaps