python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3612788 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['3623874'] with mtr_portfolio_ids : ['26292111'] and first list_photo_ids : [] new path : /proc/3612788/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.6508722305297852 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Thu Aug 28 13:21:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10603 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-28 13:21:32.230453: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-28 13:21:32.256491: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-28 13:21:32.258609: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff404000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-28 13:21:32.258658: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-28 13:21:32.262414: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-28 13:21:32.438738: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x40f5c370 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-28 13:21:32.438777: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-28 13:21:32.439983: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:21:32.440319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:21:32.442815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:21:32.444947: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:21:32.445372: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:21:32.448058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:21:32.449517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:21:32.454869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:21:32.456739: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:21:32.456838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:21:32.457835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 13:21:32.457854: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 13:21:32.457866: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 13:21:32.459580: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9821 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-28 13:21:32.734469: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:21:32.734593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:21:32.734614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:21:32.734633: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:21:32.734652: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:21:32.734669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:21:32.734687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:21:32.734705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:21:32.736265: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:21:32.737774: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:21:32.737821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:21:32.737839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:21:32.737857: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:21:32.737892: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:21:32.737911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:21:32.737927: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:21:32.737944: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:21:32.739487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:21:32.739527: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 13:21:32.739538: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 13:21:32.739547: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 13:21:32.741187: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9821 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-28 13:21:45.444592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:21:45.627609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.66250 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 3613119 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5090 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10379 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.0006194114685058594 nb_pixel_total : 22789 time to create 1 rle with old method : 0.026450157165527344 length of segment : 176 time for calcul the mask position with numpy : 0.0008900165557861328 nb_pixel_total : 52567 time to create 1 rle with old method : 0.06330609321594238 length of segment : 323 time for calcul the mask position with numpy : 0.0003597736358642578 nb_pixel_total : 6931 time to create 1 rle with old method : 0.008715391159057617 length of segment : 130 time for calcul the mask position with numpy : 0.0006821155548095703 nb_pixel_total : 48921 time to create 1 rle with old method : 0.055060386657714844 length of segment : 401 time for calcul the mask position with numpy : 0.0008802413940429688 nb_pixel_total : 53746 time to create 1 rle with old method : 0.0631563663482666 length of segment : 307 time for calcul the mask position with numpy : 0.003345012664794922 nb_pixel_total : 86286 time to create 1 rle with old method : 0.09759044647216797 length of segment : 403 time for calcul the mask position with numpy : 0.0013885498046875 nb_pixel_total : 61617 time to create 1 rle with old method : 0.06969714164733887 length of segment : 348 time for calcul the mask position with numpy : 0.0014014244079589844 nb_pixel_total : 88357 time to create 1 rle with old method : 0.09271383285522461 length of segment : 454 time for calcul the mask position with numpy : 0.0007114410400390625 nb_pixel_total : 52168 time to create 1 rle with old method : 0.055318593978881836 length of segment : 286 time for calcul the mask position with numpy : 0.0013897418975830078 nb_pixel_total : 64979 time to create 1 rle with old method : 0.07840728759765625 length of segment : 328 time for calcul the mask position with numpy : 0.0007967948913574219 nb_pixel_total : 35580 time to create 1 rle with old method : 0.04339742660522461 length of segment : 387 time for calcul the mask position with numpy : 0.020888566970825195 nb_pixel_total : 681779 time to create 1 rle with new method : 0.09324502944946289 length of segment : 1355 time for calcul the mask position with numpy : 0.0016608238220214844 nb_pixel_total : 87523 time to create 1 rle with old method : 0.10009193420410156 length of segment : 353 time for calcul the mask position with numpy : 0.0017421245574951172 nb_pixel_total : 66134 time to create 1 rle with old method : 0.07619023323059082 length of segment : 435 time for calcul the mask position with numpy : 0.0008547306060791016 nb_pixel_total : 39882 time to create 1 rle with old method : 0.0496373176574707 length of segment : 252 time for calcul the mask position with numpy : 0.0014603137969970703 nb_pixel_total : 71772 time to create 1 rle with old method : 0.08649301528930664 length of segment : 561 time for calcul the mask position with numpy : 0.00029540061950683594 nb_pixel_total : 14878 time to create 1 rle with old method : 0.017527341842651367 length of segment : 92 time for calcul the mask position with numpy : 0.0005245208740234375 nb_pixel_total : 16440 time to create 1 rle with old method : 0.020263671875 length of segment : 220 time for calcul the mask position with numpy : 0.00037598609924316406 nb_pixel_total : 20975 time to create 1 rle with old method : 0.023038864135742188 length of segment : 170 time for calcul the mask position with numpy : 0.0018558502197265625 nb_pixel_total : 70847 time to create 1 rle with old method : 0.07406926155090332 length of segment : 313 time for calcul the mask position with numpy : 0.001322031021118164 nb_pixel_total : 69903 time to create 1 rle with old method : 0.07902169227600098 length of segment : 355 time for calcul the mask position with numpy : 0.0011165142059326172 nb_pixel_total : 58259 time to create 1 rle with old method : 0.06138348579406738 length of segment : 435 time for calcul the mask position with numpy : 0.0008406639099121094 nb_pixel_total : 50070 time to create 1 rle with old method : 0.0558319091796875 length of segment : 410 time for calcul the mask position with numpy : 0.0008332729339599609 nb_pixel_total : 38058 time to create 1 rle with old method : 0.04906487464904785 length of segment : 294 time for calcul the mask position with numpy : 0.0006639957427978516 nb_pixel_total : 30568 time to create 1 rle with old method : 0.042443037033081055 length of segment : 216 time for calcul the mask position with numpy : 0.0015101432800292969 nb_pixel_total : 33433 time to create 1 rle with old method : 0.037882328033447266 length of segment : 323 time for calcul the mask position with numpy : 0.0006694793701171875 nb_pixel_total : 31515 time to create 1 rle with old method : 0.03322863578796387 length of segment : 220 time for calcul the mask position with numpy : 0.0005443096160888672 nb_pixel_total : 34939 time to create 1 rle with old method : 0.03812003135681152 length of segment : 327 time for calcul the mask position with numpy : 0.0022399425506591797 nb_pixel_total : 56430 time to create 1 rle with old method : 0.06155967712402344 length of segment : 411 time for calcul the mask position with numpy : 0.002502918243408203 nb_pixel_total : 81958 time to create 1 rle with old method : 0.09352517127990723 length of segment : 335 time for calcul the mask position with numpy : 0.005129575729370117 nb_pixel_total : 135432 time to create 1 rle with old method : 0.1494765281677246 length of segment : 745 time for calcul the mask position with numpy : 0.00040340423583984375 nb_pixel_total : 14306 time to create 1 rle with old method : 0.015852928161621094 length of segment : 109 time for calcul the mask position with numpy : 0.0030221939086914062 nb_pixel_total : 119177 time to create 1 rle with old method : 0.13385438919067383 length of segment : 805 time for calcul the mask position with numpy : 0.001138925552368164 nb_pixel_total : 41935 time to create 1 rle with old method : 0.04708242416381836 length of segment : 312 time for calcul the mask position with numpy : 0.0010035037994384766 nb_pixel_total : 28233 time to create 1 rle with old method : 0.03257250785827637 length of segment : 233 time for calcul the mask position with numpy : 0.002507925033569336 nb_pixel_total : 134783 time to create 1 rle with old method : 0.23147058486938477 length of segment : 536 time for calcul the mask position with numpy : 0.0012097358703613281 nb_pixel_total : 31637 time to create 1 rle with old method : 0.035961151123046875 length of segment : 397 time for calcul the mask position with numpy : 0.003039836883544922 nb_pixel_total : 109973 time to create 1 rle with old method : 0.1820518970489502 length of segment : 478 time for calcul the mask position with numpy : 0.0026960372924804688 nb_pixel_total : 82060 time to create 1 rle with old method : 0.09153366088867188 length of segment : 561 time for calcul the mask position with numpy : 0.0038115978240966797 nb_pixel_total : 179343 time to create 1 rle with new method : 0.008614063262939453 length of segment : 421 time for calcul the mask position with numpy : 0.0029730796813964844 nb_pixel_total : 100102 time to create 1 rle with old method : 0.11322760581970215 length of segment : 797 time for calcul the mask position with numpy : 0.0015914440155029297 nb_pixel_total : 36788 time to create 1 rle with old method : 0.04700493812561035 length of segment : 255 time for calcul the mask position with numpy : 0.0006911754608154297 nb_pixel_total : 21673 time to create 1 rle with old method : 0.02525782585144043 length of segment : 122 time for calcul the mask position with numpy : 0.0030755996704101562 nb_pixel_total : 133069 time to create 1 rle with old method : 0.14866161346435547 length of segment : 547 time for calcul the mask position with numpy : 0.0008573532104492188 nb_pixel_total : 32528 time to create 1 rle with old method : 0.037188053131103516 length of segment : 135 time for calcul the mask position with numpy : 0.0019752979278564453 nb_pixel_total : 66850 time to create 1 rle with old method : 0.07587933540344238 length of segment : 241 time for calcul the mask position with numpy : 0.0027167797088623047 nb_pixel_total : 49489 time to create 1 rle with old method : 0.05466771125793457 length of segment : 594 time for calcul the mask position with numpy : 0.0016312599182128906 nb_pixel_total : 71459 time to create 1 rle with old method : 0.07977008819580078 length of segment : 293 time for calcul the mask position with numpy : 0.0010733604431152344 nb_pixel_total : 29117 time to create 1 rle with old method : 0.048627614974975586 length of segment : 177 time for calcul the mask position with numpy : 0.0009417533874511719 nb_pixel_total : 36661 time to create 1 rle with old method : 0.04194998741149902 length of segment : 221 time for calcul the mask position with numpy : 0.008480072021484375 nb_pixel_total : 407986 time to create 1 rle with new method : 0.024968862533569336 length of segment : 928 time for calcul the mask position with numpy : 0.0009307861328125 nb_pixel_total : 27959 time to create 1 rle with old method : 0.031836748123168945 length of segment : 220 time for calcul the mask position with numpy : 0.00025653839111328125 nb_pixel_total : 4418 time to create 1 rle with old method : 0.005499839782714844 length of segment : 44 time for calcul the mask position with numpy : 0.0017573833465576172 nb_pixel_total : 32056 time to create 1 rle with old method : 0.0365605354309082 length of segment : 381 time for calcul the mask position with numpy : 0.003173828125 nb_pixel_total : 98728 time to create 1 rle with old method : 0.14053702354431152 length of segment : 391 time for calcul the mask position with numpy : 0.0005295276641845703 nb_pixel_total : 19734 time to create 1 rle with old method : 0.02263045310974121 length of segment : 280 time for calcul the mask position with numpy : 0.0006947517395019531 nb_pixel_total : 17219 time to create 1 rle with old method : 0.019062042236328125 length of segment : 144 time for calcul the mask position with numpy : 0.00016641616821289062 nb_pixel_total : 5244 time to create 1 rle with old method : 0.006342887878417969 length of segment : 46 time for calcul the mask position with numpy : 0.0014879703521728516 nb_pixel_total : 31140 time to create 1 rle with old method : 0.03538656234741211 length of segment : 566 time for calcul the mask position with numpy : 0.0006694793701171875 nb_pixel_total : 16719 time to create 1 rle with old method : 0.020323991775512695 length of segment : 128 time for calcul the mask position with numpy : 0.0008463859558105469 nb_pixel_total : 17984 time to create 1 rle with old method : 0.020921707153320312 length of segment : 181 time for calcul the mask position with numpy : 0.0006105899810791016 nb_pixel_total : 14581 time to create 1 rle with old method : 0.016660690307617188 length of segment : 260 time for calcul the mask position with numpy : 0.0009529590606689453 nb_pixel_total : 58645 time to create 1 rle with old method : 0.06392073631286621 length of segment : 247 time for calcul the mask position with numpy : 0.002131223678588867 nb_pixel_total : 120969 time to create 1 rle with old method : 0.13204288482666016 length of segment : 545 time for calcul the mask position with numpy : 0.7371969223022461 nb_pixel_total : 8707865 time to create 1 rle with new method : 1.1985840797424316 length of segment : 4279 time for calcul the mask position with numpy : 0.11337041854858398 nb_pixel_total : 2362666 time to create 1 rle with new method : 0.13455414772033691 length of segment : 1616 time for calcul the mask position with numpy : 0.00029778480529785156 nb_pixel_total : 14021 time to create 1 rle with old method : 0.016213417053222656 length of segment : 136 time for calcul the mask position with numpy : 0.09134292602539062 nb_pixel_total : 1961379 time to create 1 rle with new method : 0.22710275650024414 length of segment : 2531 time for calcul the mask position with numpy : 0.15824627876281738 nb_pixel_total : 2096290 time to create 1 rle with new method : 0.11043334007263184 length of segment : 1842 time spent for convertir_results : 12.967652797698975 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 69 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 65.02624583244324 time spend to save output : 0.16693615913391113 total time spend for step 1 : 65.19318199157715 step2:mask_detect Thu Aug 28 13:22:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10226 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-28 13:22:37.377134: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-28 13:22:37.404591: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-28 13:22:37.407033: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff3f0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-28 13:22:37.407094: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-28 13:22:37.410942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-28 13:22:37.546308: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x42370a20 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-28 13:22:37.546353: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-28 13:22:37.547695: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:22:37.548098: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:22:37.551140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:22:37.553946: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:22:37.554332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:22:37.556925: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:22:37.558251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:22:37.563630: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:22:37.565471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:22:37.565553: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:22:37.566297: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 13:22:37.566312: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 13:22:37.566321: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 13:22:37.567601: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9470 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-28 13:22:37.713591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:22:37.713722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:22:37.713765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:22:37.713789: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:22:37.713809: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:22:37.713830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:22:37.713849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:22:37.713870: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:22:37.715396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:22:37.716789: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 13:22:37.716829: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 13:22:37.716850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:22:37.716869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 13:22:37.716888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 13:22:37.716907: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 13:22:37.716926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 13:22:37.716945: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 13:22:37.718300: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 13:22:37.718333: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 13:22:37.718341: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 13:22:37.718348: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 13:22:37.719561: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9470 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-28 13:22:52.142115: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 13:22:52.292986: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 72 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 65 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 59 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 59 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 69 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.66250 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 3615059 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5311 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10603 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.029581308364868164 nb_pixel_total : 73356 time to create 1 rle with old method : 0.09085702896118164 length of segment : 348 time for calcul the mask position with numpy : 0.003655672073364258 nb_pixel_total : 129681 time to create 1 rle with old method : 0.14034628868103027 length of segment : 323 time for calcul the mask position with numpy : 0.0008242130279541016 nb_pixel_total : 23228 time to create 1 rle with old method : 0.026056766510009766 length of segment : 186 time for calcul the mask position with numpy : 0.05034923553466797 nb_pixel_total : 90678 time to create 1 rle with old method : 0.1028280258178711 length of segment : 319 time for calcul the mask position with numpy : 0.012283802032470703 nb_pixel_total : 63051 time to create 1 rle with old method : 0.07084202766418457 length of segment : 530 time for calcul the mask position with numpy : 0.011986970901489258 nb_pixel_total : 32267 time to create 1 rle with old method : 0.041857242584228516 length of segment : 230 time for calcul the mask position with numpy : 0.00637054443359375 nb_pixel_total : 78930 time to create 1 rle with old method : 0.08437967300415039 length of segment : 334 time for calcul the mask position with numpy : 0.009659528732299805 nb_pixel_total : 35762 time to create 1 rle with old method : 0.04168415069580078 length of segment : 240 time for calcul the mask position with numpy : 0.04132986068725586 nb_pixel_total : 280842 time to create 1 rle with new method : 0.03006744384765625 length of segment : 739 time for calcul the mask position with numpy : 0.015113592147827148 nb_pixel_total : 51058 time to create 1 rle with old method : 0.055864810943603516 length of segment : 300 time for calcul the mask position with numpy : 0.057965993881225586 nb_pixel_total : 257561 time to create 1 rle with new method : 0.017189979553222656 length of segment : 562 time for calcul the mask position with numpy : 0.016109704971313477 nb_pixel_total : 37743 time to create 1 rle with old method : 0.046751976013183594 length of segment : 411 time for calcul the mask position with numpy : 0.0035927295684814453 nb_pixel_total : 84692 time to create 1 rle with old method : 0.09568548202514648 length of segment : 384 time for calcul the mask position with numpy : 0.007502079010009766 nb_pixel_total : 143644 time to create 1 rle with old method : 0.15613245964050293 length of segment : 539 time for calcul the mask position with numpy : 0.05977892875671387 nb_pixel_total : 214837 time to create 1 rle with new method : 0.0124664306640625 length of segment : 608 time for calcul the mask position with numpy : 0.024749040603637695 nb_pixel_total : 97834 time to create 1 rle with old method : 0.10994601249694824 length of segment : 465 time for calcul the mask position with numpy : 0.005201578140258789 nb_pixel_total : 101429 time to create 1 rle with old method : 0.11144304275512695 length of segment : 442 time for calcul the mask position with numpy : 0.013216018676757812 nb_pixel_total : 249182 time to create 1 rle with new method : 0.015274286270141602 length of segment : 563 time for calcul the mask position with numpy : 0.1283891201019287 nb_pixel_total : 470955 time to create 1 rle with new method : 0.08798527717590332 length of segment : 1413 time for calcul the mask position with numpy : 0.03527379035949707 nb_pixel_total : 376224 time to create 1 rle with new method : 0.018932342529296875 length of segment : 763 time for calcul the mask position with numpy : 0.01816868782043457 nb_pixel_total : 500824 time to create 1 rle with new method : 0.041623830795288086 length of segment : 1038 time for calcul the mask position with numpy : 0.007197380065917969 nb_pixel_total : 111748 time to create 1 rle with old method : 0.12820148468017578 length of segment : 673 time for calcul the mask position with numpy : 0.002423524856567383 nb_pixel_total : 22508 time to create 1 rle with old method : 0.025650501251220703 length of segment : 200 time for calcul the mask position with numpy : 0.006476640701293945 nb_pixel_total : 116775 time to create 1 rle with old method : 0.1336681842803955 length of segment : 624 time for calcul the mask position with numpy : 0.010155200958251953 nb_pixel_total : 90802 time to create 1 rle with old method : 0.10436272621154785 length of segment : 458 time for calcul the mask position with numpy : 0.031641483306884766 nb_pixel_total : 689315 time to create 1 rle with new method : 0.0394132137298584 length of segment : 1536 time for calcul the mask position with numpy : 0.03190159797668457 nb_pixel_total : 450077 time to create 1 rle with new method : 0.03700852394104004 length of segment : 1162 time for calcul the mask position with numpy : 0.004875898361206055 nb_pixel_total : 228971 time to create 1 rle with new method : 0.011959075927734375 length of segment : 652 time for calcul the mask position with numpy : 0.006236553192138672 nb_pixel_total : 303883 time to create 1 rle with new method : 0.01504206657409668 length of segment : 666 time for calcul the mask position with numpy : 0.1714465618133545 nb_pixel_total : 1413442 time to create 1 rle with new method : 0.25052881240844727 length of segment : 1520 time for calcul the mask position with numpy : 0.007963180541992188 nb_pixel_total : 147146 time to create 1 rle with old method : 0.16955304145812988 length of segment : 654 time for calcul the mask position with numpy : 0.009540796279907227 nb_pixel_total : 199606 time to create 1 rle with new method : 0.014844894409179688 length of segment : 481 time for calcul the mask position with numpy : 0.06028008460998535 nb_pixel_total : 687274 time to create 1 rle with new method : 1.1673345565795898 length of segment : 1658 time for calcul the mask position with numpy : 0.002565622329711914 nb_pixel_total : 63877 time to create 1 rle with old method : 0.07617640495300293 length of segment : 375 time for calcul the mask position with numpy : 0.00400233268737793 nb_pixel_total : 179395 time to create 1 rle with new method : 0.01288914680480957 length of segment : 584 time for calcul the mask position with numpy : 0.002202272415161133 nb_pixel_total : 86194 time to create 1 rle with old method : 0.10417890548706055 length of segment : 321 time for calcul the mask position with numpy : 0.001924753189086914 nb_pixel_total : 60903 time to create 1 rle with old method : 0.07112717628479004 length of segment : 355 time for calcul the mask position with numpy : 0.027019977569580078 nb_pixel_total : 23584 time to create 1 rle with old method : 0.029685258865356445 length of segment : 147 time for calcul the mask position with numpy : 0.0009484291076660156 nb_pixel_total : 29634 time to create 1 rle with old method : 0.03420066833496094 length of segment : 343 time for calcul the mask position with numpy : 0.037041664123535156 nb_pixel_total : 1116110 time to create 1 rle with new method : 0.10297775268554688 length of segment : 1878 time for calcul the mask position with numpy : 0.014168739318847656 nb_pixel_total : 128028 time to create 1 rle with old method : 0.14393901824951172 length of segment : 600 time for calcul the mask position with numpy : 0.001889944076538086 nb_pixel_total : 76462 time to create 1 rle with old method : 0.09534478187561035 length of segment : 433 time for calcul the mask position with numpy : 0.0006406307220458984 nb_pixel_total : 13605 time to create 1 rle with old method : 0.016717195510864258 length of segment : 166 time for calcul the mask position with numpy : 0.005573749542236328 nb_pixel_total : 160273 time to create 1 rle with new method : 0.014540433883666992 length of segment : 600 time for calcul the mask position with numpy : 0.0020864009857177734 nb_pixel_total : 100926 time to create 1 rle with old method : 0.11702084541320801 length of segment : 465 time for calcul the mask position with numpy : 0.007760524749755859 nb_pixel_total : 245153 time to create 1 rle with new method : 0.01697683334350586 length of segment : 459 time for calcul the mask position with numpy : 0.016479969024658203 nb_pixel_total : 232984 time to create 1 rle with new method : 0.014321565628051758 length of segment : 772 time for calcul the mask position with numpy : 0.030972957611083984 nb_pixel_total : 117315 time to create 1 rle with old method : 0.13241314888000488 length of segment : 504 time for calcul the mask position with numpy : 0.020682096481323242 nb_pixel_total : 101731 time to create 1 rle with old method : 0.20420050621032715 length of segment : 372 time for calcul the mask position with numpy : 0.0022487640380859375 nb_pixel_total : 69853 time to create 1 rle with old method : 0.09485363960266113 length of segment : 299 time for calcul the mask position with numpy : 0.010153055191040039 nb_pixel_total : 310940 time to create 1 rle with new method : 0.24411320686340332 length of segment : 735 time for calcul the mask position with numpy : 0.016268014907836914 nb_pixel_total : 540628 time to create 1 rle with new method : 0.09423089027404785 length of segment : 966 time for calcul the mask position with numpy : 0.0019338130950927734 nb_pixel_total : 96453 time to create 1 rle with old method : 0.10520195960998535 length of segment : 457 time for calcul the mask position with numpy : 0.0014696121215820312 nb_pixel_total : 49741 time to create 1 rle with old method : 0.05599331855773926 length of segment : 544 time for calcul the mask position with numpy : 0.0015864372253417969 nb_pixel_total : 71029 time to create 1 rle with old method : 0.07826018333435059 length of segment : 314 time for calcul the mask position with numpy : 0.0013785362243652344 nb_pixel_total : 61219 time to create 1 rle with old method : 0.08139443397521973 length of segment : 277 time for calcul the mask position with numpy : 0.0033516883850097656 nb_pixel_total : 196800 time to create 1 rle with new method : 0.008952140808105469 length of segment : 531 time for calcul the mask position with numpy : 0.0017938613891601562 nb_pixel_total : 67697 time to create 1 rle with old method : 0.0760352611541748 length of segment : 352 time for calcul the mask position with numpy : 0.0029845237731933594 nb_pixel_total : 151365 time to create 1 rle with new method : 0.008357763290405273 length of segment : 498 time for calcul the mask position with numpy : 0.0017788410186767578 nb_pixel_total : 44958 time to create 1 rle with old method : 0.049835205078125 length of segment : 183 time for calcul the mask position with numpy : 0.000812530517578125 nb_pixel_total : 19047 time to create 1 rle with old method : 0.02118992805480957 length of segment : 249 time for calcul the mask position with numpy : 0.002374410629272461 nb_pixel_total : 118027 time to create 1 rle with old method : 0.12472653388977051 length of segment : 392 time for calcul the mask position with numpy : 0.006816387176513672 nb_pixel_total : 252088 time to create 1 rle with new method : 0.028749942779541016 length of segment : 941 time for calcul the mask position with numpy : 0.0028536319732666016 nb_pixel_total : 155422 time to create 1 rle with new method : 0.0077593326568603516 length of segment : 626 time for calcul the mask position with numpy : 0.0020406246185302734 nb_pixel_total : 90544 time to create 1 rle with old method : 0.126450777053833 length of segment : 391 time for calcul the mask position with numpy : 0.002321958541870117 nb_pixel_total : 61981 time to create 1 rle with old method : 0.0699310302734375 length of segment : 541 time for calcul the mask position with numpy : 0.0020971298217773438 nb_pixel_total : 97046 time to create 1 rle with old method : 0.10563540458679199 length of segment : 369 time for calcul the mask position with numpy : 0.0019183158874511719 nb_pixel_total : 52744 time to create 1 rle with old method : 0.05925130844116211 length of segment : 314 time for calcul the mask position with numpy : 0.005461931228637695 nb_pixel_total : 180001 time to create 1 rle with new method : 0.018724679946899414 length of segment : 672 time for calcul the mask position with numpy : 0.002023458480834961 nb_pixel_total : 93956 time to create 1 rle with old method : 0.10450601577758789 length of segment : 470 time for calcul the mask position with numpy : 0.006600379943847656 nb_pixel_total : 53026 time to create 1 rle with old method : 0.06123995780944824 length of segment : 259 time for calcul the mask position with numpy : 0.0017006397247314453 nb_pixel_total : 84017 time to create 1 rle with old method : 0.09383320808410645 length of segment : 369 time for calcul the mask position with numpy : 0.0016269683837890625 nb_pixel_total : 84507 time to create 1 rle with old method : 0.09563326835632324 length of segment : 366 time for calcul the mask position with numpy : 0.05199027061462402 nb_pixel_total : 1269724 time to create 1 rle with new method : 0.22113776206970215 length of segment : 1421 time for calcul the mask position with numpy : 0.0007495880126953125 nb_pixel_total : 40283 time to create 1 rle with old method : 0.04497051239013672 length of segment : 160 time for calcul the mask position with numpy : 0.0051343441009521484 nb_pixel_total : 65783 time to create 1 rle with old method : 0.07221245765686035 length of segment : 402 time for calcul the mask position with numpy : 0.003432750701904297 nb_pixel_total : 173792 time to create 1 rle with new method : 0.008907556533813477 length of segment : 523 time for calcul the mask position with numpy : 0.0024192333221435547 nb_pixel_total : 119997 time to create 1 rle with old method : 0.12945103645324707 length of segment : 400 time for calcul the mask position with numpy : 0.0005099773406982422 nb_pixel_total : 29284 time to create 1 rle with old method : 0.03286910057067871 length of segment : 144 time for calcul the mask position with numpy : 0.004525184631347656 nb_pixel_total : 176940 time to create 1 rle with new method : 0.011736869812011719 length of segment : 470 time for calcul the mask position with numpy : 0.0009534358978271484 nb_pixel_total : 35610 time to create 1 rle with old method : 0.03961467742919922 length of segment : 242 time for calcul the mask position with numpy : 0.0049626827239990234 nb_pixel_total : 175838 time to create 1 rle with new method : 0.010739564895629883 length of segment : 847 time for calcul the mask position with numpy : 0.002711057662963867 nb_pixel_total : 101903 time to create 1 rle with old method : 0.1097569465637207 length of segment : 562 time for calcul the mask position with numpy : 0.0016665458679199219 nb_pixel_total : 57740 time to create 1 rle with old method : 0.07166671752929688 length of segment : 311 time for calcul the mask position with numpy : 0.0011959075927734375 nb_pixel_total : 51473 time to create 1 rle with old method : 0.05510449409484863 length of segment : 395 time for calcul the mask position with numpy : 0.0029420852661132812 nb_pixel_total : 165944 time to create 1 rle with new method : 0.007942914962768555 length of segment : 430 time for calcul the mask position with numpy : 0.003475189208984375 nb_pixel_total : 171843 time to create 1 rle with new method : 0.010458946228027344 length of segment : 814 time for calcul the mask position with numpy : 0.005135059356689453 nb_pixel_total : 258583 time to create 1 rle with new method : 0.013413429260253906 length of segment : 639 time for calcul the mask position with numpy : 0.01496577262878418 nb_pixel_total : 487586 time to create 1 rle with new method : 0.02353215217590332 length of segment : 1204 time for calcul the mask position with numpy : 0.0011799335479736328 nb_pixel_total : 50475 time to create 1 rle with old method : 0.05590987205505371 length of segment : 362 time for calcul the mask position with numpy : 0.0034453868865966797 nb_pixel_total : 201979 time to create 1 rle with new method : 0.00908350944519043 length of segment : 761 time for calcul the mask position with numpy : 0.00044083595275878906 nb_pixel_total : 20243 time to create 1 rle with old method : 0.022141456604003906 length of segment : 233 time for calcul the mask position with numpy : 0.0043468475341796875 nb_pixel_total : 212401 time to create 1 rle with new method : 0.012861251831054688 length of segment : 576 time for calcul the mask position with numpy : 0.003659963607788086 nb_pixel_total : 137882 time to create 1 rle with old method : 0.15213799476623535 length of segment : 548 time for calcul the mask position with numpy : 0.0012028217315673828 nb_pixel_total : 36389 time to create 1 rle with old method : 0.06174516677856445 length of segment : 279 time for calcul the mask position with numpy : 0.0044345855712890625 nb_pixel_total : 145482 time to create 1 rle with old method : 0.16704392433166504 length of segment : 666 time for calcul the mask position with numpy : 0.0017266273498535156 nb_pixel_total : 84374 time to create 1 rle with old method : 0.09438681602478027 length of segment : 425 time for calcul the mask position with numpy : 0.003713846206665039 nb_pixel_total : 204192 time to create 1 rle with new method : 0.00960683822631836 length of segment : 595 time for calcul the mask position with numpy : 0.0011141300201416016 nb_pixel_total : 48022 time to create 1 rle with old method : 0.053855180740356445 length of segment : 316 time for calcul the mask position with numpy : 0.004055023193359375 nb_pixel_total : 180486 time to create 1 rle with new method : 0.010509014129638672 length of segment : 331 time for calcul the mask position with numpy : 0.001903533935546875 nb_pixel_total : 72581 time to create 1 rle with old method : 0.09699654579162598 length of segment : 435 time for calcul the mask position with numpy : 0.005381345748901367 nb_pixel_total : 146342 time to create 1 rle with old method : 0.1641836166381836 length of segment : 730 time for calcul the mask position with numpy : 0.003287792205810547 nb_pixel_total : 126978 time to create 1 rle with old method : 0.13994812965393066 length of segment : 327 time for calcul the mask position with numpy : 0.0011510848999023438 nb_pixel_total : 52819 time to create 1 rle with old method : 0.056882381439208984 length of segment : 448 time for calcul the mask position with numpy : 0.0022330284118652344 nb_pixel_total : 84857 time to create 1 rle with old method : 0.11972475051879883 length of segment : 345 time for calcul the mask position with numpy : 0.006223201751708984 nb_pixel_total : 330815 time to create 1 rle with new method : 0.014752864837646484 length of segment : 595 time for calcul the mask position with numpy : 0.0032362937927246094 nb_pixel_total : 165229 time to create 1 rle with new method : 0.007676601409912109 length of segment : 650 time for calcul the mask position with numpy : 0.001138925552368164 nb_pixel_total : 41773 time to create 1 rle with old method : 0.046970367431640625 length of segment : 329 time for calcul the mask position with numpy : 0.0006151199340820312 nb_pixel_total : 29429 time to create 1 rle with old method : 0.03251528739929199 length of segment : 181 time for calcul the mask position with numpy : 0.0030133724212646484 nb_pixel_total : 145380 time to create 1 rle with old method : 0.16114115715026855 length of segment : 222 time for calcul the mask position with numpy : 0.002312898635864258 nb_pixel_total : 70900 time to create 1 rle with old method : 0.07786989212036133 length of segment : 324 time for calcul the mask position with numpy : 0.0017044544219970703 nb_pixel_total : 80166 time to create 1 rle with old method : 0.08907198905944824 length of segment : 233 time for calcul the mask position with numpy : 0.0013616085052490234 nb_pixel_total : 52967 time to create 1 rle with old method : 0.062128305435180664 length of segment : 260 time for calcul the mask position with numpy : 0.000423431396484375 nb_pixel_total : 16061 time to create 1 rle with old method : 0.018178701400756836 length of segment : 142 time for calcul the mask position with numpy : 0.003234386444091797 nb_pixel_total : 152730 time to create 1 rle with new method : 0.008269548416137695 length of segment : 338 time for calcul the mask position with numpy : 0.0008180141448974609 nb_pixel_total : 30183 time to create 1 rle with old method : 0.03442740440368652 length of segment : 262 time for calcul the mask position with numpy : 0.009846925735473633 nb_pixel_total : 330018 time to create 1 rle with new method : 0.04879045486450195 length of segment : 1031 time for calcul the mask position with numpy : 0.002509593963623047 nb_pixel_total : 128081 time to create 1 rle with old method : 0.13933157920837402 length of segment : 581 time for calcul the mask position with numpy : 0.0018362998962402344 nb_pixel_total : 73714 time to create 1 rle with old method : 0.08115458488464355 length of segment : 433 time for calcul the mask position with numpy : 0.001550912857055664 nb_pixel_total : 87097 time to create 1 rle with old method : 0.09230256080627441 length of segment : 444 time for calcul the mask position with numpy : 0.02304863929748535 nb_pixel_total : 995799 time to create 1 rle with new method : 0.302199125289917 length of segment : 1251 time for calcul the mask position with numpy : 0.00235748291015625 nb_pixel_total : 132007 time to create 1 rle with old method : 0.14631295204162598 length of segment : 600 time for calcul the mask position with numpy : 0.0007696151733398438 nb_pixel_total : 17095 time to create 1 rle with old method : 0.024067163467407227 length of segment : 211 time for calcul the mask position with numpy : 0.0011529922485351562 nb_pixel_total : 57573 time to create 1 rle with old method : 0.06690478324890137 length of segment : 261 time for calcul the mask position with numpy : 0.0013837814331054688 nb_pixel_total : 60993 time to create 1 rle with old method : 0.06864261627197266 length of segment : 208 time for calcul the mask position with numpy : 0.0017390251159667969 nb_pixel_total : 79251 time to create 1 rle with old method : 0.1110532283782959 length of segment : 285 time for calcul the mask position with numpy : 0.00394129753112793 nb_pixel_total : 137164 time to create 1 rle with old method : 0.1566944122314453 length of segment : 434 time for calcul the mask position with numpy : 0.008100271224975586 nb_pixel_total : 207409 time to create 1 rle with new method : 0.03838849067687988 length of segment : 1070 time for calcul the mask position with numpy : 0.0008740425109863281 nb_pixel_total : 30872 time to create 1 rle with old method : 0.035190582275390625 length of segment : 228 time for calcul the mask position with numpy : 0.0030133724212646484 nb_pixel_total : 149318 time to create 1 rle with old method : 0.16028690338134766 length of segment : 583 time for calcul the mask position with numpy : 0.004186868667602539 nb_pixel_total : 211105 time to create 1 rle with new method : 0.010172605514526367 length of segment : 581 time for calcul the mask position with numpy : 0.007529258728027344 nb_pixel_total : 242824 time to create 1 rle with new method : 0.018009185791015625 length of segment : 294 time for calcul the mask position with numpy : 0.0025849342346191406 nb_pixel_total : 114821 time to create 1 rle with old method : 0.15477824211120605 length of segment : 423 time for calcul the mask position with numpy : 0.002155303955078125 nb_pixel_total : 89818 time to create 1 rle with old method : 0.10211849212646484 length of segment : 281 time for calcul the mask position with numpy : 0.007592439651489258 nb_pixel_total : 404793 time to create 1 rle with new method : 0.0196230411529541 length of segment : 644 time for calcul the mask position with numpy : 0.002798318862915039 nb_pixel_total : 173797 time to create 1 rle with new method : 0.006874799728393555 length of segment : 349 time for calcul the mask position with numpy : 0.0027625560760498047 nb_pixel_total : 110576 time to create 1 rle with old method : 0.13660931587219238 length of segment : 435 time for calcul the mask position with numpy : 0.0029299259185791016 nb_pixel_total : 150263 time to create 1 rle with new method : 0.007561445236206055 length of segment : 422 time for calcul the mask position with numpy : 0.0008220672607421875 nb_pixel_total : 31566 time to create 1 rle with old method : 0.03662419319152832 length of segment : 164 time for calcul the mask position with numpy : 0.00070953369140625 nb_pixel_total : 37104 time to create 1 rle with old method : 0.040502071380615234 length of segment : 315 time for calcul the mask position with numpy : 0.012275457382202148 nb_pixel_total : 487392 time to create 1 rle with new method : 0.06038808822631836 length of segment : 1942 time for calcul the mask position with numpy : 0.0011489391326904297 nb_pixel_total : 49320 time to create 1 rle with old method : 0.05557107925415039 length of segment : 275 time for calcul the mask position with numpy : 0.0032074451446533203 nb_pixel_total : 181361 time to create 1 rle with new method : 0.009151220321655273 length of segment : 851 time for calcul the mask position with numpy : 0.01513218879699707 nb_pixel_total : 816716 time to create 1 rle with new method : 0.04617881774902344 length of segment : 1107 time for calcul the mask position with numpy : 0.008730649948120117 nb_pixel_total : 572317 time to create 1 rle with new method : 0.01915264129638672 length of segment : 730 time for calcul the mask position with numpy : 0.007759571075439453 nb_pixel_total : 431052 time to create 1 rle with new method : 0.021343469619750977 length of segment : 907 time for calcul the mask position with numpy : 0.0021572113037109375 nb_pixel_total : 106432 time to create 1 rle with old method : 0.11563634872436523 length of segment : 431 time for calcul the mask position with numpy : 0.0010039806365966797 nb_pixel_total : 44960 time to create 1 rle with old method : 0.05133414268493652 length of segment : 288 time for calcul the mask position with numpy : 0.0005652904510498047 nb_pixel_total : 27724 time to create 1 rle with old method : 0.030495166778564453 length of segment : 273 time for calcul the mask position with numpy : 0.003888368606567383 nb_pixel_total : 199251 time to create 1 rle with new method : 0.010648250579833984 length of segment : 641 time for calcul the mask position with numpy : 0.004004001617431641 nb_pixel_total : 214672 time to create 1 rle with new method : 0.010027647018432617 length of segment : 581 time for calcul the mask position with numpy : 0.0006475448608398438 nb_pixel_total : 37094 time to create 1 rle with old method : 0.04369521141052246 length of segment : 250 time for calcul the mask position with numpy : 0.005136728286743164 nb_pixel_total : 184432 time to create 1 rle with new method : 0.015480995178222656 length of segment : 783 time for calcul the mask position with numpy : 0.005336761474609375 nb_pixel_total : 247720 time to create 1 rle with new method : 0.014277458190917969 length of segment : 575 time for calcul the mask position with numpy : 0.002760648727416992 nb_pixel_total : 117096 time to create 1 rle with old method : 0.14502477645874023 length of segment : 377 time for calcul the mask position with numpy : 0.0025255680084228516 nb_pixel_total : 91244 time to create 1 rle with old method : 0.10219645500183105 length of segment : 489 time for calcul the mask position with numpy : 0.010577201843261719 nb_pixel_total : 381856 time to create 1 rle with new method : 0.018425464630126953 length of segment : 580 time for calcul the mask position with numpy : 0.001993894577026367 nb_pixel_total : 79276 time to create 1 rle with old method : 0.08828568458557129 length of segment : 368 time for calcul the mask position with numpy : 0.004520893096923828 nb_pixel_total : 296680 time to create 1 rle with new method : 0.010352134704589844 length of segment : 580 time for calcul the mask position with numpy : 0.0013289451599121094 nb_pixel_total : 59956 time to create 1 rle with old method : 0.06562066078186035 length of segment : 305 time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 12470 time to create 1 rle with old method : 0.01397705078125 length of segment : 151 time for calcul the mask position with numpy : 0.003897428512573242 nb_pixel_total : 142880 time to create 1 rle with old method : 0.17409491539001465 length of segment : 505 time for calcul the mask position with numpy : 0.0006649494171142578 nb_pixel_total : 28532 time to create 1 rle with old method : 0.03098154067993164 length of segment : 204 time for calcul the mask position with numpy : 0.0008270740509033203 nb_pixel_total : 45260 time to create 1 rle with old method : 0.04842972755432129 length of segment : 322 time for calcul the mask position with numpy : 0.0011281967163085938 nb_pixel_total : 49545 time to create 1 rle with old method : 0.054437875747680664 length of segment : 339 time for calcul the mask position with numpy : 0.002656698226928711 nb_pixel_total : 119408 time to create 1 rle with old method : 0.12944483757019043 length of segment : 520 time for calcul the mask position with numpy : 0.016251564025878906 nb_pixel_total : 563703 time to create 1 rle with new method : 0.06548595428466797 length of segment : 907 time for calcul the mask position with numpy : 0.0015094280242919922 nb_pixel_total : 59059 time to create 1 rle with old method : 0.06444597244262695 length of segment : 353 time for calcul the mask position with numpy : 0.017538070678710938 nb_pixel_total : 503443 time to create 1 rle with new method : 0.14035701751708984 length of segment : 1031 time for calcul the mask position with numpy : 0.0013439655303955078 nb_pixel_total : 50766 time to create 1 rle with old method : 0.05651545524597168 length of segment : 387 time for calcul the mask position with numpy : 0.0016894340515136719 nb_pixel_total : 48715 time to create 1 rle with old method : 0.056165456771850586 length of segment : 256 time for calcul the mask position with numpy : 0.0010540485382080078 nb_pixel_total : 58923 time to create 1 rle with old method : 0.06263208389282227 length of segment : 331 time for calcul the mask position with numpy : 0.004735469818115234 nb_pixel_total : 263368 time to create 1 rle with new method : 0.012519121170043945 length of segment : 718 time for calcul the mask position with numpy : 0.003179311752319336 nb_pixel_total : 145386 time to create 1 rle with old method : 0.1579582691192627 length of segment : 510 time for calcul the mask position with numpy : 0.0020036697387695312 nb_pixel_total : 63065 time to create 1 rle with old method : 0.07269644737243652 length of segment : 356 time for calcul the mask position with numpy : 0.0012233257293701172 nb_pixel_total : 48852 time to create 1 rle with old method : 0.053322553634643555 length of segment : 277 time for calcul the mask position with numpy : 0.0038139820098876953 nb_pixel_total : 190360 time to create 1 rle with new method : 0.010825634002685547 length of segment : 479 time for calcul the mask position with numpy : 0.0017549991607666016 nb_pixel_total : 69694 time to create 1 rle with old method : 0.07534909248352051 length of segment : 424 time for calcul the mask position with numpy : 0.012267112731933594 nb_pixel_total : 725662 time to create 1 rle with new method : 0.052948951721191406 length of segment : 1521 time for calcul the mask position with numpy : 0.004271745681762695 nb_pixel_total : 166957 time to create 1 rle with new method : 0.014087677001953125 length of segment : 924 time for calcul the mask position with numpy : 0.004594326019287109 nb_pixel_total : 227947 time to create 1 rle with new method : 0.01328134536743164 length of segment : 497 time for calcul the mask position with numpy : 0.004038810729980469 nb_pixel_total : 146801 time to create 1 rle with old method : 0.15398192405700684 length of segment : 548 time for calcul the mask position with numpy : 0.0013947486877441406 nb_pixel_total : 52242 time to create 1 rle with old method : 0.05504179000854492 length of segment : 367 time for calcul the mask position with numpy : 0.006522655487060547 nb_pixel_total : 348087 time to create 1 rle with new method : 0.020041465759277344 length of segment : 813 time for calcul the mask position with numpy : 0.001184701919555664 nb_pixel_total : 59860 time to create 1 rle with old method : 0.0648040771484375 length of segment : 396 time for calcul the mask position with numpy : 0.0023195743560791016 nb_pixel_total : 130124 time to create 1 rle with old method : 0.13900113105773926 length of segment : 514 time for calcul the mask position with numpy : 0.0016469955444335938 nb_pixel_total : 66194 time to create 1 rle with old method : 0.07114362716674805 length of segment : 283 time for calcul the mask position with numpy : 0.001313924789428711 nb_pixel_total : 51859 time to create 1 rle with old method : 0.05564403533935547 length of segment : 413 time for calcul the mask position with numpy : 0.011347770690917969 nb_pixel_total : 600872 time to create 1 rle with new method : 0.03092050552368164 length of segment : 1257 time for calcul the mask position with numpy : 0.0032417774200439453 nb_pixel_total : 204417 time to create 1 rle with new method : 0.008910655975341797 length of segment : 661 time for calcul the mask position with numpy : 0.0010941028594970703 nb_pixel_total : 44480 time to create 1 rle with old method : 0.049268245697021484 length of segment : 227 time for calcul the mask position with numpy : 0.003692150115966797 nb_pixel_total : 196426 time to create 1 rle with new method : 0.010472536087036133 length of segment : 465 time for calcul the mask position with numpy : 0.0005133152008056641 nb_pixel_total : 22465 time to create 1 rle with old method : 0.024721145629882812 length of segment : 164 time for calcul the mask position with numpy : 0.0003962516784667969 nb_pixel_total : 28230 time to create 1 rle with old method : 0.030661821365356445 length of segment : 199 time for calcul the mask position with numpy : 0.020400285720825195 nb_pixel_total : 1132271 time to create 1 rle with new method : 0.09807467460632324 length of segment : 2003 time for calcul the mask position with numpy : 0.002688169479370117 nb_pixel_total : 127257 time to create 1 rle with old method : 0.13619065284729004 length of segment : 488 time for calcul the mask position with numpy : 0.014005184173583984 nb_pixel_total : 748098 time to create 1 rle with new method : 0.06420731544494629 length of segment : 1109 time for calcul the mask position with numpy : 0.0012655258178710938 nb_pixel_total : 71131 time to create 1 rle with old method : 0.07464408874511719 length of segment : 446 time for calcul the mask position with numpy : 0.0015645027160644531 nb_pixel_total : 67670 time to create 1 rle with old method : 0.08017873764038086 length of segment : 333 time for calcul the mask position with numpy : 0.0032813549041748047 nb_pixel_total : 151046 time to create 1 rle with new method : 0.007006645202636719 length of segment : 428 time for calcul the mask position with numpy : 0.002580881118774414 nb_pixel_total : 146324 time to create 1 rle with old method : 0.1545882225036621 length of segment : 505 time for calcul the mask position with numpy : 0.0022580623626708984 nb_pixel_total : 131341 time to create 1 rle with old method : 0.13810133934020996 length of segment : 605 time for calcul the mask position with numpy : 0.001177072525024414 nb_pixel_total : 47845 time to create 1 rle with old method : 0.050765275955200195 length of segment : 417 time for calcul the mask position with numpy : 0.0016026496887207031 nb_pixel_total : 91482 time to create 1 rle with old method : 0.09703707695007324 length of segment : 451 time for calcul the mask position with numpy : 0.0039196014404296875 nb_pixel_total : 217117 time to create 1 rle with new method : 0.010260581970214844 length of segment : 948 time for calcul the mask position with numpy : 0.0020966529846191406 nb_pixel_total : 83758 time to create 1 rle with old method : 0.08741402626037598 length of segment : 480 time for calcul the mask position with numpy : 0.0014350414276123047 nb_pixel_total : 65009 time to create 1 rle with old method : 0.0690155029296875 length of segment : 441 time for calcul the mask position with numpy : 0.009956121444702148 nb_pixel_total : 375399 time to create 1 rle with new method : 0.02503824234008789 length of segment : 596 time for calcul the mask position with numpy : 0.02178215980529785 nb_pixel_total : 673279 time to create 1 rle with new method : 0.1837923526763916 length of segment : 1466 time for calcul the mask position with numpy : 0.005821704864501953 nb_pixel_total : 385821 time to create 1 rle with new method : 0.014917373657226562 length of segment : 834 time for calcul the mask position with numpy : 0.0010704994201660156 nb_pixel_total : 53411 time to create 1 rle with old method : 0.05642104148864746 length of segment : 249 time for calcul the mask position with numpy : 0.005176544189453125 nb_pixel_total : 237313 time to create 1 rle with new method : 0.014287710189819336 length of segment : 693 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 34495 time to create 1 rle with old method : 0.03632092475891113 length of segment : 301 time for calcul the mask position with numpy : 0.0038776397705078125 nb_pixel_total : 205338 time to create 1 rle with new method : 0.011332035064697266 length of segment : 676 time for calcul the mask position with numpy : 0.001407623291015625 nb_pixel_total : 67761 time to create 1 rle with old method : 0.07196259498596191 length of segment : 292 time for calcul the mask position with numpy : 0.011204957962036133 nb_pixel_total : 433409 time to create 1 rle with new method : 0.11740422248840332 length of segment : 657 time for calcul the mask position with numpy : 0.0012824535369873047 nb_pixel_total : 62248 time to create 1 rle with old method : 0.06551456451416016 length of segment : 355 time for calcul the mask position with numpy : 0.001809835433959961 nb_pixel_total : 104989 time to create 1 rle with old method : 0.11069798469543457 length of segment : 549 time for calcul the mask position with numpy : 0.0015938282012939453 nb_pixel_total : 54622 time to create 1 rle with old method : 0.06010794639587402 length of segment : 305 time for calcul the mask position with numpy : 0.004339456558227539 nb_pixel_total : 212539 time to create 1 rle with new method : 0.012416839599609375 length of segment : 575 time for calcul the mask position with numpy : 0.0022847652435302734 nb_pixel_total : 80743 time to create 1 rle with old method : 0.08444595336914062 length of segment : 511 time for calcul the mask position with numpy : 0.0032019615173339844 nb_pixel_total : 210364 time to create 1 rle with new method : 0.0078122615814208984 length of segment : 439 time for calcul the mask position with numpy : 0.001718759536743164 nb_pixel_total : 40164 time to create 1 rle with old method : 0.043580055236816406 length of segment : 404 time for calcul the mask position with numpy : 0.0016961097717285156 nb_pixel_total : 57904 time to create 1 rle with old method : 0.06267762184143066 length of segment : 565 time for calcul the mask position with numpy : 0.0005571842193603516 nb_pixel_total : 26600 time to create 1 rle with old method : 0.029767990112304688 length of segment : 169 time for calcul the mask position with numpy : 0.0005667209625244141 nb_pixel_total : 19736 time to create 1 rle with old method : 0.02162647247314453 length of segment : 353 time for calcul the mask position with numpy : 0.001880645751953125 nb_pixel_total : 95514 time to create 1 rle with old method : 0.10242152214050293 length of segment : 564 time for calcul the mask position with numpy : 0.002373218536376953 nb_pixel_total : 131819 time to create 1 rle with old method : 0.1405487060546875 length of segment : 552 time for calcul the mask position with numpy : 0.0005803108215332031 nb_pixel_total : 28060 time to create 1 rle with old method : 0.03245210647583008 length of segment : 212 time for calcul the mask position with numpy : 0.0017273426055908203 nb_pixel_total : 67409 time to create 1 rle with old method : 0.07717037200927734 length of segment : 365 time for calcul the mask position with numpy : 0.007361650466918945 nb_pixel_total : 285941 time to create 1 rle with new method : 0.022333621978759766 length of segment : 880 time for calcul the mask position with numpy : 0.0010051727294921875 nb_pixel_total : 45947 time to create 1 rle with old method : 0.05051779747009277 length of segment : 301 time for calcul the mask position with numpy : 0.0006852149963378906 nb_pixel_total : 23068 time to create 1 rle with old method : 0.025667667388916016 length of segment : 218 time for calcul the mask position with numpy : 0.0026488304138183594 nb_pixel_total : 144361 time to create 1 rle with old method : 0.15441298484802246 length of segment : 343 time for calcul the mask position with numpy : 0.0009725093841552734 nb_pixel_total : 24828 time to create 1 rle with old method : 0.027899980545043945 length of segment : 213 time for calcul the mask position with numpy : 0.0022733211517333984 nb_pixel_total : 92679 time to create 1 rle with old method : 0.10194802284240723 length of segment : 360 time for calcul the mask position with numpy : 0.0009579658508300781 nb_pixel_total : 56189 time to create 1 rle with old method : 0.059398651123046875 length of segment : 359 time for calcul the mask position with numpy : 0.01444101333618164 nb_pixel_total : 405953 time to create 1 rle with new method : 0.07457137107849121 length of segment : 1053 time for calcul the mask position with numpy : 0.012242555618286133 nb_pixel_total : 692893 time to create 1 rle with new method : 0.12400174140930176 length of segment : 1619 time for calcul the mask position with numpy : 0.0013985633850097656 nb_pixel_total : 71419 time to create 1 rle with old method : 0.0778810977935791 length of segment : 330 time for calcul the mask position with numpy : 0.0025267601013183594 nb_pixel_total : 123916 time to create 1 rle with old method : 0.1336832046508789 length of segment : 375 time for calcul the mask position with numpy : 0.0026149749755859375 nb_pixel_total : 118665 time to create 1 rle with old method : 0.12561249732971191 length of segment : 508 time for calcul the mask position with numpy : 0.0012087821960449219 nb_pixel_total : 48841 time to create 1 rle with old method : 0.05320382118225098 length of segment : 299 time for calcul the mask position with numpy : 0.005955219268798828 nb_pixel_total : 294294 time to create 1 rle with new method : 0.017750024795532227 length of segment : 965 time for calcul the mask position with numpy : 0.003072500228881836 nb_pixel_total : 88916 time to create 1 rle with old method : 0.10655522346496582 length of segment : 619 time for calcul the mask position with numpy : 0.0037317276000976562 nb_pixel_total : 210545 time to create 1 rle with new method : 0.01038980484008789 length of segment : 452 time for calcul the mask position with numpy : 0.00287628173828125 nb_pixel_total : 141132 time to create 1 rle with old method : 0.16041970252990723 length of segment : 547 time for calcul the mask position with numpy : 0.007574796676635742 nb_pixel_total : 294029 time to create 1 rle with new method : 0.021329641342163086 length of segment : 686 time for calcul the mask position with numpy : 0.0006885528564453125 nb_pixel_total : 36782 time to create 1 rle with old method : 0.04058837890625 length of segment : 256 time for calcul the mask position with numpy : 0.0022461414337158203 nb_pixel_total : 113602 time to create 1 rle with old method : 0.12317276000976562 length of segment : 387 time for calcul the mask position with numpy : 0.0027730464935302734 nb_pixel_total : 86659 time to create 1 rle with old method : 0.09266495704650879 length of segment : 526 time for calcul the mask position with numpy : 0.0047795772552490234 nb_pixel_total : 222061 time to create 1 rle with new method : 0.013712882995605469 length of segment : 635 time for calcul the mask position with numpy : 0.0008437633514404297 nb_pixel_total : 47502 time to create 1 rle with old method : 0.05200338363647461 length of segment : 320 time for calcul the mask position with numpy : 0.005545854568481445 nb_pixel_total : 298429 time to create 1 rle with new method : 0.015741825103759766 length of segment : 685 time for calcul the mask position with numpy : 0.0018782615661621094 nb_pixel_total : 65528 time to create 1 rle with old method : 0.0716700553894043 length of segment : 402 time for calcul the mask position with numpy : 0.001912832260131836 nb_pixel_total : 72553 time to create 1 rle with old method : 0.07926583290100098 length of segment : 546 time for calcul the mask position with numpy : 0.0016338825225830078 nb_pixel_total : 62219 time to create 1 rle with old method : 0.06901264190673828 length of segment : 351 time for calcul the mask position with numpy : 0.004367828369140625 nb_pixel_total : 175923 time to create 1 rle with new method : 0.01151585578918457 length of segment : 688 time for calcul the mask position with numpy : 0.0029768943786621094 nb_pixel_total : 122206 time to create 1 rle with old method : 0.13251256942749023 length of segment : 385 time for calcul the mask position with numpy : 0.0010192394256591797 nb_pixel_total : 44529 time to create 1 rle with old method : 0.04935932159423828 length of segment : 297 time for calcul the mask position with numpy : 0.008872270584106445 nb_pixel_total : 467392 time to create 1 rle with new method : 0.02192974090576172 length of segment : 776 time for calcul the mask position with numpy : 0.003933429718017578 nb_pixel_total : 103963 time to create 1 rle with old method : 0.11485695838928223 length of segment : 450 time for calcul the mask position with numpy : 0.0015075206756591797 nb_pixel_total : 72519 time to create 1 rle with old method : 0.0813608169555664 length of segment : 223 time for calcul the mask position with numpy : 0.003664255142211914 nb_pixel_total : 158943 time to create 1 rle with new method : 0.010090112686157227 length of segment : 596 time for calcul the mask position with numpy : 0.0016322135925292969 nb_pixel_total : 68095 time to create 1 rle with old method : 0.07762575149536133 length of segment : 450 time for calcul the mask position with numpy : 0.003103017807006836 nb_pixel_total : 134219 time to create 1 rle with old method : 0.1437368392944336 length of segment : 766 time for calcul the mask position with numpy : 0.010477066040039062 nb_pixel_total : 574461 time to create 1 rle with new method : 0.02403092384338379 length of segment : 802 time for calcul the mask position with numpy : 0.0013556480407714844 nb_pixel_total : 63974 time to create 1 rle with old method : 0.06936001777648926 length of segment : 292 time for calcul the mask position with numpy : 0.0006749629974365234 nb_pixel_total : 33014 time to create 1 rle with old method : 0.037259817123413086 length of segment : 226 time for calcul the mask position with numpy : 0.0018477439880371094 nb_pixel_total : 99087 time to create 1 rle with old method : 0.10915279388427734 length of segment : 327 time for calcul the mask position with numpy : 0.0012297630310058594 nb_pixel_total : 51597 time to create 1 rle with old method : 0.05534505844116211 length of segment : 361 time for calcul the mask position with numpy : 0.0008356571197509766 nb_pixel_total : 43246 time to create 1 rle with old method : 0.04658937454223633 length of segment : 237 time for calcul the mask position with numpy : 0.004628419876098633 nb_pixel_total : 170922 time to create 1 rle with new method : 0.013545036315917969 length of segment : 568 time for calcul the mask position with numpy : 0.0012781620025634766 nb_pixel_total : 55161 time to create 1 rle with old method : 0.05957460403442383 length of segment : 268 time for calcul the mask position with numpy : 0.008544683456420898 nb_pixel_total : 350410 time to create 1 rle with new method : 0.023577213287353516 length of segment : 1092 time for calcul the mask position with numpy : 0.0029768943786621094 nb_pixel_total : 122082 time to create 1 rle with old method : 0.13020801544189453 length of segment : 479 time for calcul the mask position with numpy : 0.0013260841369628906 nb_pixel_total : 74152 time to create 1 rle with old method : 0.07865524291992188 length of segment : 364 time for calcul the mask position with numpy : 0.0045397281646728516 nb_pixel_total : 221309 time to create 1 rle with new method : 0.011003494262695312 length of segment : 598 time for calcul the mask position with numpy : 0.00131988525390625 nb_pixel_total : 57260 time to create 1 rle with old method : 0.06085467338562012 length of segment : 363 time for calcul the mask position with numpy : 0.00039196014404296875 nb_pixel_total : 18415 time to create 1 rle with old method : 0.020751953125 length of segment : 152 time for calcul the mask position with numpy : 0.001583099365234375 nb_pixel_total : 70767 time to create 1 rle with old method : 0.07627224922180176 length of segment : 372 time for calcul the mask position with numpy : 0.0015892982482910156 nb_pixel_total : 65103 time to create 1 rle with old method : 0.07024335861206055 length of segment : 443 time for calcul the mask position with numpy : 0.00583338737487793 nb_pixel_total : 244275 time to create 1 rle with new method : 0.016957521438598633 length of segment : 982 time for calcul the mask position with numpy : 0.0011229515075683594 nb_pixel_total : 50901 time to create 1 rle with old method : 0.05645155906677246 length of segment : 258 time for calcul the mask position with numpy : 0.0021636486053466797 nb_pixel_total : 98692 time to create 1 rle with old method : 0.10730504989624023 length of segment : 393 time for calcul the mask position with numpy : 0.0016551017761230469 nb_pixel_total : 90461 time to create 1 rle with old method : 0.10094451904296875 length of segment : 372 time for calcul the mask position with numpy : 0.0006511211395263672 nb_pixel_total : 29586 time to create 1 rle with old method : 0.032692909240722656 length of segment : 197 time for calcul the mask position with numpy : 0.002370595932006836 nb_pixel_total : 127941 time to create 1 rle with old method : 0.13887977600097656 length of segment : 507 time for calcul the mask position with numpy : 0.0018153190612792969 nb_pixel_total : 62339 time to create 1 rle with old method : 0.06751275062561035 length of segment : 600 time for calcul the mask position with numpy : 0.0006911754608154297 nb_pixel_total : 31437 time to create 1 rle with old method : 0.033785343170166016 length of segment : 209 time for calcul the mask position with numpy : 0.0030181407928466797 nb_pixel_total : 112571 time to create 1 rle with old method : 0.12528419494628906 length of segment : 578 time for calcul the mask position with numpy : 0.004293203353881836 nb_pixel_total : 240190 time to create 1 rle with new method : 0.010974645614624023 length of segment : 503 time for calcul the mask position with numpy : 0.003309488296508789 nb_pixel_total : 151677 time to create 1 rle with new method : 0.008256912231445312 length of segment : 475 time for calcul the mask position with numpy : 0.0032558441162109375 nb_pixel_total : 148917 time to create 1 rle with old method : 0.15740537643432617 length of segment : 559 time for calcul the mask position with numpy : 0.001252889633178711 nb_pixel_total : 45600 time to create 1 rle with old method : 0.050187110900878906 length of segment : 315 time for calcul the mask position with numpy : 0.0023484230041503906 nb_pixel_total : 136624 time to create 1 rle with old method : 0.14664363861083984 length of segment : 485 time for calcul the mask position with numpy : 0.007924079895019531 nb_pixel_total : 455256 time to create 1 rle with new method : 0.018101930618286133 length of segment : 951 time for calcul the mask position with numpy : 0.006217241287231445 nb_pixel_total : 343739 time to create 1 rle with new method : 0.01777935028076172 length of segment : 859 time for calcul the mask position with numpy : 0.0013599395751953125 nb_pixel_total : 52491 time to create 1 rle with old method : 0.05564069747924805 length of segment : 325 time for calcul the mask position with numpy : 0.0014462471008300781 nb_pixel_total : 62731 time to create 1 rle with old method : 0.07002663612365723 length of segment : 320 time for calcul the mask position with numpy : 0.0005834102630615234 nb_pixel_total : 25549 time to create 1 rle with old method : 0.028788328170776367 length of segment : 206 time for calcul the mask position with numpy : 0.0006315708160400391 nb_pixel_total : 29905 time to create 1 rle with old method : 0.032953500747680664 length of segment : 324 time for calcul the mask position with numpy : 0.0018854141235351562 nb_pixel_total : 96668 time to create 1 rle with old method : 0.10692477226257324 length of segment : 360 time for calcul the mask position with numpy : 0.001332998275756836 nb_pixel_total : 72870 time to create 1 rle with old method : 0.0812678337097168 length of segment : 293 time for calcul the mask position with numpy : 0.0015404224395751953 nb_pixel_total : 48242 time to create 1 rle with old method : 0.05365920066833496 length of segment : 236 time for calcul the mask position with numpy : 0.007009983062744141 nb_pixel_total : 346040 time to create 1 rle with new method : 0.01734781265258789 length of segment : 455 time for calcul the mask position with numpy : 0.0013120174407958984 nb_pixel_total : 77688 time to create 1 rle with old method : 0.08408069610595703 length of segment : 298 time for calcul the mask position with numpy : 0.0010747909545898438 nb_pixel_total : 50080 time to create 1 rle with old method : 0.05515027046203613 length of segment : 315 time for calcul the mask position with numpy : 0.004531145095825195 nb_pixel_total : 219737 time to create 1 rle with new method : 0.013127326965332031 length of segment : 726 time for calcul the mask position with numpy : 0.0021469593048095703 nb_pixel_total : 81342 time to create 1 rle with old method : 0.08561968803405762 length of segment : 444 time for calcul the mask position with numpy : 0.00344085693359375 nb_pixel_total : 181714 time to create 1 rle with new method : 0.009446382522583008 length of segment : 390 time for calcul the mask position with numpy : 0.004595279693603516 nb_pixel_total : 205371 time to create 1 rle with new method : 0.013931035995483398 length of segment : 1090 time for calcul the mask position with numpy : 0.004611015319824219 nb_pixel_total : 209476 time to create 1 rle with new method : 0.013132333755493164 length of segment : 357 time for calcul the mask position with numpy : 0.0010533332824707031 nb_pixel_total : 32113 time to create 1 rle with old method : 0.034417152404785156 length of segment : 651 time for calcul the mask position with numpy : 0.002976655960083008 nb_pixel_total : 142918 time to create 1 rle with old method : 0.1520707607269287 length of segment : 628 time for calcul the mask position with numpy : 0.0033974647521972656 nb_pixel_total : 214806 time to create 1 rle with new method : 0.00846099853515625 length of segment : 646 time for calcul the mask position with numpy : 0.010872840881347656 nb_pixel_total : 410140 time to create 1 rle with new method : 0.03935694694519043 length of segment : 847 time for calcul the mask position with numpy : 0.004996776580810547 nb_pixel_total : 270893 time to create 1 rle with new method : 0.014436721801757812 length of segment : 608 time for calcul the mask position with numpy : 0.00437164306640625 nb_pixel_total : 264323 time to create 1 rle with new method : 0.011838197708129883 length of segment : 609 time for calcul the mask position with numpy : 0.0019941329956054688 nb_pixel_total : 82813 time to create 1 rle with old method : 0.09122753143310547 length of segment : 615 time for calcul the mask position with numpy : 0.0016703605651855469 nb_pixel_total : 78764 time to create 1 rle with old method : 0.08580350875854492 length of segment : 292 time for calcul the mask position with numpy : 0.006722450256347656 nb_pixel_total : 236540 time to create 1 rle with new method : 0.021525144577026367 length of segment : 816 time for calcul the mask position with numpy : 0.0016515254974365234 nb_pixel_total : 93290 time to create 1 rle with old method : 0.09803986549377441 length of segment : 370 time for calcul the mask position with numpy : 0.0035715103149414062 nb_pixel_total : 194713 time to create 1 rle with new method : 0.009893655776977539 length of segment : 594 time for calcul the mask position with numpy : 0.0033903121948242188 nb_pixel_total : 159586 time to create 1 rle with new method : 0.006375312805175781 length of segment : 870 time for calcul the mask position with numpy : 0.0007557868957519531 nb_pixel_total : 25458 time to create 1 rle with old method : 0.027746915817260742 length of segment : 152 time for calcul the mask position with numpy : 0.007418394088745117 nb_pixel_total : 416202 time to create 1 rle with new method : 0.013662099838256836 length of segment : 406 time for calcul the mask position with numpy : 0.0015480518341064453 nb_pixel_total : 80221 time to create 1 rle with old method : 0.08627462387084961 length of segment : 271 time for calcul the mask position with numpy : 0.028654098510742188 nb_pixel_total : 1816933 time to create 1 rle with new method : 0.23579049110412598 length of segment : 1773 time for calcul the mask position with numpy : 0.007441282272338867 nb_pixel_total : 361923 time to create 1 rle with new method : 0.013458251953125 length of segment : 717 time for calcul the mask position with numpy : 0.003146648406982422 nb_pixel_total : 171350 time to create 1 rle with new method : 0.006149768829345703 length of segment : 397 time for calcul the mask position with numpy : 0.028981685638427734 nb_pixel_total : 1878123 time to create 1 rle with new method : 0.2085402011871338 length of segment : 1412 time for calcul the mask position with numpy : 0.003678560256958008 nb_pixel_total : 235437 time to create 1 rle with new method : 0.006619453430175781 length of segment : 423 time for calcul the mask position with numpy : 0.0005409717559814453 nb_pixel_total : 27821 time to create 1 rle with old method : 0.030492305755615234 length of segment : 249 time for calcul the mask position with numpy : 0.016881704330444336 nb_pixel_total : 1050303 time to create 1 rle with new method : 0.1503746509552002 length of segment : 1173 time for calcul the mask position with numpy : 0.0023839473724365234 nb_pixel_total : 173269 time to create 1 rle with new method : 0.005360126495361328 length of segment : 435 time for calcul the mask position with numpy : 0.006028175354003906 nb_pixel_total : 329386 time to create 1 rle with new method : 0.015451431274414062 length of segment : 617 time for calcul the mask position with numpy : 0.25499677658081055 nb_pixel_total : 3710698 time to create 1 rle with new method : 0.4323861598968506 length of segment : 3313 time for calcul the mask position with numpy : 0.07387018203735352 nb_pixel_total : 2254301 time to create 1 rle with new method : 0.17745399475097656 length of segment : 1482 time for calcul the mask position with numpy : 0.5133898258209229 nb_pixel_total : 9699878 time to create 1 rle with new method : 1.0723390579223633 length of segment : 5241 time for calcul the mask position with numpy : 0.022439002990722656 nb_pixel_total : 1929611 time to create 1 rle with new method : 0.2293686866760254 length of segment : 1059 time for calcul the mask position with numpy : 0.00026798248291015625 nb_pixel_total : 18233 time to create 1 rle with old method : 0.019531726837158203 length of segment : 138 time for calcul the mask position with numpy : 0.0044367313385009766 nb_pixel_total : 246469 time to create 1 rle with new method : 0.012886524200439453 length of segment : 663 time spent for convertir_results : 63.90061140060425 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 412 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 167.3600287437439 time spend to save output : 0.24029207229614258 total time spend for step 2 : 167.60032081604004 step3:blur_detection Thu Aug 28 13:25:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 1352.292668227342 (4160, 3120) 1771.6325931047168 (4160, 3120) 1444.6398032489333 (4160, 3120) 1664.570733193859 (4160, 3120) 2679.349472083983 (4160, 3120) 319.9119522043289 (4160, 3120) 728.2036315768901 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.015207529067993164 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.017090559005737305 save missing photos in datou_result : time spend for datou_step_exec : 4.086588382720947 time spend to save output : 0.036643028259277344 total time spend for step 3 : 4.123231410980225 step4:brightness Thu Aug 28 13:25:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756380087_3612788_1379854444_ee1322a97a78f65f43485324fa935a05.jpg treat image : temp/1756380087_3612788_1379854377_787b00d57414bf8477f0de7d9c309599.jpg treat image : temp/1756380087_3612788_1379854373_67650752bd560e1d851b449a4a36eb56.jpg treat image : temp/1756380087_3612788_1379854358_568b5b71f6d0ac62536573798296a4d9.jpg treat image : temp/1756380087_3612788_1379854338_90c02e59c0b1fcb3304da478f458e39d.jpg treat image : temp/1756380087_3612788_1379854319_0d446e42a67558c2f3bdcefb89801578.jpg treat image : temp/1756380087_3612788_1379854307_cf149e7b0fac47cf86920f04c6fca887.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.012837648391723633 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.012202024459838867 save missing photos in datou_result : time spend for datou_step_exec : 10.85873818397522 time spend to save output : 0.029731035232543945 total time spend for step 4 : 10.888469219207764 step5:rle_unique_nms_with_priority Thu Aug 28 13:25:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 412 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 81 nb_hashtags : 10 time to prepare the origin masks : 61.42510175704956 time for calcul the mask position with numpy : 0.2695319652557373 nb_pixel_total : 3529231 time to create 1 rle with new method : 1.1233983039855957 time for calcul the mask position with numpy : 0.04984307289123535 nb_pixel_total : 11633 time to create 1 rle with old method : 0.011969327926635742 time for calcul the mask position with numpy : 0.051576852798461914 nb_pixel_total : 257060 time to create 1 rle with new method : 1.120363712310791 time for calcul the mask position with numpy : 0.19960284233093262 nb_pixel_total : 1396602 time to create 1 rle with new method : 1.4760477542877197 time for calcul the mask position with numpy : 0.052359580993652344 nb_pixel_total : 66099 time to create 1 rle with old method : 0.06957793235778809 time for calcul the mask position with numpy : 0.05125117301940918 nb_pixel_total : 6753 time to create 1 rle with old method : 0.00737452507019043 time for calcul the mask position with numpy : 0.05415964126586914 nb_pixel_total : 401705 time to create 1 rle with new method : 1.238311767578125 time for calcul the mask position with numpy : 0.04975080490112305 nb_pixel_total : 26706 time to create 1 rle with old method : 0.028703927993774414 time for calcul the mask position with numpy : 0.050612688064575195 nb_pixel_total : 73167 time to create 1 rle with old method : 0.07542729377746582 time for calcul the mask position with numpy : 0.051056623458862305 nb_pixel_total : 5017 time to create 1 rle with old method : 0.0053899288177490234 time for calcul the mask position with numpy : 0.05122780799865723 nb_pixel_total : 43743 time to create 1 rle with old method : 0.045745134353637695 time for calcul the mask position with numpy : 0.05413007736206055 nb_pixel_total : 470313 time to create 1 rle with new method : 1.0726139545440674 time for calcul the mask position with numpy : 0.05259084701538086 nb_pixel_total : 86028 time to create 1 rle with old method : 0.09273457527160645 time for calcul the mask position with numpy : 0.05607008934020996 nb_pixel_total : 116488 time to create 1 rle with old method : 0.1589043140411377 time for calcul the mask position with numpy : 0.055362701416015625 nb_pixel_total : 139474 time to create 1 rle with old method : 0.14566898345947266 time for calcul the mask position with numpy : 0.05357527732849121 nb_pixel_total : 4099 time to create 1 rle with old method : 0.004894733428955078 time for calcul the mask position with numpy : 0.050890445709228516 nb_pixel_total : 3837 time to create 1 rle with old method : 0.004645824432373047 time for calcul the mask position with numpy : 0.05110597610473633 nb_pixel_total : 90432 time to create 1 rle with old method : 0.0917963981628418 time for calcul the mask position with numpy : 0.05016803741455078 nb_pixel_total : 37608 time to create 1 rle with old method : 0.03942251205444336 time for calcul the mask position with numpy : 0.05840587615966797 nb_pixel_total : 108268 time to create 1 rle with old method : 0.11903166770935059 time for calcul the mask position with numpy : 0.052611351013183594 nb_pixel_total : 50870 time to create 1 rle with old method : 0.05338168144226074 time for calcul the mask position with numpy : 0.052553415298461914 nb_pixel_total : 127730 time to create 1 rle with old method : 0.13332319259643555 time for calcul the mask position with numpy : 0.05153799057006836 nb_pixel_total : 62645 time to create 1 rle with old method : 0.06470561027526855 time for calcul the mask position with numpy : 0.050351858139038086 nb_pixel_total : 135 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.054331302642822266 nb_pixel_total : 90481 time to create 1 rle with old method : 0.10729408264160156 time for calcul the mask position with numpy : 0.052457571029663086 nb_pixel_total : 35589 time to create 1 rle with old method : 0.037891387939453125 time for calcul the mask position with numpy : 0.05208539962768555 nb_pixel_total : 102009 time to create 1 rle with old method : 0.10686421394348145 time for calcul the mask position with numpy : 0.05295276641845703 nb_pixel_total : 214457 time to create 1 rle with new method : 1.1449360847473145 time for calcul the mask position with numpy : 0.05122876167297363 nb_pixel_total : 23464 time to create 1 rle with old method : 0.024441957473754883 time for calcul the mask position with numpy : 0.05126214027404785 nb_pixel_total : 97648 time to create 1 rle with old method : 0.10025548934936523 time for calcul the mask position with numpy : 0.05070805549621582 nb_pixel_total : 50213 time to create 1 rle with old method : 0.05092215538024902 time for calcul the mask position with numpy : 0.050446271896362305 nb_pixel_total : 101618 time to create 1 rle with old method : 0.10301399230957031 time for calcul the mask position with numpy : 0.05614733695983887 nb_pixel_total : 393964 time to create 1 rle with new method : 1.2248139381408691 time for calcul the mask position with numpy : 0.0517420768737793 nb_pixel_total : 232976 time to create 1 rle with new method : 1.0537772178649902 time for calcul the mask position with numpy : 0.0514678955078125 nb_pixel_total : 22391 time to create 1 rle with old method : 0.023430824279785156 time for calcul the mask position with numpy : 0.05234956741333008 nb_pixel_total : 248636 time to create 1 rle with new method : 0.9674830436706543 time for calcul the mask position with numpy : 0.05051565170288086 nb_pixel_total : 18922 time to create 1 rle with old method : 0.020133018493652344 time for calcul the mask position with numpy : 0.0511775016784668 nb_pixel_total : 155329 time to create 1 rle with new method : 0.9483256340026855 time for calcul the mask position with numpy : 0.05131220817565918 nb_pixel_total : 144098 time to create 1 rle with old method : 0.14661884307861328 time for calcul the mask position with numpy : 0.05025029182434082 nb_pixel_total : 2532 time to create 1 rle with old method : 0.003088235855102539 time for calcul the mask position with numpy : 0.05047321319580078 nb_pixel_total : 52359 time to create 1 rle with old method : 0.05402636528015137 time for calcul the mask position with numpy : 0.050017595291137695 nb_pixel_total : 50728 time to create 1 rle with old method : 0.05180931091308594 time for calcul the mask position with numpy : 0.05213189125061035 nb_pixel_total : 367060 time to create 1 rle with new method : 1.0799384117126465 time for calcul the mask position with numpy : 0.05108022689819336 nb_pixel_total : 78823 time to create 1 rle with old method : 0.08126521110534668 time for calcul the mask position with numpy : 0.05020451545715332 nb_pixel_total : 5382 time to create 1 rle with old method : 0.005695819854736328 time for calcul the mask position with numpy : 0.05060243606567383 nb_pixel_total : 19426 time to create 1 rle with old method : 0.02017974853515625 time for calcul the mask position with numpy : 0.057912349700927734 nb_pixel_total : 56 time to create 1 rle with old method : 0.00010418891906738281 time for calcul the mask position with numpy : 0.05177760124206543 nb_pixel_total : 271 time to create 1 rle with old method : 0.0004944801330566406 time for calcul the mask position with numpy : 0.05117654800415039 nb_pixel_total : 32206 time to create 1 rle with old method : 0.032817840576171875 time for calcul the mask position with numpy : 0.04987597465515137 nb_pixel_total : 29479 time to create 1 rle with old method : 0.03080606460571289 time for calcul the mask position with numpy : 0.0500490665435791 nb_pixel_total : 6209 time to create 1 rle with old method : 0.006815910339355469 time for calcul the mask position with numpy : 0.05011582374572754 nb_pixel_total : 61012 time to create 1 rle with old method : 0.0625603199005127 time for calcul the mask position with numpy : 0.05305767059326172 nb_pixel_total : 479382 time to create 1 rle with new method : 0.9316840171813965 time for calcul the mask position with numpy : 0.05032658576965332 nb_pixel_total : 168 time to create 1 rle with old method : 0.000408172607421875 time for calcul the mask position with numpy : 0.05061149597167969 nb_pixel_total : 3132 time to create 1 rle with old method : 0.003470182418823242 time for calcul the mask position with numpy : 0.05118155479431152 nb_pixel_total : 280223 time to create 1 rle with new method : 1.1300973892211914 time for calcul the mask position with numpy : 0.05004572868347168 nb_pixel_total : 90706 time to create 1 rle with old method : 0.09468722343444824 time for calcul the mask position with numpy : 0.05306386947631836 nb_pixel_total : 434108 time to create 1 rle with new method : 1.023742437362671 time for calcul the mask position with numpy : 0.054763078689575195 nb_pixel_total : 52626 time to create 1 rle with old method : 0.057639122009277344 time for calcul the mask position with numpy : 0.05427098274230957 nb_pixel_total : 61088 time to create 1 rle with old method : 0.06863999366760254 time for calcul the mask position with numpy : 0.0517423152923584 nb_pixel_total : 48779 time to create 1 rle with old method : 0.049756765365600586 time for calcul the mask position with numpy : 0.05070090293884277 nb_pixel_total : 83878 time to create 1 rle with old method : 0.08820509910583496 time for calcul the mask position with numpy : 0.05155038833618164 nb_pixel_total : 101207 time to create 1 rle with old method : 0.10322260856628418 time for calcul the mask position with numpy : 0.050481319427490234 nb_pixel_total : 58132 time to create 1 rle with old method : 0.060404300689697266 time for calcul the mask position with numpy : 0.05065488815307617 nb_pixel_total : 22697 time to create 1 rle with old method : 0.02346944808959961 time for calcul the mask position with numpy : 0.05126810073852539 nb_pixel_total : 146904 time to create 1 rle with old method : 0.14888668060302734 time for calcul the mask position with numpy : 0.05612373352050781 nb_pixel_total : 538824 time to create 1 rle with new method : 1.1073741912841797 time for calcul the mask position with numpy : 0.04993939399719238 nb_pixel_total : 2334 time to create 1 rle with old method : 0.0025184154510498047 time for calcul the mask position with numpy : 0.050833702087402344 nb_pixel_total : 23166 time to create 1 rle with old method : 0.024006128311157227 time for calcul the mask position with numpy : 0.050400495529174805 nb_pixel_total : 5431 time to create 1 rle with old method : 0.007164955139160156 time for calcul the mask position with numpy : 0.05055522918701172 nb_pixel_total : 159605 time to create 1 rle with new method : 0.986391544342041 time for calcul the mask position with numpy : 0.050627708435058594 nb_pixel_total : 113919 time to create 1 rle with old method : 0.13728928565979004 time for calcul the mask position with numpy : 0.05465388298034668 nb_pixel_total : 14687 time to create 1 rle with old method : 0.01678776741027832 time for calcul the mask position with numpy : 0.05300021171569824 nb_pixel_total : 2544 time to create 1 rle with old method : 0.0030455589294433594 time for calcul the mask position with numpy : 0.052065134048461914 nb_pixel_total : 21801 time to create 1 rle with old method : 0.023841142654418945 time for calcul the mask position with numpy : 0.05445694923400879 nb_pixel_total : 244415 time to create 1 rle with new method : 0.9426617622375488 time for calcul the mask position with numpy : 0.05019021034240723 nb_pixel_total : 13556 time to create 1 rle with old method : 0.014135360717773438 time for calcul the mask position with numpy : 0.05269956588745117 nb_pixel_total : 149 time to create 1 rle with old method : 0.00022554397583007812 time for calcul the mask position with numpy : 0.05230140686035156 nb_pixel_total : 63230 time to create 1 rle with old method : 0.06553792953491211 time for calcul the mask position with numpy : 0.05021929740905762 nb_pixel_total : 2087 time to create 1 rle with old method : 0.0024738311767578125 time for calcul the mask position with numpy : 0.05033254623413086 nb_pixel_total : 129395 time to create 1 rle with old method : 0.13112974166870117 time for calcul the mask position with numpy : 0.05011749267578125 nb_pixel_total : 28046 time to create 1 rle with old method : 0.02858901023864746 create new chi : 27.388766288757324 time to delete rle : 0.034906864166259766 batch 1 Loaded 82 chid ids of type : 4855 Number RLEs to save : 65098 TO DO : save crop sub photo not yet done ! save time : 7.037759065628052 nb_obj : 73 nb_hashtags : 8 time to prepare the origin masks : 51.912691593170166 time for calcul the mask position with numpy : 0.6815140247344971 nb_pixel_total : 4357339 time to create 1 rle with new method : 1.3269057273864746 time for calcul the mask position with numpy : 0.056607961654663086 nb_pixel_total : 241795 time to create 1 rle with new method : 1.2821424007415771 time for calcul the mask position with numpy : 0.05411481857299805 nb_pixel_total : 14817 time to create 1 rle with old method : 0.01674175262451172 time for calcul the mask position with numpy : 0.05484724044799805 nb_pixel_total : 141954 time to create 1 rle with old method : 0.15641069412231445 time for calcul the mask position with numpy : 0.05462002754211426 nb_pixel_total : 165119 time to create 1 rle with new method : 1.7395992279052734 time for calcul the mask position with numpy : 0.06845784187316895 nb_pixel_total : 519742 time to create 1 rle with new method : 1.138946294784546 time for calcul the mask position with numpy : 0.05199718475341797 nb_pixel_total : 201617 time to create 1 rle with new method : 0.902759313583374 time for calcul the mask position with numpy : 0.05084848403930664 nb_pixel_total : 119670 time to create 1 rle with old method : 0.12378954887390137 time for calcul the mask position with numpy : 0.05163979530334473 nb_pixel_total : 164991 time to create 1 rle with new method : 1.1963200569152832 time for calcul the mask position with numpy : 0.050418853759765625 nb_pixel_total : 14433 time to create 1 rle with old method : 0.01575446128845215 time for calcul the mask position with numpy : 0.05054211616516113 nb_pixel_total : 40080 time to create 1 rle with old method : 0.04133105278015137 time for calcul the mask position with numpy : 0.05024576187133789 nb_pixel_total : 127985 time to create 1 rle with old method : 0.13223028182983398 time for calcul the mask position with numpy : 0.05005669593811035 nb_pixel_total : 57404 time to create 1 rle with old method : 0.0616304874420166 time for calcul the mask position with numpy : 0.05250358581542969 nb_pixel_total : 47898 time to create 1 rle with old method : 0.05175328254699707 time for calcul the mask position with numpy : 0.054206132888793945 nb_pixel_total : 210093 time to create 1 rle with new method : 0.8408596515655518 time for calcul the mask position with numpy : 0.05160117149353027 nb_pixel_total : 147583 time to create 1 rle with old method : 0.1671457290649414 time for calcul the mask position with numpy : 0.05206751823425293 nb_pixel_total : 137678 time to create 1 rle with old method : 0.14267230033874512 time for calcul the mask position with numpy : 0.052681922912597656 nb_pixel_total : 175949 time to create 1 rle with new method : 0.7024121284484863 time for calcul the mask position with numpy : 0.051401376724243164 nb_pixel_total : 146725 time to create 1 rle with old method : 0.15569138526916504 time for calcul the mask position with numpy : 0.051541805267333984 nb_pixel_total : 52765 time to create 1 rle with old method : 0.0559697151184082 time for calcul the mask position with numpy : 0.050254106521606445 nb_pixel_total : 40207 time to create 1 rle with old method : 0.0427556037902832 time for calcul the mask position with numpy : 0.05312538146972656 nb_pixel_total : 258463 time to create 1 rle with new method : 1.0029449462890625 time for calcul the mask position with numpy : 0.05253291130065918 nb_pixel_total : 79997 time to create 1 rle with old method : 0.08696222305297852 time for calcul the mask position with numpy : 0.052687883377075195 nb_pixel_total : 39767 time to create 1 rle with old method : 0.042322635650634766 time for calcul the mask position with numpy : 0.051692962646484375 nb_pixel_total : 13589 time to create 1 rle with old method : 0.016223907470703125 time for calcul the mask position with numpy : 0.05328249931335449 nb_pixel_total : 4247 time to create 1 rle with old method : 0.0048563480377197266 time for calcul the mask position with numpy : 0.05220150947570801 nb_pixel_total : 3767 time to create 1 rle with old method : 0.004492998123168945 time for calcul the mask position with numpy : 0.05436348915100098 nb_pixel_total : 330219 time to create 1 rle with new method : 0.960472822189331 time for calcul the mask position with numpy : 0.05269646644592285 nb_pixel_total : 60763 time to create 1 rle with old method : 0.06666851043701172 time for calcul the mask position with numpy : 0.053940773010253906 nb_pixel_total : 193562 time to create 1 rle with new method : 0.7906794548034668 time for calcul the mask position with numpy : 0.05304598808288574 nb_pixel_total : 211765 time to create 1 rle with new method : 0.943533182144165 time for calcul the mask position with numpy : 0.054376840591430664 nb_pixel_total : 22040 time to create 1 rle with old method : 0.02507925033569336 time for calcul the mask position with numpy : 0.054442644119262695 nb_pixel_total : 45968 time to create 1 rle with old method : 0.050733327865600586 time for calcul the mask position with numpy : 0.053577423095703125 nb_pixel_total : 171723 time to create 1 rle with new method : 1.0792012214660645 time for calcul the mask position with numpy : 0.05134725570678711 nb_pixel_total : 145690 time to create 1 rle with old method : 0.15770578384399414 time for calcul the mask position with numpy : 0.05366396903991699 nb_pixel_total : 87076 time to create 1 rle with old method : 0.09345364570617676 time for calcul the mask position with numpy : 0.05253863334655762 nb_pixel_total : 20206 time to create 1 rle with old method : 0.02197885513305664 time for calcul the mask position with numpy : 0.052393198013305664 nb_pixel_total : 27766 time to create 1 rle with old method : 0.030295133590698242 time for calcul the mask position with numpy : 0.0539860725402832 nb_pixel_total : 203098 time to create 1 rle with new method : 1.325204610824585 time for calcul the mask position with numpy : 0.05500078201293945 nb_pixel_total : 87405 time to create 1 rle with old method : 0.10498499870300293 time for calcul the mask position with numpy : 0.07467770576477051 nb_pixel_total : 28894 time to create 1 rle with old method : 0.03241777420043945 time for calcul the mask position with numpy : 0.05530381202697754 nb_pixel_total : 35494 time to create 1 rle with old method : 0.04023575782775879 time for calcul the mask position with numpy : 0.055849552154541016 nb_pixel_total : 15989 time to create 1 rle with old method : 0.01855778694152832 time for calcul the mask position with numpy : 0.05473923683166504 nb_pixel_total : 101792 time to create 1 rle with old method : 0.1227881908416748 time for calcul the mask position with numpy : 0.05718708038330078 nb_pixel_total : 55135 time to create 1 rle with old method : 0.06165957450866699 time for calcul the mask position with numpy : 0.05408453941345215 nb_pixel_total : 29247 time to create 1 rle with old method : 0.03273797035217285 time for calcul the mask position with numpy : 0.05671358108520508 nb_pixel_total : 165667 time to create 1 rle with new method : 1.0099093914031982 time for calcul the mask position with numpy : 0.054396629333496094 nb_pixel_total : 35527 time to create 1 rle with old method : 0.04098200798034668 time for calcul the mask position with numpy : 0.05432271957397461 nb_pixel_total : 66082 time to create 1 rle with old method : 0.07297301292419434 time for calcul the mask position with numpy : 0.05539274215698242 nb_pixel_total : 16963 time to create 1 rle with old method : 0.01857781410217285 time for calcul the mask position with numpy : 0.052753448486328125 nb_pixel_total : 14498 time to create 1 rle with old method : 0.016190767288208008 time for calcul the mask position with numpy : 0.053511857986450195 nb_pixel_total : 34912 time to create 1 rle with old method : 0.03854060173034668 time for calcul the mask position with numpy : 0.05313754081726074 nb_pixel_total : 24636 time to create 1 rle with old method : 0.027584314346313477 time for calcul the mask position with numpy : 0.08469486236572266 nb_pixel_total : 1269899 time to create 1 rle with new method : 1.1755638122558594 time for calcul the mask position with numpy : 0.05393409729003906 nb_pixel_total : 84755 time to create 1 rle with old method : 0.09374332427978516 time for calcul the mask position with numpy : 0.05325126647949219 nb_pixel_total : 126397 time to create 1 rle with old method : 0.13648629188537598 time for calcul the mask position with numpy : 0.052796363830566406 nb_pixel_total : 84265 time to create 1 rle with old method : 0.09071516990661621 time for calcul the mask position with numpy : 0.052584171295166016 nb_pixel_total : 41674 time to create 1 rle with old method : 0.04559016227722168 time for calcul the mask position with numpy : 0.052971839904785156 nb_pixel_total : 43535 time to create 1 rle with old method : 0.04797649383544922 time for calcul the mask position with numpy : 0.05256986618041992 nb_pixel_total : 84241 time to create 1 rle with old method : 0.09121370315551758 time for calcul the mask position with numpy : 0.055643558502197266 nb_pixel_total : 487165 time to create 1 rle with new method : 1.2932817935943604 time for calcul the mask position with numpy : 0.05767178535461426 nb_pixel_total : 173522 time to create 1 rle with new method : 0.9003462791442871 time for calcul the mask position with numpy : 0.05430126190185547 nb_pixel_total : 2021 time to create 1 rle with old method : 0.002660036087036133 time for calcul the mask position with numpy : 0.05399131774902344 nb_pixel_total : 72487 time to create 1 rle with old method : 0.08100414276123047 time for calcul the mask position with numpy : 0.054154396057128906 nb_pixel_total : 172883 time to create 1 rle with new method : 0.9260075092315674 time for calcul the mask position with numpy : 0.06173992156982422 nb_pixel_total : 145133 time to create 1 rle with old method : 0.15752172470092773 time for calcul the mask position with numpy : 0.05320429801940918 nb_pixel_total : 5971 time to create 1 rle with old method : 0.0069732666015625 time for calcul the mask position with numpy : 0.05370473861694336 nb_pixel_total : 65603 time to create 1 rle with old method : 0.07167196273803711 time for calcul the mask position with numpy : 0.0535128116607666 nb_pixel_total : 52815 time to create 1 rle with old method : 0.05667281150817871 time for calcul the mask position with numpy : 0.05253195762634277 nb_pixel_total : 76217 time to create 1 rle with old method : 0.08328652381896973 time for calcul the mask position with numpy : 0.053771257400512695 nb_pixel_total : 145161 time to create 1 rle with old method : 0.1582810878753662 time for calcul the mask position with numpy : 0.05320549011230469 nb_pixel_total : 57598 time to create 1 rle with old method : 0.06467580795288086 time for calcul the mask position with numpy : 0.05371880531311035 nb_pixel_total : 821 time to create 1 rle with old method : 0.0019593238830566406 time for calcul the mask position with numpy : 0.05369734764099121 nb_pixel_total : 29246 time to create 1 rle with old method : 0.03196430206298828 create new chi : 29.629539489746094 time to delete rle : 0.007901906967163086 batch 1 Loaded 74 chid ids of type : 4855 Number RLEs to save : 62279 TO DO : save crop sub photo not yet done ! save time : 4.802152395248413 nb_obj : 67 nb_hashtags : 10 time to prepare the origin masks : 51.197643518447876 time for calcul the mask position with numpy : 0.5051417350769043 nb_pixel_total : 4387125 time to create 1 rle with new method : 1.0590922832489014 time for calcul the mask position with numpy : 0.05449175834655762 nb_pixel_total : 10971 time to create 1 rle with old method : 0.012209892272949219 time for calcul the mask position with numpy : 0.13207292556762695 nb_pixel_total : 449131 time to create 1 rle with new method : 1.0843160152435303 time for calcul the mask position with numpy : 0.05627298355102539 nb_pixel_total : 489018 time to create 1 rle with new method : 0.9013650417327881 time for calcul the mask position with numpy : 0.0536501407623291 nb_pixel_total : 42698 time to create 1 rle with old method : 0.04714703559875488 time for calcul the mask position with numpy : 0.055292606353759766 nb_pixel_total : 134046 time to create 1 rle with old method : 0.14445161819458008 time for calcul the mask position with numpy : 0.056799888610839844 nb_pixel_total : 44820 time to create 1 rle with old method : 0.04927539825439453 time for calcul the mask position with numpy : 0.053400278091430664 nb_pixel_total : 106175 time to create 1 rle with old method : 0.11418008804321289 time for calcul the mask position with numpy : 0.05638694763183594 nb_pixel_total : 36951 time to create 1 rle with old method : 0.05928945541381836 time for calcul the mask position with numpy : 0.05531620979309082 nb_pixel_total : 69585 time to create 1 rle with old method : 0.07679200172424316 time for calcul the mask position with numpy : 0.054335832595825195 nb_pixel_total : 4907 time to create 1 rle with old method : 0.005610466003417969 time for calcul the mask position with numpy : 0.06404495239257812 nb_pixel_total : 877 time to create 1 rle with old method : 0.0018246173858642578 time for calcul the mask position with numpy : 0.060573577880859375 nb_pixel_total : 451183 time to create 1 rle with new method : 1.1720871925354004 time for calcul the mask position with numpy : 0.05184793472290039 nb_pixel_total : 30471 time to create 1 rle with old method : 0.03138256072998047 time for calcul the mask position with numpy : 0.05110621452331543 nb_pixel_total : 35043 time to create 1 rle with old method : 0.038227081298828125 time for calcul the mask position with numpy : 0.05529952049255371 nb_pixel_total : 492877 time to create 1 rle with new method : 1.1787335872650146 time for calcul the mask position with numpy : 0.052916526794433594 nb_pixel_total : 142531 time to create 1 rle with old method : 0.15357375144958496 time for calcul the mask position with numpy : 0.05292940139770508 nb_pixel_total : 1842 time to create 1 rle with old method : 0.0025162696838378906 time for calcul the mask position with numpy : 0.05416131019592285 nb_pixel_total : 214422 time to create 1 rle with new method : 0.9975335597991943 time for calcul the mask position with numpy : 0.05350780487060547 nb_pixel_total : 69727 time to create 1 rle with old method : 0.0776374340057373 time for calcul the mask position with numpy : 0.052367448806762695 nb_pixel_total : 91592 time to create 1 rle with old method : 0.09517550468444824 time for calcul the mask position with numpy : 0.05081748962402344 nb_pixel_total : 5560 time to create 1 rle with old method : 0.005984783172607422 time for calcul the mask position with numpy : 0.05116915702819824 nb_pixel_total : 52330 time to create 1 rle with old method : 0.05513763427734375 time for calcul the mask position with numpy : 0.051981449127197266 nb_pixel_total : 114813 time to create 1 rle with old method : 0.13208723068237305 time for calcul the mask position with numpy : 0.0601191520690918 nb_pixel_total : 12432 time to create 1 rle with old method : 0.013943672180175781 time for calcul the mask position with numpy : 0.05455946922302246 nb_pixel_total : 256146 time to create 1 rle with new method : 0.9238383769989014 time for calcul the mask position with numpy : 0.05304074287414551 nb_pixel_total : 296308 time to create 1 rle with new method : 0.6841278076171875 time for calcul the mask position with numpy : 0.05263638496398926 nb_pixel_total : 2613 time to create 1 rle with old method : 0.003236055374145508 time for calcul the mask position with numpy : 0.05117487907409668 nb_pixel_total : 150052 time to create 1 rle with new method : 0.9743411540985107 time for calcul the mask position with numpy : 0.04932594299316406 nb_pixel_total : 33166 time to create 1 rle with old method : 0.03424954414367676 time for calcul the mask position with numpy : 0.052449941635131836 nb_pixel_total : 418316 time to create 1 rle with new method : 0.859743595123291 time for calcul the mask position with numpy : 0.05284261703491211 nb_pixel_total : 199203 time to create 1 rle with new method : 1.0214674472808838 time for calcul the mask position with numpy : 0.06661462783813477 nb_pixel_total : 375776 time to create 1 rle with new method : 0.9011962413787842 time for calcul the mask position with numpy : 0.05284857749938965 nb_pixel_total : 55507 time to create 1 rle with old method : 0.05933022499084473 time for calcul the mask position with numpy : 0.052245378494262695 nb_pixel_total : 51158 time to create 1 rle with old method : 0.05500435829162598 time for calcul the mask position with numpy : 0.0521085262298584 nb_pixel_total : 49483 time to create 1 rle with old method : 0.054894447326660156 time for calcul the mask position with numpy : 0.051538944244384766 nb_pixel_total : 70588 time to create 1 rle with old method : 0.07353925704956055 time for calcul the mask position with numpy : 0.05168914794921875 nb_pixel_total : 9885 time to create 1 rle with old method : 0.011000394821166992 time for calcul the mask position with numpy : 0.052678585052490234 nb_pixel_total : 25334 time to create 1 rle with old method : 0.02637958526611328 time for calcul the mask position with numpy : 0.05039334297180176 nb_pixel_total : 82957 time to create 1 rle with old method : 0.0877079963684082 time for calcul the mask position with numpy : 0.05069589614868164 nb_pixel_total : 49034 time to create 1 rle with old method : 0.051191091537475586 time for calcul the mask position with numpy : 0.0525059700012207 nb_pixel_total : 58139 time to create 1 rle with old method : 0.06011652946472168 time for calcul the mask position with numpy : 0.04974007606506348 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0014109611511230469 time for calcul the mask position with numpy : 0.04948544502258301 nb_pixel_total : 68787 time to create 1 rle with old method : 0.0718393325805664 time for calcul the mask position with numpy : 0.05186200141906738 nb_pixel_total : 78703 time to create 1 rle with old method : 0.08065152168273926 time for calcul the mask position with numpy : 0.05182218551635742 nb_pixel_total : 37952 time to create 1 rle with old method : 0.039955854415893555 time for calcul the mask position with numpy : 0.0493931770324707 nb_pixel_total : 59851 time to create 1 rle with old method : 0.06092357635498047 time for calcul the mask position with numpy : 0.05149435997009277 nb_pixel_total : 429752 time to create 1 rle with new method : 0.699044942855835 time for calcul the mask position with numpy : 0.05181121826171875 nb_pixel_total : 156776 time to create 1 rle with new method : 0.78302001953125 time for calcul the mask position with numpy : 0.05136418342590332 nb_pixel_total : 48569 time to create 1 rle with old method : 0.05092000961303711 time for calcul the mask position with numpy : 0.05033683776855469 nb_pixel_total : 572 time to create 1 rle with old method : 0.0008823871612548828 time for calcul the mask position with numpy : 0.05152106285095215 nb_pixel_total : 1966 time to create 1 rle with old method : 0.0024063587188720703 time for calcul the mask position with numpy : 0.05164694786071777 nb_pixel_total : 6437 time to create 1 rle with old method : 0.0069751739501953125 time for calcul the mask position with numpy : 0.05263638496398926 nb_pixel_total : 189993 time to create 1 rle with new method : 0.8262784481048584 time for calcul the mask position with numpy : 0.0498807430267334 nb_pixel_total : 31379 time to create 1 rle with old method : 0.03236865997314453 time for calcul the mask position with numpy : 0.06158638000488281 nb_pixel_total : 816298 time to create 1 rle with new method : 0.8235769271850586 time for calcul the mask position with numpy : 0.0513458251953125 nb_pixel_total : 188986 time to create 1 rle with new method : 0.8048949241638184 time for calcul the mask position with numpy : 0.050626516342163086 nb_pixel_total : 58964 time to create 1 rle with old method : 0.06241941452026367 time for calcul the mask position with numpy : 0.049298763275146484 nb_pixel_total : 4143 time to create 1 rle with old method : 0.00490260124206543 time for calcul the mask position with numpy : 0.05017256736755371 nb_pixel_total : 184213 time to create 1 rle with new method : 0.6495413780212402 time for calcul the mask position with numpy : 0.050126075744628906 nb_pixel_total : 41627 time to create 1 rle with old method : 0.04346132278442383 time for calcul the mask position with numpy : 0.05231022834777832 nb_pixel_total : 570913 time to create 1 rle with new method : 0.8540189266204834 time for calcul the mask position with numpy : 0.051064491271972656 nb_pixel_total : 247273 time to create 1 rle with new method : 0.67275071144104 time for calcul the mask position with numpy : 0.0494539737701416 nb_pixel_total : 15794 time to create 1 rle with old method : 0.016428470611572266 time for calcul the mask position with numpy : 0.049768686294555664 nb_pixel_total : 27578 time to create 1 rle with old method : 0.0286557674407959 time for calcul the mask position with numpy : 0.05083727836608887 nb_pixel_total : 3070 time to create 1 rle with old method : 0.0034437179565429688 time for calcul the mask position with numpy : 0.0496981143951416 nb_pixel_total : 12682 time to create 1 rle with old method : 0.013233423233032227 time for calcul the mask position with numpy : 0.04953598976135254 nb_pixel_total : 20897 time to create 1 rle with old method : 0.02138233184814453 create new chi : 24.986225605010986 time to delete rle : 0.0064754486083984375 batch 1 Loaded 68 chid ids of type : 4855 Number RLEs to save : 59231 TO DO : save crop sub photo not yet done ! save time : 7.019854545593262 nb_obj : 71 nb_hashtags : 8 time to prepare the origin masks : 50.60015916824341 time for calcul the mask position with numpy : 0.24087190628051758 nb_pixel_total : 5267974 time to create 1 rle with new method : 0.5595388412475586 time for calcul the mask position with numpy : 0.05351901054382324 nb_pixel_total : 4291 time to create 1 rle with old method : 0.005101680755615234 time for calcul the mask position with numpy : 0.05644392967224121 nb_pixel_total : 16998 time to create 1 rle with old method : 0.019715070724487305 time for calcul the mask position with numpy : 0.06609892845153809 nb_pixel_total : 175569 time to create 1 rle with new method : 0.7780015468597412 time for calcul the mask position with numpy : 0.053865909576416016 nb_pixel_total : 81762 time to create 1 rle with old method : 0.0860292911529541 time for calcul the mask position with numpy : 0.075531005859375 nb_pixel_total : 724002 time to create 1 rle with new method : 1.6643686294555664 time for calcul the mask position with numpy : 0.05462646484375 nb_pixel_total : 6621 time to create 1 rle with old method : 0.01154637336730957 time for calcul the mask position with numpy : 0.06165361404418945 nb_pixel_total : 41843 time to create 1 rle with old method : 0.04641532897949219 time for calcul the mask position with numpy : 0.057459115982055664 nb_pixel_total : 205288 time to create 1 rle with new method : 1.1311085224151611 time for calcul the mask position with numpy : 0.054548025131225586 nb_pixel_total : 119149 time to create 1 rle with old method : 0.12852191925048828 time for calcul the mask position with numpy : 0.05688190460205078 nb_pixel_total : 370468 time to create 1 rle with new method : 1.1531438827514648 time for calcul the mask position with numpy : 0.054598093032836914 nb_pixel_total : 34433 time to create 1 rle with old method : 0.0386202335357666 time for calcul the mask position with numpy : 0.054477691650390625 nb_pixel_total : 2614 time to create 1 rle with old method : 0.0035538673400878906 time for calcul the mask position with numpy : 0.057170867919921875 nb_pixel_total : 209897 time to create 1 rle with new method : 1.1252295970916748 time for calcul the mask position with numpy : 0.056891441345214844 nb_pixel_total : 396 time to create 1 rle with old method : 0.0009326934814453125 time for calcul the mask position with numpy : 0.05533456802368164 nb_pixel_total : 70988 time to create 1 rle with old method : 0.10136842727661133 time for calcul the mask position with numpy : 0.05453777313232422 nb_pixel_total : 28195 time to create 1 rle with old method : 0.0316157341003418 time for calcul the mask position with numpy : 0.057297468185424805 nb_pixel_total : 115113 time to create 1 rle with old method : 0.12752890586853027 time for calcul the mask position with numpy : 0.05463218688964844 nb_pixel_total : 11744 time to create 1 rle with old method : 0.013770341873168945 time for calcul the mask position with numpy : 0.054757118225097656 nb_pixel_total : 109867 time to create 1 rle with old method : 0.1213994026184082 time for calcul the mask position with numpy : 0.05435299873352051 nb_pixel_total : 21818 time to create 1 rle with old method : 0.024495601654052734 time for calcul the mask position with numpy : 0.05487632751464844 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002884864807128906 time for calcul the mask position with numpy : 0.05410170555114746 nb_pixel_total : 28027 time to create 1 rle with old method : 0.030541419982910156 time for calcul the mask position with numpy : 0.057506561279296875 nb_pixel_total : 432471 time to create 1 rle with new method : 1.1264381408691406 time for calcul the mask position with numpy : 0.053559064865112305 nb_pixel_total : 91300 time to create 1 rle with old method : 0.09984612464904785 time for calcul the mask position with numpy : 0.05327916145324707 nb_pixel_total : 53264 time to create 1 rle with old method : 0.05802750587463379 time for calcul the mask position with numpy : 0.05347132682800293 nb_pixel_total : 24730 time to create 1 rle with old method : 0.027123451232910156 time for calcul the mask position with numpy : 0.054125308990478516 nb_pixel_total : 23019 time to create 1 rle with old method : 0.02523183822631836 time for calcul the mask position with numpy : 0.05358242988586426 nb_pixel_total : 41746 time to create 1 rle with old method : 0.046636343002319336 time for calcul the mask position with numpy : 0.0542597770690918 nb_pixel_total : 82117 time to create 1 rle with old method : 0.09294843673706055 time for calcul the mask position with numpy : 0.05531573295593262 nb_pixel_total : 47739 time to create 1 rle with old method : 0.05431246757507324 time for calcul the mask position with numpy : 0.059752464294433594 nb_pixel_total : 91698 time to create 1 rle with old method : 0.10338449478149414 time for calcul the mask position with numpy : 0.05631542205810547 nb_pixel_total : 3606 time to create 1 rle with old method : 0.004943370819091797 time for calcul the mask position with numpy : 0.05701041221618652 nb_pixel_total : 236650 time to create 1 rle with new method : 1.0541298389434814 time for calcul the mask position with numpy : 0.057229042053222656 nb_pixel_total : 62132 time to create 1 rle with old method : 0.08740472793579102 time for calcul the mask position with numpy : 0.05523538589477539 nb_pixel_total : 83612 time to create 1 rle with old method : 0.09288930892944336 time for calcul the mask position with numpy : 0.05595993995666504 nb_pixel_total : 74556 time to create 1 rle with old method : 0.08258533477783203 time for calcul the mask position with numpy : 0.05612611770629883 nb_pixel_total : 282709 time to create 1 rle with new method : 0.8230867385864258 time for calcul the mask position with numpy : 0.055031776428222656 nb_pixel_total : 217086 time to create 1 rle with new method : 0.8976173400878906 time for calcul the mask position with numpy : 0.056282758712768555 nb_pixel_total : 375240 time to create 1 rle with new method : 0.8530142307281494 time for calcul the mask position with numpy : 0.05363750457763672 nb_pixel_total : 67587 time to create 1 rle with old method : 0.08079957962036133 time for calcul the mask position with numpy : 0.05372977256774902 nb_pixel_total : 146199 time to create 1 rle with old method : 0.1696460247039795 time for calcul the mask position with numpy : 0.05240297317504883 nb_pixel_total : 21527 time to create 1 rle with old method : 0.025753498077392578 time for calcul the mask position with numpy : 0.060222625732421875 nb_pixel_total : 691764 time to create 1 rle with new method : 0.8552811145782471 time for calcul the mask position with numpy : 0.05268073081970215 nb_pixel_total : 261316 time to create 1 rle with new method : 0.8229200839996338 time for calcul the mask position with numpy : 0.05289959907531738 nb_pixel_total : 5186 time to create 1 rle with old method : 0.0069882869720458984 time for calcul the mask position with numpy : 0.05346488952636719 nb_pixel_total : 39508 time to create 1 rle with old method : 0.04679679870605469 time for calcul the mask position with numpy : 0.053795814514160156 nb_pixel_total : 131034 time to create 1 rle with old method : 0.14737987518310547 time for calcul the mask position with numpy : 0.05350303649902344 nb_pixel_total : 80650 time to create 1 rle with old method : 0.08701705932617188 time for calcul the mask position with numpy : 0.0601963996887207 nb_pixel_total : 582281 time to create 1 rle with new method : 0.8722934722900391 time for calcul the mask position with numpy : 0.05594515800476074 nb_pixel_total : 2032 time to create 1 rle with old method : 0.002985239028930664 time for calcul the mask position with numpy : 0.06143927574157715 nb_pixel_total : 135031 time to create 1 rle with old method : 0.16299176216125488 time for calcul the mask position with numpy : 0.05435490608215332 nb_pixel_total : 9876 time to create 1 rle with old method : 0.012511730194091797 time for calcul the mask position with numpy : 0.054265499114990234 nb_pixel_total : 15069 time to create 1 rle with old method : 0.01886439323425293 time for calcul the mask position with numpy : 0.054190874099731445 nb_pixel_total : 4298 time to create 1 rle with old method : 0.005857229232788086 time for calcul the mask position with numpy : 0.055296897888183594 nb_pixel_total : 150741 time to create 1 rle with new method : 1.037154197692871 time for calcul the mask position with numpy : 0.05518770217895508 nb_pixel_total : 17493 time to create 1 rle with old method : 0.01960134506225586 time for calcul the mask position with numpy : 0.05414414405822754 nb_pixel_total : 14212 time to create 1 rle with old method : 0.016110658645629883 time for calcul the mask position with numpy : 0.05425143241882324 nb_pixel_total : 2777 time to create 1 rle with old method : 0.0034635066986083984 time for calcul the mask position with numpy : 0.05501151084899902 nb_pixel_total : 56099 time to create 1 rle with old method : 0.061437368392944336 time for calcul the mask position with numpy : 0.05428171157836914 nb_pixel_total : 23965 time to create 1 rle with old method : 0.026872873306274414 time for calcul the mask position with numpy : 0.05639243125915527 nb_pixel_total : 242511 time to create 1 rle with new method : 0.9381775856018066 time for calcul the mask position with numpy : 0.053580522537231445 nb_pixel_total : 1556 time to create 1 rle with old method : 0.002237558364868164 time for calcul the mask position with numpy : 0.05362057685852051 nb_pixel_total : 54463 time to create 1 rle with old method : 0.05959892272949219 time for calcul the mask position with numpy : 0.05259084701538086 nb_pixel_total : 9781 time to create 1 rle with old method : 0.010856866836547852 time for calcul the mask position with numpy : 0.05267620086669922 nb_pixel_total : 2369 time to create 1 rle with old method : 0.002837657928466797 time for calcul the mask position with numpy : 0.05327582359313965 nb_pixel_total : 67238 time to create 1 rle with old method : 0.07562494277954102 time for calcul the mask position with numpy : 0.05326366424560547 nb_pixel_total : 67619 time to create 1 rle with old method : 0.07346343994140625 time for calcul the mask position with numpy : 0.05332636833190918 nb_pixel_total : 111236 time to create 1 rle with old method : 0.12236237525939941 time for calcul the mask position with numpy : 0.0530393123626709 nb_pixel_total : 21832 time to create 1 rle with old method : 0.024041175842285156 time for calcul the mask position with numpy : 0.05235171318054199 nb_pixel_total : 70935 time to create 1 rle with old method : 0.07730269432067871 time for calcul the mask position with numpy : 0.05313277244567871 nb_pixel_total : 90 time to create 1 rle with old method : 0.00013709068298339844 create new chi : 23.500511169433594 time to delete rle : 0.006752490997314453 batch 1 Loaded 72 chid ids of type : 4855 Number RLEs to save : 60498 TO DO : save crop sub photo not yet done ! save time : 9.860736608505249 nb_obj : 87 nb_hashtags : 9 time to prepare the origin masks : 65.95036268234253 time for calcul the mask position with numpy : 0.7565443515777588 nb_pixel_total : 5206016 time to create 1 rle with new method : 1.3873193264007568 time for calcul the mask position with numpy : 0.05401206016540527 nb_pixel_total : 121789 time to create 1 rle with old method : 0.13366436958312988 time for calcul the mask position with numpy : 0.05117440223693848 nb_pixel_total : 10035 time to create 1 rle with old method : 0.01066732406616211 time for calcul the mask position with numpy : 0.051468849182128906 nb_pixel_total : 3803 time to create 1 rle with old method : 0.004346609115600586 time for calcul the mask position with numpy : 0.05302929878234863 nb_pixel_total : 220641 time to create 1 rle with new method : 1.0806138515472412 time for calcul the mask position with numpy : 0.05206942558288574 nb_pixel_total : 4413 time to create 1 rle with old method : 0.004792451858520508 time for calcul the mask position with numpy : 0.05189776420593262 nb_pixel_total : 73976 time to create 1 rle with old method : 0.07775616645812988 time for calcul the mask position with numpy : 0.05187582969665527 nb_pixel_total : 47688 time to create 1 rle with old method : 0.05206131935119629 time for calcul the mask position with numpy : 0.054622650146484375 nb_pixel_total : 106043 time to create 1 rle with old method : 0.11427497863769531 time for calcul the mask position with numpy : 0.051569223403930664 nb_pixel_total : 66703 time to create 1 rle with old method : 0.07055902481079102 time for calcul the mask position with numpy : 0.05159926414489746 nb_pixel_total : 32969 time to create 1 rle with old method : 0.035085439682006836 time for calcul the mask position with numpy : 0.05190563201904297 nb_pixel_total : 156165 time to create 1 rle with new method : 0.8818104267120361 time for calcul the mask position with numpy : 0.05256319046020508 nb_pixel_total : 36615 time to create 1 rle with old method : 0.05415701866149902 time for calcul the mask position with numpy : 0.06012916564941406 nb_pixel_total : 74049 time to create 1 rle with old method : 0.08147454261779785 time for calcul the mask position with numpy : 0.052000999450683594 nb_pixel_total : 47746 time to create 1 rle with old method : 0.0503542423248291 time for calcul the mask position with numpy : 0.052213430404663086 nb_pixel_total : 52034 time to create 1 rle with old method : 0.0561060905456543 time for calcul the mask position with numpy : 0.05200052261352539 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003795623779296875 time for calcul the mask position with numpy : 0.05192399024963379 nb_pixel_total : 63846 time to create 1 rle with old method : 0.06849360466003418 time for calcul the mask position with numpy : 0.051489830017089844 nb_pixel_total : 67713 time to create 1 rle with old method : 0.07333683967590332 time for calcul the mask position with numpy : 0.051980018615722656 nb_pixel_total : 31991 time to create 1 rle with old method : 0.03433704376220703 time for calcul the mask position with numpy : 0.052469491958618164 nb_pixel_total : 121719 time to create 1 rle with old method : 0.13362765312194824 time for calcul the mask position with numpy : 0.05296802520751953 nb_pixel_total : 62191 time to create 1 rle with old method : 0.06814050674438477 time for calcul the mask position with numpy : 0.05338168144226074 nb_pixel_total : 29520 time to create 1 rle with old method : 0.03546452522277832 time for calcul the mask position with numpy : 0.055002689361572266 nb_pixel_total : 44428 time to create 1 rle with old method : 0.049131155014038086 time for calcul the mask position with numpy : 0.05377554893493652 nb_pixel_total : 72398 time to create 1 rle with old method : 0.07761716842651367 time for calcul the mask position with numpy : 0.05280923843383789 nb_pixel_total : 9 time to create 1 rle with old method : 4.601478576660156e-05 time for calcul the mask position with numpy : 0.05265545845031738 nb_pixel_total : 14552 time to create 1 rle with old method : 0.015839576721191406 time for calcul the mask position with numpy : 0.05338239669799805 nb_pixel_total : 175240 time to create 1 rle with new method : 0.9033989906311035 time for calcul the mask position with numpy : 0.05244278907775879 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002644062042236328 time for calcul the mask position with numpy : 0.052408695220947266 nb_pixel_total : 57068 time to create 1 rle with old method : 0.06038212776184082 time for calcul the mask position with numpy : 0.05234360694885254 nb_pixel_total : 28918 time to create 1 rle with old method : 0.031516075134277344 time for calcul the mask position with numpy : 0.05278801918029785 nb_pixel_total : 27269 time to create 1 rle with old method : 0.029468297958374023 time for calcul the mask position with numpy : 0.05373978614807129 nb_pixel_total : 72236 time to create 1 rle with old method : 0.07807779312133789 time for calcul the mask position with numpy : 0.0521855354309082 nb_pixel_total : 54961 time to create 1 rle with old method : 0.05765199661254883 time for calcul the mask position with numpy : 0.05209660530090332 nb_pixel_total : 62027 time to create 1 rle with old method : 0.06585288047790527 time for calcul the mask position with numpy : 0.05322551727294922 nb_pixel_total : 202260 time to create 1 rle with new method : 0.983433723449707 time for calcul the mask position with numpy : 0.052698612213134766 nb_pixel_total : 18303 time to create 1 rle with old method : 0.02090740203857422 time for calcul the mask position with numpy : 0.05203509330749512 nb_pixel_total : 32361 time to create 1 rle with old method : 0.03393268585205078 time for calcul the mask position with numpy : 0.05960679054260254 nb_pixel_total : 134035 time to create 1 rle with old method : 0.15663933753967285 time for calcul the mask position with numpy : 0.05277562141418457 nb_pixel_total : 71467 time to create 1 rle with old method : 0.07671141624450684 time for calcul the mask position with numpy : 0.054781436920166016 nb_pixel_total : 45026 time to create 1 rle with old method : 0.048429250717163086 time for calcul the mask position with numpy : 0.053203582763671875 nb_pixel_total : 151498 time to create 1 rle with new method : 1.0224535465240479 time for calcul the mask position with numpy : 0.05195784568786621 nb_pixel_total : 45456 time to create 1 rle with old method : 0.04709005355834961 time for calcul the mask position with numpy : 0.051938772201538086 nb_pixel_total : 246751 time to create 1 rle with new method : 0.9963746070861816 time for calcul the mask position with numpy : 0.05450105667114258 nb_pixel_total : 98583 time to create 1 rle with old method : 0.10468244552612305 time for calcul the mask position with numpy : 0.05180954933166504 nb_pixel_total : 50783 time to create 1 rle with old method : 0.05387473106384277 time for calcul the mask position with numpy : 0.05142498016357422 nb_pixel_total : 17931 time to create 1 rle with old method : 0.01856064796447754 time for calcul the mask position with numpy : 0.05263185501098633 nb_pixel_total : 37071 time to create 1 rle with old method : 0.039884328842163086 time for calcul the mask position with numpy : 0.05179882049560547 nb_pixel_total : 98709 time to create 1 rle with old method : 0.10511159896850586 time for calcul the mask position with numpy : 0.050432682037353516 nb_pixel_total : 72723 time to create 1 rle with old method : 0.07631683349609375 time for calcul the mask position with numpy : 0.052379608154296875 nb_pixel_total : 6898 time to create 1 rle with old method : 0.007666587829589844 time for calcul the mask position with numpy : 0.05396080017089844 nb_pixel_total : 98587 time to create 1 rle with old method : 0.11023759841918945 time for calcul the mask position with numpy : 0.054670095443725586 nb_pixel_total : 44720 time to create 1 rle with old method : 0.04890942573547363 time for calcul the mask position with numpy : 0.053971052169799805 nb_pixel_total : 71317 time to create 1 rle with old method : 0.0780482292175293 time for calcul the mask position with numpy : 0.05364632606506348 nb_pixel_total : 7540 time to create 1 rle with old method : 0.008182525634765625 time for calcul the mask position with numpy : 0.05206418037414551 nb_pixel_total : 42456 time to create 1 rle with old method : 0.044417381286621094 time for calcul the mask position with numpy : 0.053479671478271484 nb_pixel_total : 16765 time to create 1 rle with old method : 0.018128395080566406 time for calcul the mask position with numpy : 0.052301883697509766 nb_pixel_total : 30789 time to create 1 rle with old method : 0.032340288162231445 time for calcul the mask position with numpy : 0.05201101303100586 nb_pixel_total : 61571 time to create 1 rle with old method : 0.06885480880737305 time for calcul the mask position with numpy : 0.052205562591552734 nb_pixel_total : 2641 time to create 1 rle with old method : 0.003166675567626953 time for calcul the mask position with numpy : 0.05146074295043945 nb_pixel_total : 152818 time to create 1 rle with new method : 0.8259387016296387 time for calcul the mask position with numpy : 0.05796074867248535 nb_pixel_total : 312265 time to create 1 rle with new method : 0.770437479019165 time for calcul the mask position with numpy : 0.05245542526245117 nb_pixel_total : 81021 time to create 1 rle with old method : 0.08581662178039551 time for calcul the mask position with numpy : 0.05251955986022949 nb_pixel_total : 158828 time to create 1 rle with new method : 1.006417989730835 time for calcul the mask position with numpy : 0.05124521255493164 nb_pixel_total : 51481 time to create 1 rle with old method : 0.055001020431518555 time for calcul the mask position with numpy : 0.05299091339111328 nb_pixel_total : 14202 time to create 1 rle with old method : 0.015020608901977539 time for calcul the mask position with numpy : 0.06030893325805664 nb_pixel_total : 573816 time to create 1 rle with new method : 0.915097713470459 time for calcul the mask position with numpy : 0.05276799201965332 nb_pixel_total : 103728 time to create 1 rle with old method : 0.11016201972961426 time for calcul the mask position with numpy : 0.053137779235839844 nb_pixel_total : 8015 time to create 1 rle with old method : 0.009274482727050781 time for calcul the mask position with numpy : 0.053624868392944336 nb_pixel_total : 220491 time to create 1 rle with new method : 0.9464693069458008 time for calcul the mask position with numpy : 0.05237007141113281 nb_pixel_total : 29887 time to create 1 rle with old method : 0.03199362754821777 time for calcul the mask position with numpy : 0.05347490310668945 nb_pixel_total : 270626 time to create 1 rle with new method : 0.8376874923706055 time for calcul the mask position with numpy : 0.05329251289367676 nb_pixel_total : 4706 time to create 1 rle with old method : 0.005784034729003906 time for calcul the mask position with numpy : 0.0516507625579834 nb_pixel_total : 6912 time to create 1 rle with old method : 0.007654428482055664 time for calcul the mask position with numpy : 0.0514521598815918 nb_pixel_total : 25464 time to create 1 rle with old method : 0.027335166931152344 time for calcul the mask position with numpy : 0.05209016799926758 nb_pixel_total : 43165 time to create 1 rle with old method : 0.048149824142456055 time for calcul the mask position with numpy : 0.05312371253967285 nb_pixel_total : 175749 time to create 1 rle with new method : 0.831066370010376 time for calcul the mask position with numpy : 0.05215954780578613 nb_pixel_total : 52682 time to create 1 rle with old method : 0.05632781982421875 time for calcul the mask position with numpy : 0.05299091339111328 nb_pixel_total : 34403 time to create 1 rle with old method : 0.0372319221496582 time for calcul the mask position with numpy : 0.053002119064331055 nb_pixel_total : 170116 time to create 1 rle with new method : 0.9523842334747314 time for calcul the mask position with numpy : 0.05602097511291504 nb_pixel_total : 407820 time to create 1 rle with new method : 0.7950713634490967 time for calcul the mask position with numpy : 0.05266571044921875 nb_pixel_total : 49780 time to create 1 rle with old method : 0.053583621978759766 time for calcul the mask position with numpy : 0.05457806587219238 nb_pixel_total : 214347 time to create 1 rle with new method : 0.8502054214477539 time for calcul the mask position with numpy : 0.055826425552368164 nb_pixel_total : 466626 time to create 1 rle with new method : 0.8224117755889893 time for calcul the mask position with numpy : 0.05238652229309082 nb_pixel_total : 234800 time to create 1 rle with new method : 0.925485372543335 time for calcul the mask position with numpy : 0.05254840850830078 nb_pixel_total : 65216 time to create 1 rle with old method : 0.06939196586608887 time for calcul the mask position with numpy : 0.0524139404296875 nb_pixel_total : 95564 time to create 1 rle with old method : 0.10271120071411133 time for calcul the mask position with numpy : 0.05222058296203613 nb_pixel_total : 1307 time to create 1 rle with old method : 0.0016427040100097656 create new chi : 27.448339223861694 time to delete rle : 0.007582664489746094 batch 1 Loaded 88 chid ids of type : 4855 Number RLEs to save : 66331 TO DO : save crop sub photo not yet done ! save time : 6.748784303665161 nb_obj : 17 nb_hashtags : 6 time to prepare the origin masks : 19.09960126876831 time for calcul the mask position with numpy : 0.2734818458557129 nb_pixel_total : 2555564 time to create 1 rle with new method : 1.3409202098846436 time for calcul the mask position with numpy : 0.08475947380065918 nb_pixel_total : 1186450 time to create 1 rle with new method : 1.1343662738800049 time for calcul the mask position with numpy : 0.234602689743042 nb_pixel_total : 2419736 time to create 1 rle with new method : 1.3804078102111816 time for calcul the mask position with numpy : 0.06502056121826172 nb_pixel_total : 328438 time to create 1 rle with new method : 1.1637732982635498 time for calcul the mask position with numpy : 0.06129789352416992 nb_pixel_total : 124483 time to create 1 rle with old method : 0.13470983505249023 time for calcul the mask position with numpy : 0.06094646453857422 nb_pixel_total : 153608 time to create 1 rle with new method : 1.003950834274292 time for calcul the mask position with numpy : 0.07113289833068848 nb_pixel_total : 990524 time to create 1 rle with new method : 1.3703529834747314 time for calcul the mask position with numpy : 0.060709238052368164 nb_pixel_total : 27751 time to create 1 rle with old method : 0.030167102813720703 time for calcul the mask position with numpy : 0.06438851356506348 nb_pixel_total : 234940 time to create 1 rle with new method : 1.1690382957458496 time for calcul the mask position with numpy : 0.05987405776977539 nb_pixel_total : 58613 time to create 1 rle with old method : 0.06330442428588867 time for calcul the mask position with numpy : 0.07836008071899414 nb_pixel_total : 1873377 time to create 1 rle with new method : 0.9840853214263916 time for calcul the mask position with numpy : 0.05504298210144043 nb_pixel_total : 170825 time to create 1 rle with new method : 0.9602310657501221 time for calcul the mask position with numpy : 0.040717124938964844 nb_pixel_total : 361427 time to create 1 rle with new method : 1.0699868202209473 time for calcul the mask position with numpy : 0.0559389591217041 nb_pixel_total : 1814114 time to create 1 rle with new method : 0.9554390907287598 time for calcul the mask position with numpy : 0.06533193588256836 nb_pixel_total : 79951 time to create 1 rle with old method : 0.11250090599060059 time for calcul the mask position with numpy : 0.06344223022460938 nb_pixel_total : 414509 time to create 1 rle with new method : 1.1453461647033691 time for calcul the mask position with numpy : 0.06329631805419922 nb_pixel_total : 25299 time to create 1 rle with old method : 0.028010129928588867 time for calcul the mask position with numpy : 0.05814552307128906 nb_pixel_total : 159591 time to create 1 rle with new method : 1.2128279209136963 create new chi : 17.325737714767456 time to delete rle : 0.0032503604888916016 batch 1 Loaded 18 chid ids of type : 4855 Number RLEs to save : 26555 TO DO : save crop sub photo not yet done ! save time : 2.3225972652435303 nb_obj : 6 nb_hashtags : 1 time to prepare the origin masks : 14.629806756973267 time for calcul the mask position with numpy : 0.22416377067565918 nb_pixel_total : 1406682 time to create 1 rle with new method : 1.55464506149292 time for calcul the mask position with numpy : 0.06530165672302246 nb_pixel_total : 231002 time to create 1 rle with new method : 1.087205410003662 time for calcul the mask position with numpy : 0.060030221939086914 nb_pixel_total : 82894 time to create 1 rle with old method : 0.08952188491821289 time for calcul the mask position with numpy : 0.06241607666015625 nb_pixel_total : 131526 time to create 1 rle with old method : 0.1597003936767578 time for calcul the mask position with numpy : 0.0670614242553711 nb_pixel_total : 46096 time to create 1 rle with old method : 0.051256418228149414 time for calcul the mask position with numpy : 0.07479476928710938 nb_pixel_total : 1317463 time to create 1 rle with new method : 1.2150027751922607 time for calcul the mask position with numpy : 0.8084096908569336 nb_pixel_total : 9763537 time to create 1 rle with new method : 1.2124316692352295 create new chi : 6.931048393249512 time to delete rle : 0.002429485321044922 batch 1 Loaded 7 chid ids of type : 4855 Number RLEs to save : 18189 TO DO : save crop sub photo not yet done ! save time : 1.8464579582214355 map_output_result : {1379854444: (0.4826611146009304, 'Should be the crop_list due to order', 0.7160278734225889), 1379854377: (0.4826611146009304, 'Should be the crop_list due to order', 0.4160642691366674), 1379854373: (0.4826611146009304, 'Should be the crop_list due to order', 0.5235799224264389), 1379854358: (0.4826611146009304, 'Should be the crop_list due to order', 0.5331202544909085), 1379854338: (0.4826611146009304, 'Should be the crop_list due to order', 0.3441892228052304), 1379854319: (0.4826611146009304, 'Should be the crop_list due to order', 0.8456462599246791), 1379854307: (0.4826611146009304, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379854444, 1379854377, 1379854373, 1379854358, 1379854338, 1379854319, 1379854307] Looping around the photos to save general results len do output : 7 /1379854444.Didn't retrieve data . /1379854377.Didn't retrieve data . /1379854373.Didn't retrieve data . /1379854358.Didn't retrieve data . /1379854338.Didn't retrieve data . /1379854319.Didn't retrieve data . /1379854307.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854444', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854377', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854373', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854358', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854338', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854319', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854307', None, None, None, None, None, '3623874') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.017017602920532227 save_final save missing photos in datou_result : time spend for datou_step_exec : 515.14648604393 time spend to save output : 0.021724939346313477 total time spend for step 5 : 515.1682109832764 step6:crop_condition Thu Aug 28 13:34:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 409 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3015255 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756380890_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 40 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.963514566421509 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 81 About to insert : list_path_to_insert length 81 new photo from crops ! About to upload 81 photos upload in portfolio : 3015255 init cache_photo without model_param we have 81 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756380949_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 81 photos in the portfolio 3015255 time of upload the photos Elapsed time : 21.454166889190674 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3015255 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756380979_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 25 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.213820219039917 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3015255 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756380993_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.7042243480682373 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3015255 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756381000_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.8111066818237305 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3015255 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756381014_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 22 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.821193218231201 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 75 About to insert : list_path_to_insert length 75 new photo from crops ! About to upload 75 photos upload in portfolio : 3015255 init cache_photo without model_param we have 75 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756381129_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 75 photos in the portfolio 3015255 time of upload the photos Elapsed time : 24.849639892578125 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756381158_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6722149848937988 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3015255 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756381166_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.4885146617889404 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3015255 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756381307_3612788 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 42 photos in the portfolio 3015255 time of upload the photos Elapsed time : 11.435848474502563 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379854444, 1379854377, 1379854373, 1379854358, 1379854338, 1379854319, 1379854307] Looping around the photos to save general results len do output : 313 /1379868195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379868866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379870161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854444', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854377', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854373', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854358', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854338', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854319', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854307', None, None, None, None, None, '3623874') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 946 time used for this insertion : 0.18716049194335938 save_final save missing photos in datou_result : time spend for datou_step_exec : 472.86620569229126 time spend to save output : 0.19829368591308594 total time spend for step 6 : 473.06449937820435 step7:ventilate_hashtags_in_portfolio Thu Aug 28 13:42:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26292111 get user id for portfolio 26292111 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292111 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292111 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292111 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292111 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/26293305,26293306,26293307,26293308,26293309,26293314,26293316,26293317,26293318,26293319,26293320,26293321,26293323,26293324,26293325,26293326,26293327,26293328,26293329,26293330?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26292111 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379854444, 1379854377, 1379854373, 1379854358, 1379854338, 1379854319, 1379854307] Looping around the photos to save general results len do output : 1 /26292111. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854444', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854377', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854373', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854358', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854338', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854319', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854307', None, None, None, None, None, '3623874') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.042722225189208984 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.545631647109985 time spend to save output : 0.04318046569824219 total time spend for step 7 : 5.5888121128082275 step8:final Thu Aug 28 13:42:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379854444: ('0.5794230840386216',), 1379854377: ('0.5794230840386216',), 1379854373: ('0.5794230840386216',), 1379854358: ('0.5794230840386216',), 1379854338: ('0.5794230840386216',), 1379854319: ('0.5794230840386216',), 1379854307: ('0.5794230840386216',)} new output for save of step final : {1379854444: ('0.5794230840386216',), 1379854377: ('0.5794230840386216',), 1379854373: ('0.5794230840386216',), 1379854358: ('0.5794230840386216',), 1379854338: ('0.5794230840386216',), 1379854319: ('0.5794230840386216',), 1379854307: ('0.5794230840386216',)} [1379854444, 1379854377, 1379854373, 1379854358, 1379854338, 1379854319, 1379854307] Looping around the photos to save general results len do output : 7 /1379854444.Didn't retrieve data . /1379854377.Didn't retrieve data . /1379854373.Didn't retrieve data . /1379854358.Didn't retrieve data . /1379854338.Didn't retrieve data . /1379854319.Didn't retrieve data . /1379854307.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854444', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854377', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854373', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854358', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854338', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854319', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854307', None, None, None, None, None, '3623874') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.02194499969482422 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.146897554397583 time spend to save output : 0.05956554412841797 total time spend for step 8 : 0.20646309852600098 step9:velours_tree Thu Aug 28 13:42:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.645308256149292 time spend to save output : 4.315376281738281e-05 total time spend for step 9 : 1.6453514099121094 step10:send_mail_cod Thu Aug 28 13:42:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26292111_28-08-2025_13_42_12.pdf 26293278 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262932781756381332 26293279 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262932791756381334 26293280 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262932801756381336 26293281 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262932811756381338 26293282 change filename to text .change filename to text .change filename to text .imagette262932821756381338 26293283 imagette262932831756381339 26293284 imagette262932841756381339 26293285 imagette262932851756381339 26293286 imagette262932861756381339 26293287 imagette262932871756381339 26293288 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262932881756381339 26293289 imagette262932891756381342 26293290 imagette262932901756381342 26293291 imagette262932911756381342 26293292 imagette262932921756381342 26293293 imagette262932931756381342 26293294 imagette262932941756381342 26293295 change filename to text .imagette262932951756381342 26293296 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262932961756381342 26293298 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262932981756381343 26293299 imagette262932991756381345 26293300 imagette262933001756381345 26293301 imagette262933011756381345 26293302 imagette262933021756381345 26293303 imagette262933031756381345 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26292111 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26293305,26293306,26293307,26293308,26293309,26293314,26293316,26293317,26293318,26293319,26293320,26293321,26293323,26293324,26293325,26293326,26293327,26293328,26293329,26293330?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26292111 your option no_mail is active, we will not send the real mail to your client args[1379854444] : ((1379854444, 1352.292668227342, 2107751945), (1379854444, -0.29779817544372417, 496442774), '0.5794230840386216') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379854377] : ((1379854377, 1771.6325931047168, 2107751945), (1379854377, -0.37075443652612444, 496442774), '0.5794230840386216') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379854373] : ((1379854373, 1444.6398032489333, 2107751945), (1379854373, -0.2241775227965535, 496442774), '0.5794230840386216') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379854358] : ((1379854358, 1664.570733193859, 2107751945), (1379854358, -0.3623159350229521, 496442774), '0.5794230840386216') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379854338] : ((1379854338, 2679.349472083983, 492609224), (1379854338, -0.39180601120991954, 496442774), '0.5794230840386216') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379854319] : ((1379854319, 319.9119522043289, 492688767), (1379854319, -0.13743025217381777, 496442774), '0.5794230840386216') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379854307] : ((1379854307, 728.2036315768901, 492688767), (1379854307, -0.8034405058521432, 501862349), '0.5794230840386216') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.5794230840386216 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292111_28-08-2025_13_42_12.pdf results_Auto_P26292111_28-08-2025_13_42_12.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292111_28-08-2025_13_42_12.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','26292111','results_Auto_P26292111_28-08-2025_13_42_12.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292111_28-08-2025_13_42_12.pdf','pdf','','2.54','0.5794230840386216') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379854444, 1379854377, 1379854373, 1379854358, 1379854338, 1379854319, 1379854307] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854444', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854377', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854373', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854358', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854338', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854319', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854307', None, None, None, None, None, '3623874') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.0226595401763916 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.40366506576538 time spend to save output : 0.02296590805053711 total time spend for step 10 : 16.426630973815918 step11:split_time_score Thu Aug 28 13:42:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 2), ('20', 5)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28082025 26292111 Nombre de photos uploadées : 7 / 23040 (0%) 28082025 26292111 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 28082025 26292111 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 6.4373016357421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.7404556274414062e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.003889799118041992 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21018075942993164 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292108 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292109 order by id desc limit 1 Qualite : 0.3235829256287251 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292110_28-08-2025_13_18_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292110 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292110 AND mptpi.`type`=4855 To do Qualite : 0.5794230840386216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292111_28-08-2025_13_42_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292111 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292111 AND mptpi.`type`=4855 To do Qualite : 0.548860349869327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26292112_28-08-2025_13_04_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26292112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26292112 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28082025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379854444, 1379854377, 1379854373, 1379854358, 1379854338, 1379854319, 1379854307] Looping around the photos to save general results len do output : 1 /26292111Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854444', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854377', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854373', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854358', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854338', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854319', None, None, None, None, None, '3623874') ('4741', None, None, None, None, None, None, None, '3623874') ('4741', '26292111', '1379854307', None, None, None, None, None, '3623874') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.04566001892089844 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.8772618770599365 time spend to save output : 0.045874595642089844 total time spend for step 11 : 2.9231364727020264 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 789.85user 373.63system 21:10.13elapsed 91%CPU (0avgtext+0avgdata 8636444maxresident)k 2137944inputs+887376outputs (51865major+68138060minor)pagefaults 0swaps