python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4182899 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4741, datou_cur_ids : ['3646766'] with mtr_portfolio_ids : ['26290980'] and first list_photo_ids : [] new path : /proc/4182899/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : {} origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.8237659931182861 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Sep 1 16:01:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5309 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-01 16:01:32.879441: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-01 16:01:32.908597: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-01 16:01:32.910582: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f879c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-01 16:01:32.910603: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-01 16:01:32.913980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-01 16:01:33.059714: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3832b320 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-01 16:01:33.059754: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-01 16:01:33.060534: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-01 16:01:33.061812: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:01:33.066771: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:01:33.077727: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-01 16:01:33.079714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-01 16:01:33.101169: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-01 16:01:33.102655: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-01 16:01:33.131281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-01 16:01:33.132471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-01 16:01:33.132838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:01:33.133470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-01 16:01:33.133488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-01 16:01:33.133497: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-01 16:01:33.134856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4848 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-01 16:01:33.435367: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-01 16:01:33.435487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:01:33.435505: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:01:33.435520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-01 16:01:33.435535: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-01 16:01:33.435549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-01 16:01:33.435562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-01 16:01:33.435576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-01 16:01:33.436474: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-01 16:01:33.437679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-01 16:01:33.437711: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:01:33.437727: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:01:33.437740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-01 16:01:33.437766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-01 16:01:33.437780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-01 16:01:33.437794: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-01 16:01:33.437807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-01 16:01:33.438738: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-01 16:01:33.438780: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-01 16:01:33.438789: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-01 16:01:33.438796: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-01 16:01:33.439713: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4848 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-01 16:01:44.374667: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:01:44.560411: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.15859 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -92.31328 max: 136.27031 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 4183057 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5309 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10379 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.01633143424987793 nb_pixel_total : 420407 time to create 1 rle with new method : 0.02788686752319336 length of segment : 834 time for calcul the mask position with numpy : 0.0008542537689208984 nb_pixel_total : 54578 time to create 1 rle with old method : 0.06554722785949707 length of segment : 218 time for calcul the mask position with numpy : 0.0007281303405761719 nb_pixel_total : 39051 time to create 1 rle with old method : 0.04375195503234863 length of segment : 199 time for calcul the mask position with numpy : 0.000537872314453125 nb_pixel_total : 23779 time to create 1 rle with old method : 0.028869152069091797 length of segment : 196 time for calcul the mask position with numpy : 0.00045228004455566406 nb_pixel_total : 19060 time to create 1 rle with old method : 0.031319618225097656 length of segment : 156 time for calcul the mask position with numpy : 0.00028705596923828125 nb_pixel_total : 8889 time to create 1 rle with old method : 0.01511240005493164 length of segment : 144 time for calcul the mask position with numpy : 0.001405954360961914 nb_pixel_total : 41011 time to create 1 rle with old method : 0.047754764556884766 length of segment : 288 time for calcul the mask position with numpy : 0.002750396728515625 nb_pixel_total : 192307 time to create 1 rle with new method : 0.007260560989379883 length of segment : 595 time for calcul the mask position with numpy : 0.0007336139678955078 nb_pixel_total : 49223 time to create 1 rle with old method : 0.05605125427246094 length of segment : 318 time for calcul the mask position with numpy : 0.0006039142608642578 nb_pixel_total : 47886 time to create 1 rle with old method : 0.05441856384277344 length of segment : 296 time for calcul the mask position with numpy : 0.0004756450653076172 nb_pixel_total : 27295 time to create 1 rle with old method : 0.03043818473815918 length of segment : 268 time for calcul the mask position with numpy : 0.006871938705444336 nb_pixel_total : 400653 time to create 1 rle with new method : 0.03646516799926758 length of segment : 1052 time for calcul the mask position with numpy : 0.006392478942871094 nb_pixel_total : 339701 time to create 1 rle with new method : 0.01579141616821289 length of segment : 1422 time for calcul the mask position with numpy : 0.0009276866912841797 nb_pixel_total : 19645 time to create 1 rle with old method : 0.02218484878540039 length of segment : 304 time for calcul the mask position with numpy : 0.0017659664154052734 nb_pixel_total : 99227 time to create 1 rle with old method : 0.10973834991455078 length of segment : 614 time for calcul the mask position with numpy : 0.0024611949920654297 nb_pixel_total : 156433 time to create 1 rle with new method : 0.005902528762817383 length of segment : 485 time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 21505 time to create 1 rle with old method : 0.02467799186706543 length of segment : 150 time for calcul the mask position with numpy : 0.0002472400665283203 nb_pixel_total : 7664 time to create 1 rle with old method : 0.008971929550170898 length of segment : 141 time for calcul the mask position with numpy : 0.023967266082763672 nb_pixel_total : 1077174 time to create 1 rle with new method : 0.308002233505249 length of segment : 2027 time for calcul the mask position with numpy : 0.0005075931549072266 nb_pixel_total : 21441 time to create 1 rle with old method : 0.02355790138244629 length of segment : 163 time for calcul the mask position with numpy : 0.00045943260192871094 nb_pixel_total : 20872 time to create 1 rle with old method : 0.023171424865722656 length of segment : 183 time for calcul the mask position with numpy : 0.0039327144622802734 nb_pixel_total : 268687 time to create 1 rle with new method : 0.008366823196411133 length of segment : 444 time for calcul the mask position with numpy : 0.005515575408935547 nb_pixel_total : 328246 time to create 1 rle with new method : 0.015899658203125 length of segment : 643 time for calcul the mask position with numpy : 0.00017714500427246094 nb_pixel_total : 6084 time to create 1 rle with old method : 0.00819849967956543 length of segment : 49 time for calcul the mask position with numpy : 0.00040531158447265625 nb_pixel_total : 13909 time to create 1 rle with old method : 0.018312692642211914 length of segment : 166 time for calcul the mask position with numpy : 0.0018470287322998047 nb_pixel_total : 110934 time to create 1 rle with old method : 0.1341862678527832 length of segment : 533 time for calcul the mask position with numpy : 0.0013682842254638672 nb_pixel_total : 50960 time to create 1 rle with old method : 0.05649924278259277 length of segment : 216 time for calcul the mask position with numpy : 0.0003070831298828125 nb_pixel_total : 10711 time to create 1 rle with old method : 0.017264842987060547 length of segment : 173 time for calcul the mask position with numpy : 0.0014979839324951172 nb_pixel_total : 35075 time to create 1 rle with old method : 0.0403904914855957 length of segment : 231 time for calcul the mask position with numpy : 0.00096893310546875 nb_pixel_total : 56027 time to create 1 rle with old method : 0.06450200080871582 length of segment : 360 time for calcul the mask position with numpy : 0.0027921199798583984 nb_pixel_total : 138327 time to create 1 rle with old method : 0.16600584983825684 length of segment : 505 time for calcul the mask position with numpy : 0.0011494159698486328 nb_pixel_total : 35418 time to create 1 rle with old method : 0.0395505428314209 length of segment : 237 time for calcul the mask position with numpy : 0.0023403167724609375 nb_pixel_total : 24700 time to create 1 rle with old method : 0.028244733810424805 length of segment : 287 time for calcul the mask position with numpy : 0.0009930133819580078 nb_pixel_total : 32101 time to create 1 rle with old method : 0.03550076484680176 length of segment : 454 time for calcul the mask position with numpy : 0.0005457401275634766 nb_pixel_total : 24039 time to create 1 rle with old method : 0.02760934829711914 length of segment : 178 time for calcul the mask position with numpy : 0.0007987022399902344 nb_pixel_total : 22663 time to create 1 rle with old method : 0.025454998016357422 length of segment : 288 time for calcul the mask position with numpy : 0.0005500316619873047 nb_pixel_total : 14289 time to create 1 rle with old method : 0.01656341552734375 length of segment : 177 time for calcul the mask position with numpy : 0.011457443237304688 nb_pixel_total : 798391 time to create 1 rle with new method : 0.03813028335571289 length of segment : 734 time for calcul the mask position with numpy : 0.0009055137634277344 nb_pixel_total : 45729 time to create 1 rle with old method : 0.05291271209716797 length of segment : 423 time spent for convertir_results : 4.572508811950684 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 39 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 36.42157053947449 time spend to save output : 0.09458780288696289 total time spend for step 1 : 36.51615834236145 step2:mask_detect Mon Sep 1 16:02:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10379 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-01 16:02:08.742354: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-01 16:02:08.772727: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-01 16:02:08.774189: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f87a8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-01 16:02:08.774246: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-01 16:02:08.776882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-01 16:02:08.926868: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x39b968e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-01 16:02:08.926925: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-01 16:02:08.928251: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-01 16:02:08.928739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:02:08.931783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:02:08.934803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-01 16:02:08.935309: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-01 16:02:08.938268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-01 16:02:08.939262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-01 16:02:08.943431: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-01 16:02:08.944926: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-01 16:02:08.945018: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:02:08.945747: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-01 16:02:08.945762: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-01 16:02:08.945771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-01 16:02:08.947058: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9612 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-01 16:02:09.057976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-01 16:02:09.058056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:02:09.058075: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:02:09.058092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-01 16:02:09.058108: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-01 16:02:09.058124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-01 16:02:09.058139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-01 16:02:09.058156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-01 16:02:09.059488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-01 16:02:09.060592: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-01 16:02:09.060626: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:02:09.060643: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:02:09.060658: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-01 16:02:09.060673: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-01 16:02:09.060688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-01 16:02:09.060714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-01 16:02:09.060731: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-01 16:02:09.061997: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-01 16:02:09.062021: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-01 16:02:09.062029: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-01 16:02:09.062036: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-01 16:02:09.063273: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9612 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-01 16:02:18.577726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:02:18.771085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 80 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.15859 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 54 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 80 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -92.31328 max: 136.27031 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 4184155 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5088 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10377 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0019931793212890625 nb_pixel_total : 38205 time to create 1 rle with old method : 0.05347871780395508 length of segment : 363 time for calcul the mask position with numpy : 0.003445863723754883 nb_pixel_total : 113195 time to create 1 rle with old method : 0.13823938369750977 length of segment : 360 time for calcul the mask position with numpy : 0.0006322860717773438 nb_pixel_total : 21780 time to create 1 rle with old method : 0.025589942932128906 length of segment : 161 time for calcul the mask position with numpy : 0.004671812057495117 nb_pixel_total : 139030 time to create 1 rle with old method : 0.17131376266479492 length of segment : 421 time for calcul the mask position with numpy : 0.003693819046020508 nb_pixel_total : 135503 time to create 1 rle with old method : 0.1573622226715088 length of segment : 328 time for calcul the mask position with numpy : 0.020356416702270508 nb_pixel_total : 751555 time to create 1 rle with new method : 0.13358020782470703 length of segment : 1194 time for calcul the mask position with numpy : 0.011152982711791992 nb_pixel_total : 442992 time to create 1 rle with new method : 0.03623032569885254 length of segment : 887 time for calcul the mask position with numpy : 0.0007710456848144531 nb_pixel_total : 26448 time to create 1 rle with old method : 0.030504465103149414 length of segment : 213 time for calcul the mask position with numpy : 0.001314401626586914 nb_pixel_total : 56257 time to create 1 rle with old method : 0.07121467590332031 length of segment : 308 time for calcul the mask position with numpy : 0.002463102340698242 nb_pixel_total : 135693 time to create 1 rle with old method : 0.16686439514160156 length of segment : 364 time for calcul the mask position with numpy : 0.0004394054412841797 nb_pixel_total : 11474 time to create 1 rle with old method : 0.013684988021850586 length of segment : 200 time for calcul the mask position with numpy : 0.004733562469482422 nb_pixel_total : 176793 time to create 1 rle with new method : 0.01388239860534668 length of segment : 477 time for calcul the mask position with numpy : 0.0037059783935546875 nb_pixel_total : 99470 time to create 1 rle with old method : 0.11288738250732422 length of segment : 373 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 8994 time to create 1 rle with old method : 0.010532617568969727 length of segment : 168 time for calcul the mask position with numpy : 0.00218963623046875 nb_pixel_total : 133843 time to create 1 rle with old method : 0.16426444053649902 length of segment : 309 time for calcul the mask position with numpy : 0.0007586479187011719 nb_pixel_total : 38654 time to create 1 rle with old method : 0.04675555229187012 length of segment : 186 time for calcul the mask position with numpy : 0.001455545425415039 nb_pixel_total : 45514 time to create 1 rle with old method : 0.05347299575805664 length of segment : 376 time for calcul the mask position with numpy : 0.0008549690246582031 nb_pixel_total : 31283 time to create 1 rle with old method : 0.0357515811920166 length of segment : 249 time for calcul the mask position with numpy : 0.0013544559478759766 nb_pixel_total : 49628 time to create 1 rle with old method : 0.056826114654541016 length of segment : 350 time for calcul the mask position with numpy : 0.0028142929077148438 nb_pixel_total : 123005 time to create 1 rle with old method : 0.1772785186767578 length of segment : 285 time for calcul the mask position with numpy : 0.0041141510009765625 nb_pixel_total : 168904 time to create 1 rle with new method : 0.010016441345214844 length of segment : 703 time for calcul the mask position with numpy : 0.0005483627319335938 nb_pixel_total : 19047 time to create 1 rle with old method : 0.021921873092651367 length of segment : 207 time for calcul the mask position with numpy : 0.0004901885986328125 nb_pixel_total : 13249 time to create 1 rle with old method : 0.01553201675415039 length of segment : 159 time for calcul the mask position with numpy : 0.0007364749908447266 nb_pixel_total : 21330 time to create 1 rle with old method : 0.024888038635253906 length of segment : 213 time for calcul the mask position with numpy : 0.0003948211669921875 nb_pixel_total : 14020 time to create 1 rle with old method : 0.0164642333984375 length of segment : 178 time for calcul the mask position with numpy : 0.010381698608398438 nb_pixel_total : 247996 time to create 1 rle with new method : 0.20246243476867676 length of segment : 1311 time for calcul the mask position with numpy : 0.0004076957702636719 nb_pixel_total : 11386 time to create 1 rle with old method : 0.01310586929321289 length of segment : 161 time for calcul the mask position with numpy : 0.001897573471069336 nb_pixel_total : 101496 time to create 1 rle with old method : 0.10948538780212402 length of segment : 402 time for calcul the mask position with numpy : 0.0009407997131347656 nb_pixel_total : 8905 time to create 1 rle with old method : 0.010332584381103516 length of segment : 445 time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 14494 time to create 1 rle with old method : 0.01629781723022461 length of segment : 205 time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 27507 time to create 1 rle with old method : 0.030864238739013672 length of segment : 403 time for calcul the mask position with numpy : 0.0018551349639892578 nb_pixel_total : 90540 time to create 1 rle with old method : 0.0979909896850586 length of segment : 372 time for calcul the mask position with numpy : 0.004311084747314453 nb_pixel_total : 182736 time to create 1 rle with new method : 0.013550758361816406 length of segment : 705 time for calcul the mask position with numpy : 0.009235382080078125 nb_pixel_total : 415003 time to create 1 rle with new method : 0.039517879486083984 length of segment : 922 time for calcul the mask position with numpy : 0.0007102489471435547 nb_pixel_total : 21162 time to create 1 rle with old method : 0.024423599243164062 length of segment : 214 time for calcul the mask position with numpy : 0.0008933544158935547 nb_pixel_total : 34286 time to create 1 rle with old method : 0.04191088676452637 length of segment : 415 time for calcul the mask position with numpy : 0.002640247344970703 nb_pixel_total : 126128 time to create 1 rle with old method : 0.14163589477539062 length of segment : 462 time for calcul the mask position with numpy : 0.00040984153747558594 nb_pixel_total : 10573 time to create 1 rle with old method : 0.01259613037109375 length of segment : 191 time for calcul the mask position with numpy : 0.0013339519500732422 nb_pixel_total : 55269 time to create 1 rle with old method : 0.06371235847473145 length of segment : 234 time for calcul the mask position with numpy : 0.002744436264038086 nb_pixel_total : 102615 time to create 1 rle with old method : 0.1358022689819336 length of segment : 365 time for calcul the mask position with numpy : 0.0002734661102294922 nb_pixel_total : 7040 time to create 1 rle with old method : 0.008469104766845703 length of segment : 85 time for calcul the mask position with numpy : 0.006578207015991211 nb_pixel_total : 337694 time to create 1 rle with new method : 0.01815319061279297 length of segment : 610 time for calcul the mask position with numpy : 0.0077114105224609375 nb_pixel_total : 245791 time to create 1 rle with new method : 0.023245573043823242 length of segment : 755 time for calcul the mask position with numpy : 0.008168697357177734 nb_pixel_total : 301673 time to create 1 rle with new method : 0.021604061126708984 length of segment : 535 time for calcul the mask position with numpy : 0.0003521442413330078 nb_pixel_total : 7648 time to create 1 rle with old method : 0.009061098098754883 length of segment : 154 time for calcul the mask position with numpy : 0.0005309581756591797 nb_pixel_total : 22971 time to create 1 rle with old method : 0.026822328567504883 length of segment : 179 time for calcul the mask position with numpy : 0.003185272216796875 nb_pixel_total : 159914 time to create 1 rle with new method : 0.010274410247802734 length of segment : 512 time for calcul the mask position with numpy : 0.004683256149291992 nb_pixel_total : 165802 time to create 1 rle with new method : 0.015304088592529297 length of segment : 1189 time for calcul the mask position with numpy : 0.0013604164123535156 nb_pixel_total : 42799 time to create 1 rle with old method : 0.04987692832946777 length of segment : 259 time for calcul the mask position with numpy : 0.002590656280517578 nb_pixel_total : 134093 time to create 1 rle with old method : 0.16009211540222168 length of segment : 407 time for calcul the mask position with numpy : 0.0010366439819335938 nb_pixel_total : 32286 time to create 1 rle with old method : 0.03683209419250488 length of segment : 247 time for calcul the mask position with numpy : 0.0032596588134765625 nb_pixel_total : 104114 time to create 1 rle with old method : 0.11813521385192871 length of segment : 276 time for calcul the mask position with numpy : 0.020014524459838867 nb_pixel_total : 563908 time to create 1 rle with new method : 0.22376418113708496 length of segment : 1231 time for calcul the mask position with numpy : 0.001232147216796875 nb_pixel_total : 53404 time to create 1 rle with old method : 0.06720829010009766 length of segment : 244 time for calcul the mask position with numpy : 0.010673999786376953 nb_pixel_total : 534457 time to create 1 rle with new method : 0.20985174179077148 length of segment : 905 time for calcul the mask position with numpy : 0.0008618831634521484 nb_pixel_total : 30770 time to create 1 rle with old method : 0.03589272499084473 length of segment : 318 time for calcul the mask position with numpy : 0.0003871917724609375 nb_pixel_total : 9861 time to create 1 rle with old method : 0.01172637939453125 length of segment : 139 time for calcul the mask position with numpy : 0.003387928009033203 nb_pixel_total : 157509 time to create 1 rle with new method : 0.009891748428344727 length of segment : 563 time for calcul the mask position with numpy : 0.0009369850158691406 nb_pixel_total : 27157 time to create 1 rle with old method : 0.031044721603393555 length of segment : 287 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 16046 time to create 1 rle with old method : 0.01921391487121582 length of segment : 83 time for calcul the mask position with numpy : 0.0015139579772949219 nb_pixel_total : 55417 time to create 1 rle with old method : 0.06452631950378418 length of segment : 515 time for calcul the mask position with numpy : 0.004305124282836914 nb_pixel_total : 192553 time to create 1 rle with new method : 0.013389110565185547 length of segment : 678 time for calcul the mask position with numpy : 0.0012633800506591797 nb_pixel_total : 20707 time to create 1 rle with old method : 0.02389812469482422 length of segment : 403 time for calcul the mask position with numpy : 0.0006589889526367188 nb_pixel_total : 25715 time to create 1 rle with old method : 0.029267072677612305 length of segment : 204 time for calcul the mask position with numpy : 0.0012667179107666016 nb_pixel_total : 57294 time to create 1 rle with old method : 0.0669715404510498 length of segment : 359 time for calcul the mask position with numpy : 0.023790597915649414 nb_pixel_total : 839632 time to create 1 rle with new method : 0.2989025115966797 length of segment : 1100 time for calcul the mask position with numpy : 0.0009250640869140625 nb_pixel_total : 25904 time to create 1 rle with old method : 0.03095841407775879 length of segment : 116 time for calcul the mask position with numpy : 0.0021698474884033203 nb_pixel_total : 4017 time to create 1 rle with old method : 0.005589008331298828 length of segment : 92 time for calcul the mask position with numpy : 0.0007069110870361328 nb_pixel_total : 5281 time to create 1 rle with old method : 0.0064241886138916016 length of segment : 155 time for calcul the mask position with numpy : 0.001455545425415039 nb_pixel_total : 59853 time to create 1 rle with old method : 0.07108473777770996 length of segment : 256 time for calcul the mask position with numpy : 0.007983207702636719 nb_pixel_total : 228718 time to create 1 rle with new method : 0.02526545524597168 length of segment : 1063 time for calcul the mask position with numpy : 0.0044515132904052734 nb_pixel_total : 133184 time to create 1 rle with old method : 0.1519458293914795 length of segment : 555 time for calcul the mask position with numpy : 0.0014202594757080078 nb_pixel_total : 47664 time to create 1 rle with old method : 0.05494189262390137 length of segment : 382 time for calcul the mask position with numpy : 0.00033736228942871094 nb_pixel_total : 12646 time to create 1 rle with old method : 0.014869451522827148 length of segment : 177 time for calcul the mask position with numpy : 0.0014758110046386719 nb_pixel_total : 45104 time to create 1 rle with old method : 0.05127096176147461 length of segment : 326 time for calcul the mask position with numpy : 0.003119230270385742 nb_pixel_total : 111974 time to create 1 rle with old method : 0.12766313552856445 length of segment : 317 time for calcul the mask position with numpy : 0.0073277950286865234 nb_pixel_total : 246447 time to create 1 rle with new method : 0.022657155990600586 length of segment : 679 time for calcul the mask position with numpy : 0.0013554096221923828 nb_pixel_total : 53064 time to create 1 rle with old method : 0.06067681312561035 length of segment : 380 time for calcul the mask position with numpy : 0.0008780956268310547 nb_pixel_total : 34670 time to create 1 rle with old method : 0.03995060920715332 length of segment : 279 time for calcul the mask position with numpy : 0.0008206367492675781 nb_pixel_total : 30116 time to create 1 rle with old method : 0.03479361534118652 length of segment : 130 time for calcul the mask position with numpy : 0.007325172424316406 nb_pixel_total : 359167 time to create 1 rle with new method : 0.017972946166992188 length of segment : 1602 time for calcul the mask position with numpy : 0.0005908012390136719 nb_pixel_total : 31250 time to create 1 rle with old method : 0.035445213317871094 length of segment : 307 time for calcul the mask position with numpy : 0.00030803680419921875 nb_pixel_total : 11117 time to create 1 rle with old method : 0.013323545455932617 length of segment : 132 time for calcul the mask position with numpy : 0.0003616809844970703 nb_pixel_total : 8964 time to create 1 rle with old method : 0.010363578796386719 length of segment : 146 time for calcul the mask position with numpy : 0.001455068588256836 nb_pixel_total : 79006 time to create 1 rle with old method : 0.0888669490814209 length of segment : 272 time for calcul the mask position with numpy : 0.011469125747680664 nb_pixel_total : 648488 time to create 1 rle with new method : 0.03737378120422363 length of segment : 958 time for calcul the mask position with numpy : 0.00407862663269043 nb_pixel_total : 216594 time to create 1 rle with new method : 0.012871742248535156 length of segment : 659 time for calcul the mask position with numpy : 0.0030994415283203125 nb_pixel_total : 144378 time to create 1 rle with old method : 0.16066503524780273 length of segment : 813 time for calcul the mask position with numpy : 0.0013320446014404297 nb_pixel_total : 64854 time to create 1 rle with old method : 0.07477974891662598 length of segment : 175 time for calcul the mask position with numpy : 0.01856088638305664 nb_pixel_total : 1023619 time to create 1 rle with new method : 0.07968616485595703 length of segment : 1779 time for calcul the mask position with numpy : 0.0016913414001464844 nb_pixel_total : 55418 time to create 1 rle with old method : 0.06330490112304688 length of segment : 342 time for calcul the mask position with numpy : 0.00045990943908691406 nb_pixel_total : 20619 time to create 1 rle with old method : 0.02422809600830078 length of segment : 166 time for calcul the mask position with numpy : 0.001489400863647461 nb_pixel_total : 73992 time to create 1 rle with old method : 0.08770442008972168 length of segment : 330 time for calcul the mask position with numpy : 0.0009400844573974609 nb_pixel_total : 28586 time to create 1 rle with old method : 0.03261399269104004 length of segment : 270 time for calcul the mask position with numpy : 0.0003521442413330078 nb_pixel_total : 9773 time to create 1 rle with old method : 0.011705636978149414 length of segment : 103 time for calcul the mask position with numpy : 0.004500865936279297 nb_pixel_total : 186796 time to create 1 rle with new method : 0.013643026351928711 length of segment : 764 time for calcul the mask position with numpy : 0.012421131134033203 nb_pixel_total : 590411 time to create 1 rle with new method : 0.06109476089477539 length of segment : 970 time for calcul the mask position with numpy : 0.0011887550354003906 nb_pixel_total : 51254 time to create 1 rle with old method : 0.05718421936035156 length of segment : 378 time for calcul the mask position with numpy : 0.0007548332214355469 nb_pixel_total : 20900 time to create 1 rle with old method : 0.023989200592041016 length of segment : 311 time for calcul the mask position with numpy : 0.0040929317474365234 nb_pixel_total : 216577 time to create 1 rle with new method : 0.011570930480957031 length of segment : 477 time for calcul the mask position with numpy : 0.0022630691528320312 nb_pixel_total : 115835 time to create 1 rle with old method : 0.13590097427368164 length of segment : 515 time for calcul the mask position with numpy : 0.001184225082397461 nb_pixel_total : 48060 time to create 1 rle with old method : 0.05571103096008301 length of segment : 275 time for calcul the mask position with numpy : 0.003261089324951172 nb_pixel_total : 149525 time to create 1 rle with old method : 0.17031526565551758 length of segment : 380 time for calcul the mask position with numpy : 0.0012178421020507812 nb_pixel_total : 47734 time to create 1 rle with old method : 0.05664563179016113 length of segment : 306 time for calcul the mask position with numpy : 0.00030303001403808594 nb_pixel_total : 6613 time to create 1 rle with old method : 0.007758617401123047 length of segment : 238 time for calcul the mask position with numpy : 0.0036478042602539062 nb_pixel_total : 185838 time to create 1 rle with new method : 0.009654521942138672 length of segment : 694 time for calcul the mask position with numpy : 0.025618791580200195 nb_pixel_total : 1042515 time to create 1 rle with new method : 0.1114349365234375 length of segment : 2406 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 14994 time to create 1 rle with old method : 0.020151376724243164 length of segment : 131 time for calcul the mask position with numpy : 0.003897428512573242 nb_pixel_total : 239134 time to create 1 rle with new method : 0.010739564895629883 length of segment : 659 time for calcul the mask position with numpy : 0.011307239532470703 nb_pixel_total : 539642 time to create 1 rle with new method : 0.0777578353881836 length of segment : 871 time for calcul the mask position with numpy : 0.015238285064697266 nb_pixel_total : 631856 time to create 1 rle with new method : 0.058927059173583984 length of segment : 1481 time for calcul the mask position with numpy : 0.0025680065155029297 nb_pixel_total : 91734 time to create 1 rle with old method : 0.10503697395324707 length of segment : 368 time for calcul the mask position with numpy : 0.007642984390258789 nb_pixel_total : 300523 time to create 1 rle with new method : 0.15077614784240723 length of segment : 1144 time for calcul the mask position with numpy : 0.0005848407745361328 nb_pixel_total : 14753 time to create 1 rle with old method : 0.023893117904663086 length of segment : 294 time for calcul the mask position with numpy : 0.009024858474731445 nb_pixel_total : 526084 time to create 1 rle with new method : 0.03250265121459961 length of segment : 827 time for calcul the mask position with numpy : 0.0003008842468261719 nb_pixel_total : 9587 time to create 1 rle with old method : 0.011368274688720703 length of segment : 141 time for calcul the mask position with numpy : 0.0024728775024414062 nb_pixel_total : 106753 time to create 1 rle with old method : 0.12608027458190918 length of segment : 590 time for calcul the mask position with numpy : 0.00025463104248046875 nb_pixel_total : 6925 time to create 1 rle with old method : 0.008158445358276367 length of segment : 185 time for calcul the mask position with numpy : 0.002130270004272461 nb_pixel_total : 128218 time to create 1 rle with old method : 0.14903855323791504 length of segment : 376 time for calcul the mask position with numpy : 0.002511262893676758 nb_pixel_total : 114561 time to create 1 rle with old method : 0.13176798820495605 length of segment : 502 time for calcul the mask position with numpy : 0.0014090538024902344 nb_pixel_total : 74619 time to create 1 rle with old method : 0.09037137031555176 length of segment : 328 time for calcul the mask position with numpy : 0.0016546249389648438 nb_pixel_total : 70226 time to create 1 rle with old method : 0.08020234107971191 length of segment : 335 time for calcul the mask position with numpy : 0.0018839836120605469 nb_pixel_total : 61789 time to create 1 rle with old method : 0.07096362113952637 length of segment : 402 time for calcul the mask position with numpy : 0.004967212677001953 nb_pixel_total : 190016 time to create 1 rle with new method : 0.01503610610961914 length of segment : 691 time for calcul the mask position with numpy : 0.0007302761077880859 nb_pixel_total : 27747 time to create 1 rle with old method : 0.032033681869506836 length of segment : 175 time for calcul the mask position with numpy : 0.003856182098388672 nb_pixel_total : 230961 time to create 1 rle with new method : 0.01064610481262207 length of segment : 651 time for calcul the mask position with numpy : 0.001676797866821289 nb_pixel_total : 112555 time to create 1 rle with old method : 0.1279764175415039 length of segment : 371 time for calcul the mask position with numpy : 0.0028371810913085938 nb_pixel_total : 84075 time to create 1 rle with old method : 0.09944391250610352 length of segment : 391 time for calcul the mask position with numpy : 0.0012903213500976562 nb_pixel_total : 32016 time to create 1 rle with old method : 0.04181170463562012 length of segment : 187 time for calcul the mask position with numpy : 0.02344799041748047 nb_pixel_total : 1015911 time to create 1 rle with new method : 0.12681937217712402 length of segment : 1222 time for calcul the mask position with numpy : 0.0015571117401123047 nb_pixel_total : 80767 time to create 1 rle with old method : 0.09237194061279297 length of segment : 403 time for calcul the mask position with numpy : 0.0007369518280029297 nb_pixel_total : 35162 time to create 1 rle with old method : 0.04067873954772949 length of segment : 165 time for calcul the mask position with numpy : 0.01250600814819336 nb_pixel_total : 644183 time to create 1 rle with new method : 0.0860433578491211 length of segment : 850 time for calcul the mask position with numpy : 0.0015616416931152344 nb_pixel_total : 56608 time to create 1 rle with old method : 0.06451678276062012 length of segment : 389 time for calcul the mask position with numpy : 0.001119375228881836 nb_pixel_total : 26297 time to create 1 rle with old method : 0.030445337295532227 length of segment : 463 time for calcul the mask position with numpy : 0.0038537979125976562 nb_pixel_total : 98147 time to create 1 rle with old method : 0.11294746398925781 length of segment : 267 time for calcul the mask position with numpy : 0.0007789134979248047 nb_pixel_total : 20372 time to create 1 rle with old method : 0.025568246841430664 length of segment : 198 time for calcul the mask position with numpy : 0.0029184818267822266 nb_pixel_total : 107814 time to create 1 rle with old method : 0.12316703796386719 length of segment : 517 time for calcul the mask position with numpy : 0.00495457649230957 nb_pixel_total : 249568 time to create 1 rle with new method : 0.013947486877441406 length of segment : 881 time for calcul the mask position with numpy : 0.0012123584747314453 nb_pixel_total : 28776 time to create 1 rle with old method : 0.032408952713012695 length of segment : 491 time for calcul the mask position with numpy : 0.0014405250549316406 nb_pixel_total : 64867 time to create 1 rle with old method : 0.06957817077636719 length of segment : 310 time for calcul the mask position with numpy : 0.0011844635009765625 nb_pixel_total : 37690 time to create 1 rle with old method : 0.04289722442626953 length of segment : 294 time for calcul the mask position with numpy : 0.002165079116821289 nb_pixel_total : 103270 time to create 1 rle with old method : 0.1189272403717041 length of segment : 334 time for calcul the mask position with numpy : 0.0007121562957763672 nb_pixel_total : 24269 time to create 1 rle with old method : 0.028026580810546875 length of segment : 248 time for calcul the mask position with numpy : 0.004045248031616211 nb_pixel_total : 128277 time to create 1 rle with old method : 0.15543866157531738 length of segment : 544 time for calcul the mask position with numpy : 0.0030286312103271484 nb_pixel_total : 165594 time to create 1 rle with new method : 0.007653951644897461 length of segment : 538 time for calcul the mask position with numpy : 0.012476921081542969 nb_pixel_total : 606378 time to create 1 rle with new method : 0.10402822494506836 length of segment : 1249 time for calcul the mask position with numpy : 0.004780292510986328 nb_pixel_total : 167015 time to create 1 rle with new method : 0.017307043075561523 length of segment : 719 time for calcul the mask position with numpy : 0.0010569095611572266 nb_pixel_total : 36542 time to create 1 rle with old method : 0.04087090492248535 length of segment : 220 time for calcul the mask position with numpy : 0.0050351619720458984 nb_pixel_total : 240274 time to create 1 rle with new method : 0.016370058059692383 length of segment : 509 time for calcul the mask position with numpy : 0.00693202018737793 nb_pixel_total : 336035 time to create 1 rle with new method : 0.07910633087158203 length of segment : 523 time for calcul the mask position with numpy : 0.0005214214324951172 nb_pixel_total : 17189 time to create 1 rle with old method : 0.02051687240600586 length of segment : 149 time for calcul the mask position with numpy : 0.0010285377502441406 nb_pixel_total : 30994 time to create 1 rle with old method : 0.0356450080871582 length of segment : 248 time for calcul the mask position with numpy : 0.0019066333770751953 nb_pixel_total : 72542 time to create 1 rle with old method : 0.0819096565246582 length of segment : 261 time for calcul the mask position with numpy : 0.004030942916870117 nb_pixel_total : 82364 time to create 1 rle with old method : 0.18351268768310547 length of segment : 369 time for calcul the mask position with numpy : 0.022966623306274414 nb_pixel_total : 701500 time to create 1 rle with new method : 0.22787213325500488 length of segment : 1139 time for calcul the mask position with numpy : 0.0005927085876464844 nb_pixel_total : 10876 time to create 1 rle with old method : 0.013722658157348633 length of segment : 196 time for calcul the mask position with numpy : 0.00395512580871582 nb_pixel_total : 185247 time to create 1 rle with new method : 0.01136636734008789 length of segment : 871 time for calcul the mask position with numpy : 0.0009038448333740234 nb_pixel_total : 23609 time to create 1 rle with old method : 0.02687549591064453 length of segment : 296 time for calcul the mask position with numpy : 0.0013949871063232422 nb_pixel_total : 49588 time to create 1 rle with old method : 0.05745244026184082 length of segment : 282 time for calcul the mask position with numpy : 0.0002779960632324219 nb_pixel_total : 9520 time to create 1 rle with old method : 0.011296510696411133 length of segment : 146 time for calcul the mask position with numpy : 0.0013248920440673828 nb_pixel_total : 15026 time to create 1 rle with old method : 0.01773810386657715 length of segment : 187 time for calcul the mask position with numpy : 0.0007836818695068359 nb_pixel_total : 18125 time to create 1 rle with old method : 0.029794931411743164 length of segment : 144 time for calcul the mask position with numpy : 0.0026061534881591797 nb_pixel_total : 81089 time to create 1 rle with old method : 0.09249186515808105 length of segment : 446 time for calcul the mask position with numpy : 0.0008399486541748047 nb_pixel_total : 31437 time to create 1 rle with old method : 0.03564095497131348 length of segment : 181 time for calcul the mask position with numpy : 0.02950596809387207 nb_pixel_total : 397014 time to create 1 rle with new method : 0.14487648010253906 length of segment : 1237 time for calcul the mask position with numpy : 0.0005702972412109375 nb_pixel_total : 19648 time to create 1 rle with old method : 0.022942066192626953 length of segment : 132 time for calcul the mask position with numpy : 0.015636920928955078 nb_pixel_total : 566188 time to create 1 rle with new method : 0.06385064125061035 length of segment : 1639 time for calcul the mask position with numpy : 0.005783796310424805 nb_pixel_total : 183332 time to create 1 rle with new method : 0.02094125747680664 length of segment : 702 time for calcul the mask position with numpy : 0.007029294967651367 nb_pixel_total : 332038 time to create 1 rle with new method : 0.02521204948425293 length of segment : 683 time for calcul the mask position with numpy : 0.005429267883300781 nb_pixel_total : 155384 time to create 1 rle with new method : 0.01556086540222168 length of segment : 314 time for calcul the mask position with numpy : 0.0009360313415527344 nb_pixel_total : 32639 time to create 1 rle with old method : 0.0374143123626709 length of segment : 246 time for calcul the mask position with numpy : 0.00042748451232910156 nb_pixel_total : 14320 time to create 1 rle with old method : 0.0169675350189209 length of segment : 89 time for calcul the mask position with numpy : 0.002357959747314453 nb_pixel_total : 109377 time to create 1 rle with old method : 0.12636971473693848 length of segment : 406 time for calcul the mask position with numpy : 0.005384922027587891 nb_pixel_total : 81297 time to create 1 rle with old method : 0.1075592041015625 length of segment : 560 time for calcul the mask position with numpy : 0.0006160736083984375 nb_pixel_total : 22498 time to create 1 rle with old method : 0.0254209041595459 length of segment : 221 time for calcul the mask position with numpy : 0.0007359981536865234 nb_pixel_total : 29220 time to create 1 rle with old method : 0.03365015983581543 length of segment : 174 time for calcul the mask position with numpy : 0.002640247344970703 nb_pixel_total : 79726 time to create 1 rle with old method : 0.09238219261169434 length of segment : 319 time for calcul the mask position with numpy : 0.0022580623626708984 nb_pixel_total : 82696 time to create 1 rle with old method : 0.09046459197998047 length of segment : 403 time for calcul the mask position with numpy : 0.006737947463989258 nb_pixel_total : 126307 time to create 1 rle with old method : 0.14201116561889648 length of segment : 288 time for calcul the mask position with numpy : 0.001333475112915039 nb_pixel_total : 35289 time to create 1 rle with old method : 0.040284156799316406 length of segment : 288 time for calcul the mask position with numpy : 0.013459444046020508 nb_pixel_total : 425854 time to create 1 rle with new method : 0.03635525703430176 length of segment : 913 time for calcul the mask position with numpy : 0.004128694534301758 nb_pixel_total : 218419 time to create 1 rle with new method : 0.012135982513427734 length of segment : 613 time for calcul the mask position with numpy : 0.0012097358703613281 nb_pixel_total : 13448 time to create 1 rle with old method : 0.032464027404785156 length of segment : 120 time for calcul the mask position with numpy : 0.002557039260864258 nb_pixel_total : 104824 time to create 1 rle with old method : 0.11699652671813965 length of segment : 622 time for calcul the mask position with numpy : 0.00448298454284668 nb_pixel_total : 223988 time to create 1 rle with new method : 0.011907339096069336 length of segment : 592 time for calcul the mask position with numpy : 0.0012900829315185547 nb_pixel_total : 53518 time to create 1 rle with old method : 0.06430816650390625 length of segment : 309 time for calcul the mask position with numpy : 0.0007512569427490234 nb_pixel_total : 10893 time to create 1 rle with old method : 0.012430191040039062 length of segment : 134 time for calcul the mask position with numpy : 0.0030388832092285156 nb_pixel_total : 121626 time to create 1 rle with old method : 0.13804912567138672 length of segment : 276 time for calcul the mask position with numpy : 0.0050792694091796875 nb_pixel_total : 168794 time to create 1 rle with new method : 0.015819787979125977 length of segment : 715 time for calcul the mask position with numpy : 0.0021772384643554688 nb_pixel_total : 78339 time to create 1 rle with old method : 0.08966875076293945 length of segment : 342 time for calcul the mask position with numpy : 0.0023834705352783203 nb_pixel_total : 23789 time to create 1 rle with old method : 0.029006481170654297 length of segment : 336 time for calcul the mask position with numpy : 0.0013301372528076172 nb_pixel_total : 46886 time to create 1 rle with old method : 0.05350184440612793 length of segment : 299 time for calcul the mask position with numpy : 0.006968498229980469 nb_pixel_total : 333506 time to create 1 rle with new method : 0.035736799240112305 length of segment : 670 time for calcul the mask position with numpy : 0.0007181167602539062 nb_pixel_total : 38938 time to create 1 rle with old method : 0.05432248115539551 length of segment : 122 time for calcul the mask position with numpy : 0.0016705989837646484 nb_pixel_total : 75348 time to create 1 rle with old method : 0.10941958427429199 length of segment : 358 time for calcul the mask position with numpy : 0.0013432502746582031 nb_pixel_total : 27184 time to create 1 rle with old method : 0.030564546585083008 length of segment : 216 time for calcul the mask position with numpy : 0.0007009506225585938 nb_pixel_total : 33175 time to create 1 rle with old method : 0.0369260311126709 length of segment : 253 time for calcul the mask position with numpy : 0.004320383071899414 nb_pixel_total : 65732 time to create 1 rle with old method : 0.07549643516540527 length of segment : 388 time for calcul the mask position with numpy : 0.0015597343444824219 nb_pixel_total : 50007 time to create 1 rle with old method : 0.05533027648925781 length of segment : 228 time for calcul the mask position with numpy : 0.0038275718688964844 nb_pixel_total : 151831 time to create 1 rle with new method : 0.012591361999511719 length of segment : 774 time for calcul the mask position with numpy : 0.021233320236206055 nb_pixel_total : 642773 time to create 1 rle with new method : 0.39000511169433594 length of segment : 2502 time for calcul the mask position with numpy : 0.0009405612945556641 nb_pixel_total : 40636 time to create 1 rle with old method : 0.046468496322631836 length of segment : 246 time for calcul the mask position with numpy : 0.009758710861206055 nb_pixel_total : 448376 time to create 1 rle with new method : 0.06346654891967773 length of segment : 918 time for calcul the mask position with numpy : 0.0021209716796875 nb_pixel_total : 86716 time to create 1 rle with old method : 0.1096799373626709 length of segment : 332 time for calcul the mask position with numpy : 0.015554189682006836 nb_pixel_total : 455412 time to create 1 rle with new method : 0.09085583686828613 length of segment : 1484 time for calcul the mask position with numpy : 0.0004596710205078125 nb_pixel_total : 18253 time to create 1 rle with old method : 0.02074408531188965 length of segment : 164 time for calcul the mask position with numpy : 0.002235889434814453 nb_pixel_total : 32812 time to create 1 rle with old method : 0.03900027275085449 length of segment : 244 time for calcul the mask position with numpy : 0.0005090236663818359 nb_pixel_total : 3222 time to create 1 rle with old method : 0.0048980712890625 length of segment : 151 time for calcul the mask position with numpy : 0.0005736351013183594 nb_pixel_total : 22199 time to create 1 rle with old method : 0.02511000633239746 length of segment : 209 time for calcul the mask position with numpy : 0.00047850608825683594 nb_pixel_total : 23489 time to create 1 rle with old method : 0.027202606201171875 length of segment : 144 time for calcul the mask position with numpy : 0.004111766815185547 nb_pixel_total : 226175 time to create 1 rle with new method : 0.012928247451782227 length of segment : 791 time for calcul the mask position with numpy : 0.0006647109985351562 nb_pixel_total : 35809 time to create 1 rle with old method : 0.03977823257446289 length of segment : 234 time for calcul the mask position with numpy : 0.0010561943054199219 nb_pixel_total : 49502 time to create 1 rle with old method : 0.05507922172546387 length of segment : 226 time for calcul the mask position with numpy : 0.7388670444488525 nb_pixel_total : 7112873 time to create 1 rle with new method : 0.9121582508087158 length of segment : 2753 time for calcul the mask position with numpy : 0.013907909393310547 nb_pixel_total : 955929 time to create 1 rle with new method : 0.0513453483581543 length of segment : 722 time spent for convertir_results : 36.16939735412598 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 255 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 92.79000568389893 time spend to save output : 0.33504819869995117 total time spend for step 2 : 93.12505388259888 step3:blur_detection Mon Sep 1 16:03:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (3120, 3120) 694.8644463648399 (3120, 3120) 276.5889822210875 (3120, 3120) 894.1056424982089 (3120, 3120) 132.6910973724649 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.014191627502441406 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.013324260711669922 save missing photos in datou_result : time spend for datou_step_exec : 0.5096325874328613 time spend to save output : 0.03157854080200195 total time spend for step 3 : 0.5412111282348633 step4:brightness Mon Sep 1 16:03:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756735288_4182899_1379844790_00daaf16a68ae1f75d3d06661d4f5056.jpg treat image : temp/1756735288_4182899_1379844776_e66e15b667584bbf2dda568591cdbba4.jpg treat image : temp/1756735288_4182899_1379844764_6116713e073f0320d3135deb2e918013.jpg treat image : temp/1756735288_4182899_1379844735_fcd55e31fc20a46c4f433a5fe8a323c1.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.011079549789428711 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.011067390441894531 save missing photos in datou_result : time spend for datou_step_exec : 4.172842025756836 time spend to save output : 0.02716517448425293 total time spend for step 4 : 4.200007200241089 step5:rle_unique_nms_with_priority Mon Sep 1 16:03:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 255 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 89 nb_hashtags : 11 time to prepare the origin masks : 44.291507720947266 time for calcul the mask position with numpy : 0.08444023132324219 nb_pixel_total : 2606405 time to create 1 rle with new method : 0.5874745845794678 time for calcul the mask position with numpy : 0.049306392669677734 nb_pixel_total : 112975 time to create 1 rle with old method : 0.14374828338623047 time for calcul the mask position with numpy : 0.04883003234863281 nb_pixel_total : 532459 time to create 1 rle with new method : 0.6648755073547363 time for calcul the mask position with numpy : 0.04325127601623535 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007596015930175781 time for calcul the mask position with numpy : 0.0475921630859375 nb_pixel_total : 414292 time to create 1 rle with new method : 0.6790649890899658 time for calcul the mask position with numpy : 0.044199228286743164 nb_pixel_total : 11768 time to create 1 rle with old method : 0.013497591018676758 time for calcul the mask position with numpy : 0.04350852966308594 nb_pixel_total : 191726 time to create 1 rle with new method : 0.6593356132507324 time for calcul the mask position with numpy : 0.04103493690490723 nb_pixel_total : 7786 time to create 1 rle with old method : 0.009397506713867188 time for calcul the mask position with numpy : 0.04149913787841797 nb_pixel_total : 26131 time to create 1 rle with old method : 0.029391765594482422 time for calcul the mask position with numpy : 0.041281938552856445 nb_pixel_total : 52732 time to create 1 rle with old method : 0.08504581451416016 time for calcul the mask position with numpy : 0.05305886268615723 nb_pixel_total : 21232 time to create 1 rle with old method : 0.02404308319091797 time for calcul the mask position with numpy : 0.04191160202026367 nb_pixel_total : 21703 time to create 1 rle with old method : 0.02625131607055664 time for calcul the mask position with numpy : 0.04086637496948242 nb_pixel_total : 14478 time to create 1 rle with old method : 0.018193960189819336 time for calcul the mask position with numpy : 0.040636539459228516 nb_pixel_total : 1676 time to create 1 rle with old method : 0.0023016929626464844 time for calcul the mask position with numpy : 0.04127764701843262 nb_pixel_total : 55097 time to create 1 rle with old method : 0.0616002082824707 time for calcul the mask position with numpy : 0.04064297676086426 nb_pixel_total : 14004 time to create 1 rle with old method : 0.015746593475341797 time for calcul the mask position with numpy : 0.041056156158447266 nb_pixel_total : 41589 time to create 1 rle with old method : 0.04749941825866699 time for calcul the mask position with numpy : 0.040940046310424805 nb_pixel_total : 49638 time to create 1 rle with old method : 0.05604958534240723 time for calcul the mask position with numpy : 0.04134559631347656 nb_pixel_total : 21089 time to create 1 rle with old method : 0.023919343948364258 time for calcul the mask position with numpy : 0.04105496406555176 nb_pixel_total : 45336 time to create 1 rle with old method : 0.05343508720397949 time for calcul the mask position with numpy : 0.04116630554199219 nb_pixel_total : 31223 time to create 1 rle with old method : 0.035391807556152344 time for calcul the mask position with numpy : 0.040668487548828125 nb_pixel_total : 39239 time to create 1 rle with old method : 0.04524827003479004 time for calcul the mask position with numpy : 0.049041748046875 nb_pixel_total : 750550 time to create 1 rle with new method : 0.726243257522583 time for calcul the mask position with numpy : 0.041146039962768555 nb_pixel_total : 537 time to create 1 rle with old method : 0.0008530616760253906 time for calcul the mask position with numpy : 0.041400909423828125 nb_pixel_total : 19015 time to create 1 rle with old method : 0.025125980377197266 time for calcul the mask position with numpy : 0.04285240173339844 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002071857452392578 time for calcul the mask position with numpy : 0.04251527786254883 nb_pixel_total : 155542 time to create 1 rle with new method : 0.8193833827972412 time for calcul the mask position with numpy : 0.041182756423950195 nb_pixel_total : 17986 time to create 1 rle with old method : 0.021005868911743164 time for calcul the mask position with numpy : 0.04790782928466797 nb_pixel_total : 50086 time to create 1 rle with old method : 0.0685431957244873 time for calcul the mask position with numpy : 0.042603254318237305 nb_pixel_total : 59664 time to create 1 rle with old method : 0.0874471664428711 time for calcul the mask position with numpy : 0.040303707122802734 nb_pixel_total : 8735 time to create 1 rle with old method : 0.010003089904785156 time for calcul the mask position with numpy : 0.04045748710632324 nb_pixel_total : 37562 time to create 1 rle with old method : 0.0419614315032959 time for calcul the mask position with numpy : 0.040343284606933594 nb_pixel_total : 19362 time to create 1 rle with old method : 0.022212743759155273 time for calcul the mask position with numpy : 0.04045820236206055 nb_pixel_total : 45383 time to create 1 rle with old method : 0.05169177055358887 time for calcul the mask position with numpy : 0.04068350791931152 nb_pixel_total : 54425 time to create 1 rle with old method : 0.061032772064208984 time for calcul the mask position with numpy : 0.04034113883972168 nb_pixel_total : 8976 time to create 1 rle with old method : 0.016622543334960938 time for calcul the mask position with numpy : 0.04567575454711914 nb_pixel_total : 34639 time to create 1 rle with old method : 0.04562091827392578 time for calcul the mask position with numpy : 0.040452003479003906 nb_pixel_total : 15982 time to create 1 rle with old method : 0.018268346786499023 time for calcul the mask position with numpy : 0.04187822341918945 nb_pixel_total : 138805 time to create 1 rle with old method : 0.15612196922302246 time for calcul the mask position with numpy : 0.040944814682006836 nb_pixel_total : 10682 time to create 1 rle with old method : 0.01238560676574707 time for calcul the mask position with numpy : 0.043150901794433594 nb_pixel_total : 84163 time to create 1 rle with old method : 0.09398913383483887 time for calcul the mask position with numpy : 0.045035600662231445 nb_pixel_total : 135328 time to create 1 rle with old method : 0.15177273750305176 time for calcul the mask position with numpy : 0.03999137878417969 nb_pixel_total : 2717 time to create 1 rle with old method : 0.0036208629608154297 time for calcul the mask position with numpy : 0.04146695137023926 nb_pixel_total : 61962 time to create 1 rle with old method : 0.06947517395019531 time for calcul the mask position with numpy : 0.041464805603027344 nb_pixel_total : 90371 time to create 1 rle with old method : 0.10246753692626953 time for calcul the mask position with numpy : 0.04088759422302246 nb_pixel_total : 13225 time to create 1 rle with old method : 0.01508474349975586 time for calcul the mask position with numpy : 0.04427146911621094 nb_pixel_total : 337116 time to create 1 rle with new method : 0.6434626579284668 time for calcul the mask position with numpy : 0.03952646255493164 nb_pixel_total : 62044 time to create 1 rle with old method : 0.0675344467163086 time for calcul the mask position with numpy : 0.041419267654418945 nb_pixel_total : 6194 time to create 1 rle with old method : 0.007070064544677734 time for calcul the mask position with numpy : 0.040552377700805664 nb_pixel_total : 134987 time to create 1 rle with old method : 0.15061259269714355 time for calcul the mask position with numpy : 0.040283918380737305 nb_pixel_total : 87028 time to create 1 rle with old method : 0.09969830513000488 time for calcul the mask position with numpy : 0.041769981384277344 nb_pixel_total : 38996 time to create 1 rle with old method : 0.04365730285644531 time for calcul the mask position with numpy : 0.040665626525878906 nb_pixel_total : 4708 time to create 1 rle with old method : 0.005585908889770508 time for calcul the mask position with numpy : 0.040679931640625 nb_pixel_total : 57187 time to create 1 rle with old method : 0.06582260131835938 time for calcul the mask position with numpy : 0.04075312614440918 nb_pixel_total : 19006 time to create 1 rle with old method : 0.021670818328857422 time for calcul the mask position with numpy : 0.04313063621520996 nb_pixel_total : 10551 time to create 1 rle with old method : 0.011949777603149414 time for calcul the mask position with numpy : 0.04175591468811035 nb_pixel_total : 149950 time to create 1 rle with old method : 0.1701955795288086 time for calcul the mask position with numpy : 0.04304838180541992 nb_pixel_total : 8635 time to create 1 rle with old method : 0.010337114334106445 time for calcul the mask position with numpy : 0.0428011417388916 nb_pixel_total : 23641 time to create 1 rle with old method : 0.02787494659423828 time for calcul the mask position with numpy : 0.0432734489440918 nb_pixel_total : 39167 time to create 1 rle with old method : 0.04554915428161621 time for calcul the mask position with numpy : 0.0429387092590332 nb_pixel_total : 29154 time to create 1 rle with old method : 0.03545665740966797 time for calcul the mask position with numpy : 0.04313230514526367 nb_pixel_total : 175541 time to create 1 rle with new method : 1.2872753143310547 time for calcul the mask position with numpy : 0.04284262657165527 nb_pixel_total : 355643 time to create 1 rle with new method : 0.8383519649505615 time for calcul the mask position with numpy : 0.04360151290893555 nb_pixel_total : 301187 time to create 1 rle with new method : 0.8855316638946533 time for calcul the mask position with numpy : 0.04076385498046875 nb_pixel_total : 8845 time to create 1 rle with old method : 0.010920524597167969 time for calcul the mask position with numpy : 0.04076886177062988 nb_pixel_total : 11394 time to create 1 rle with old method : 0.012935876846313477 time for calcul the mask position with numpy : 0.04222297668457031 nb_pixel_total : 181940 time to create 1 rle with new method : 0.7501225471496582 time for calcul the mask position with numpy : 0.04164767265319824 nb_pixel_total : 33972 time to create 1 rle with old method : 0.03852033615112305 time for calcul the mask position with numpy : 0.04161214828491211 nb_pixel_total : 32912 time to create 1 rle with old method : 0.038587093353271484 time for calcul the mask position with numpy : 0.041181087493896484 nb_pixel_total : 26344 time to create 1 rle with old method : 0.029897451400756836 time for calcul the mask position with numpy : 0.046277761459350586 nb_pixel_total : 419557 time to create 1 rle with new method : 0.7756009101867676 time for calcul the mask position with numpy : 0.04462742805480957 nb_pixel_total : 191995 time to create 1 rle with new method : 0.6451995372772217 time for calcul the mask position with numpy : 0.04258561134338379 nb_pixel_total : 195968 time to create 1 rle with new method : 0.5175187587738037 time for calcul the mask position with numpy : 0.04288816452026367 nb_pixel_total : 7589 time to create 1 rle with old method : 0.009083986282348633 time for calcul the mask position with numpy : 0.041107177734375 nb_pixel_total : 16921 time to create 1 rle with old method : 0.020123004913330078 time for calcul the mask position with numpy : 0.0437924861907959 nb_pixel_total : 9270 time to create 1 rle with old method : 0.013254404067993164 time for calcul the mask position with numpy : 0.04987072944641113 nb_pixel_total : 7540 time to create 1 rle with old method : 0.008571624755859375 time for calcul the mask position with numpy : 0.04088878631591797 nb_pixel_total : 19041 time to create 1 rle with old method : 0.021512269973754883 time for calcul the mask position with numpy : 0.04298210144042969 nb_pixel_total : 47044 time to create 1 rle with old method : 0.05292487144470215 time for calcul the mask position with numpy : 0.04100608825683594 nb_pixel_total : 504 time to create 1 rle with old method : 0.0008604526519775391 time for calcul the mask position with numpy : 0.04148602485656738 nb_pixel_total : 8958 time to create 1 rle with old method : 0.010257244110107422 time for calcul the mask position with numpy : 0.04103541374206543 nb_pixel_total : 10525 time to create 1 rle with old method : 0.01215362548828125 time for calcul the mask position with numpy : 0.04264497756958008 nb_pixel_total : 122315 time to create 1 rle with old method : 0.13782715797424316 time for calcul the mask position with numpy : 0.04082894325256348 nb_pixel_total : 53060 time to create 1 rle with old method : 0.060552120208740234 time for calcul the mask position with numpy : 0.0409541130065918 nb_pixel_total : 24631 time to create 1 rle with old method : 0.02973484992980957 time for calcul the mask position with numpy : 0.041719913482666016 nb_pixel_total : 168246 time to create 1 rle with new method : 0.4739716053009033 time for calcul the mask position with numpy : 0.04098844528198242 nb_pixel_total : 101020 time to create 1 rle with old method : 0.11607551574707031 time for calcul the mask position with numpy : 0.041661739349365234 nb_pixel_total : 55324 time to create 1 rle with old method : 0.0622403621673584 time for calcul the mask position with numpy : 0.04098343849182129 nb_pixel_total : 5263 time to create 1 rle with old method : 0.006008625030517578 time for calcul the mask position with numpy : 0.0406491756439209 nb_pixel_total : 4509 time to create 1 rle with old method : 0.005362987518310547 create new chi : 18.79776358604431 time to delete rle : 0.028591632843017578 batch 1 Loaded 90 chid ids of type : 4855 Number RLEs to save : 57094 TO DO : save crop sub photo not yet done ! save time : 3.578632116317749 nb_obj : 63 nb_hashtags : 10 time to prepare the origin masks : 31.27054452896118 time for calcul the mask position with numpy : 0.08309459686279297 nb_pixel_total : 1721571 time to create 1 rle with new method : 1.2433812618255615 time for calcul the mask position with numpy : 0.04180097579956055 nb_pixel_total : 78743 time to create 1 rle with old method : 0.08917069435119629 time for calcul the mask position with numpy : 0.04957699775695801 nb_pixel_total : 523034 time to create 1 rle with new method : 1.2800087928771973 time for calcul the mask position with numpy : 0.05047440528869629 nb_pixel_total : 80617 time to create 1 rle with old method : 0.19989514350891113 time for calcul the mask position with numpy : 0.04419589042663574 nb_pixel_total : 20356 time to create 1 rle with old method : 0.024690628051757812 time for calcul the mask position with numpy : 0.05131864547729492 nb_pixel_total : 762011 time to create 1 rle with new method : 1.1937260627746582 time for calcul the mask position with numpy : 0.04102730751037598 nb_pixel_total : 5163 time to create 1 rle with old method : 0.0062711238861083984 time for calcul the mask position with numpy : 0.04188895225524902 nb_pixel_total : 186487 time to create 1 rle with new method : 0.6057190895080566 time for calcul the mask position with numpy : 0.04091906547546387 nb_pixel_total : 14913 time to create 1 rle with old method : 0.01885509490966797 time for calcul the mask position with numpy : 0.04254794120788574 nb_pixel_total : 47966 time to create 1 rle with old method : 0.053967952728271484 time for calcul the mask position with numpy : 0.04204821586608887 nb_pixel_total : 261631 time to create 1 rle with new method : 0.7965857982635498 time for calcul the mask position with numpy : 0.056607961654663086 nb_pixel_total : 20598 time to create 1 rle with old method : 0.04580259323120117 time for calcul the mask position with numpy : 0.04183459281921387 nb_pixel_total : 37914 time to create 1 rle with old method : 0.04201173782348633 time for calcul the mask position with numpy : 0.039800405502319336 nb_pixel_total : 4562 time to create 1 rle with old method : 0.005354166030883789 time for calcul the mask position with numpy : 0.04094815254211426 nb_pixel_total : 491 time to create 1 rle with old method : 0.0007379055023193359 time for calcul the mask position with numpy : 0.04057931900024414 nb_pixel_total : 115314 time to create 1 rle with old method : 0.13130807876586914 time for calcul the mask position with numpy : 0.04536890983581543 nb_pixel_total : 21378 time to create 1 rle with old method : 0.023888349533081055 time for calcul the mask position with numpy : 0.040008544921875 nb_pixel_total : 19534 time to create 1 rle with old method : 0.02222275733947754 time for calcul the mask position with numpy : 0.042278289794921875 nb_pixel_total : 14681 time to create 1 rle with old method : 0.015978574752807617 time for calcul the mask position with numpy : 0.0386812686920166 nb_pixel_total : 6879 time to create 1 rle with old method : 0.0075185298919677734 time for calcul the mask position with numpy : 0.0442509651184082 nb_pixel_total : 646969 time to create 1 rle with new method : 0.7438721656799316 time for calcul the mask position with numpy : 0.05025935173034668 nb_pixel_total : 959122 time to create 1 rle with new method : 0.7550928592681885 time for calcul the mask position with numpy : 0.043914794921875 nb_pixel_total : 216160 time to create 1 rle with new method : 0.7746486663818359 time for calcul the mask position with numpy : 0.04046511650085449 nb_pixel_total : 7193 time to create 1 rle with old method : 0.008242607116699219 time for calcul the mask position with numpy : 0.04148125648498535 nb_pixel_total : 149029 time to create 1 rle with old method : 0.1928565502166748 time for calcul the mask position with numpy : 0.04096722602844238 nb_pixel_total : 6574 time to create 1 rle with old method : 0.007504701614379883 time for calcul the mask position with numpy : 0.041486263275146484 nb_pixel_total : 127448 time to create 1 rle with old method : 0.1418769359588623 time for calcul the mask position with numpy : 0.040254831314086914 nb_pixel_total : 18755 time to create 1 rle with old method : 0.02104640007019043 time for calcul the mask position with numpy : 0.03949093818664551 nb_pixel_total : 20377 time to create 1 rle with old method : 0.023044824600219727 time for calcul the mask position with numpy : 0.04028010368347168 nb_pixel_total : 11040 time to create 1 rle with old method : 0.014178991317749023 time for calcul the mask position with numpy : 0.04158163070678711 nb_pixel_total : 1920 time to create 1 rle with old method : 0.002382040023803711 time for calcul the mask position with numpy : 0.04379010200500488 nb_pixel_total : 358901 time to create 1 rle with new method : 0.783991813659668 time for calcul the mask position with numpy : 0.03944110870361328 nb_pixel_total : 29391 time to create 1 rle with old method : 0.03284335136413574 time for calcul the mask position with numpy : 0.04290151596069336 nb_pixel_total : 300171 time to create 1 rle with new method : 0.7187833786010742 time for calcul the mask position with numpy : 0.03992438316345215 nb_pixel_total : 5634 time to create 1 rle with old method : 0.006287097930908203 time for calcul the mask position with numpy : 0.03934669494628906 nb_pixel_total : 19503 time to create 1 rle with old method : 0.02238154411315918 time for calcul the mask position with numpy : 0.03932332992553711 nb_pixel_total : 27655 time to create 1 rle with old method : 0.031157970428466797 time for calcul the mask position with numpy : 0.04082131385803223 nb_pixel_total : 59729 time to create 1 rle with old method : 0.06913948059082031 time for calcul the mask position with numpy : 0.041764020919799805 nb_pixel_total : 155974 time to create 1 rle with new method : 0.6589744091033936 time for calcul the mask position with numpy : 0.043283700942993164 nb_pixel_total : 28497 time to create 1 rle with old method : 0.035123586654663086 time for calcul the mask position with numpy : 0.04137063026428223 nb_pixel_total : 7464 time to create 1 rle with old method : 0.009400129318237305 time for calcul the mask position with numpy : 0.041107892990112305 nb_pixel_total : 31118 time to create 1 rle with old method : 0.036263465881347656 time for calcul the mask position with numpy : 0.052907705307006836 nb_pixel_total : 935350 time to create 1 rle with new method : 0.7590315341949463 time for calcul the mask position with numpy : 0.04098367691040039 nb_pixel_total : 51192 time to create 1 rle with old method : 0.05687379837036133 time for calcul the mask position with numpy : 0.04130911827087402 nb_pixel_total : 55370 time to create 1 rle with old method : 0.06230044364929199 time for calcul the mask position with numpy : 0.04315686225891113 nb_pixel_total : 406011 time to create 1 rle with new method : 0.7400085926055908 time for calcul the mask position with numpy : 0.0402216911315918 nb_pixel_total : 12260 time to create 1 rle with old method : 0.014814376831054688 time for calcul the mask position with numpy : 0.04196906089782715 nb_pixel_total : 156774 time to create 1 rle with new method : 0.708876371383667 time for calcul the mask position with numpy : 0.04717826843261719 nb_pixel_total : 185759 time to create 1 rle with new method : 0.8356235027313232 time for calcul the mask position with numpy : 0.041387319564819336 nb_pixel_total : 64659 time to create 1 rle with old method : 0.07314562797546387 time for calcul the mask position with numpy : 0.04252934455871582 nb_pixel_total : 144212 time to create 1 rle with old method : 0.1963977813720703 time for calcul the mask position with numpy : 0.0406954288482666 nb_pixel_total : 5092 time to create 1 rle with old method : 0.0058650970458984375 time for calcul the mask position with numpy : 0.040966033935546875 nb_pixel_total : 47663 time to create 1 rle with old method : 0.05316472053527832 time for calcul the mask position with numpy : 0.04200935363769531 nb_pixel_total : 149772 time to create 1 rle with old method : 0.1629016399383545 time for calcul the mask position with numpy : 0.04091596603393555 nb_pixel_total : 228381 time to create 1 rle with new method : 0.5921285152435303 time for calcul the mask position with numpy : 0.04123568534851074 nb_pixel_total : 14093 time to create 1 rle with old method : 0.01752185821533203 time for calcul the mask position with numpy : 0.04214930534362793 nb_pixel_total : 2297 time to create 1 rle with old method : 0.0030248165130615234 time for calcul the mask position with numpy : 0.04146838188171387 nb_pixel_total : 25908 time to create 1 rle with old method : 0.029482364654541016 time for calcul the mask position with numpy : 0.042981863021850586 nb_pixel_total : 73901 time to create 1 rle with old method : 0.08434367179870605 time for calcul the mask position with numpy : 0.04413294792175293 nb_pixel_total : 1031 time to create 1 rle with old method : 0.0015690326690673828 time for calcul the mask position with numpy : 0.04325270652770996 nb_pixel_total : 522 time to create 1 rle with old method : 0.0007479190826416016 time for calcul the mask position with numpy : 0.042035579681396484 nb_pixel_total : 31593 time to create 1 rle with old method : 0.036678314208984375 time for calcul the mask position with numpy : 0.042206764221191406 nb_pixel_total : 1177 time to create 1 rle with old method : 0.0016202926635742188 time for calcul the mask position with numpy : 0.042101144790649414 nb_pixel_total : 8916 time to create 1 rle with old method : 0.010379552841186523 create new chi : 18.69903016090393 time to delete rle : 0.006430625915527344 batch 1 Loaded 64 chid ids of type : 4855 Number RLEs to save : 54149 TO DO : save crop sub photo not yet done ! save time : 3.580784320831299 nb_obj : 97 nb_hashtags : 12 time to prepare the origin masks : 49.41174030303955 time for calcul the mask position with numpy : 0.1843719482421875 nb_pixel_total : 2308222 time to create 1 rle with new method : 0.6137516498565674 time for calcul the mask position with numpy : 0.03899526596069336 nb_pixel_total : 64892 time to create 1 rle with old method : 0.07006478309631348 time for calcul the mask position with numpy : 0.03874325752258301 nb_pixel_total : 2241 time to create 1 rle with old method : 0.002759218215942383 time for calcul the mask position with numpy : 0.03907442092895508 nb_pixel_total : 36415 time to create 1 rle with old method : 0.03878617286682129 time for calcul the mask position with numpy : 0.03872990608215332 nb_pixel_total : 13378 time to create 1 rle with old method : 0.014022111892700195 time for calcul the mask position with numpy : 0.03864145278930664 nb_pixel_total : 6046 time to create 1 rle with old method : 0.006391763687133789 time for calcul the mask position with numpy : 0.03879117965698242 nb_pixel_total : 3188 time to create 1 rle with old method : 0.003925323486328125 time for calcul the mask position with numpy : 0.0387425422668457 nb_pixel_total : 123947 time to create 1 rle with old method : 0.13060379028320312 time for calcul the mask position with numpy : 0.04021048545837402 nb_pixel_total : 239725 time to create 1 rle with new method : 0.730130672454834 time for calcul the mask position with numpy : 0.040251970291137695 nb_pixel_total : 82130 time to create 1 rle with old method : 0.0895841121673584 time for calcul the mask position with numpy : 0.03860735893249512 nb_pixel_total : 550 time to create 1 rle with old method : 0.0007181167602539062 time for calcul the mask position with numpy : 0.03806638717651367 nb_pixel_total : 18155 time to create 1 rle with old method : 0.01912832260131836 time for calcul the mask position with numpy : 0.03967857360839844 nb_pixel_total : 35514 time to create 1 rle with old method : 0.037425994873046875 time for calcul the mask position with numpy : 0.03812217712402344 nb_pixel_total : 65079 time to create 1 rle with old method : 0.06913089752197266 time for calcul the mask position with numpy : 0.04044485092163086 nb_pixel_total : 59874 time to create 1 rle with old method : 0.06343579292297363 time for calcul the mask position with numpy : 0.03787398338317871 nb_pixel_total : 32651 time to create 1 rle with old method : 0.03463268280029297 time for calcul the mask position with numpy : 0.03859972953796387 nb_pixel_total : 23966 time to create 1 rle with old method : 0.02606201171875 time for calcul the mask position with numpy : 0.03941464424133301 nb_pixel_total : 30851 time to create 1 rle with old method : 0.032843589782714844 time for calcul the mask position with numpy : 0.038350820541381836 nb_pixel_total : 3169 time to create 1 rle with old method : 0.003574848175048828 time for calcul the mask position with numpy : 0.03849673271179199 nb_pixel_total : 4691 time to create 1 rle with old method : 0.005458831787109375 time for calcul the mask position with numpy : 0.03856301307678223 nb_pixel_total : 14972 time to create 1 rle with old method : 0.016136646270751953 time for calcul the mask position with numpy : 0.03886914253234863 nb_pixel_total : 10835 time to create 1 rle with old method : 0.011682748794555664 time for calcul the mask position with numpy : 0.0375821590423584 nb_pixel_total : 21067 time to create 1 rle with old method : 0.022080183029174805 time for calcul the mask position with numpy : 0.038134098052978516 nb_pixel_total : 23459 time to create 1 rle with old method : 0.024969816207885742 time for calcul the mask position with numpy : 0.039587974548339844 nb_pixel_total : 19420 time to create 1 rle with old method : 0.02023792266845703 time for calcul the mask position with numpy : 0.03797292709350586 nb_pixel_total : 11786 time to create 1 rle with old method : 0.01246333122253418 time for calcul the mask position with numpy : 0.04257702827453613 nb_pixel_total : 374758 time to create 1 rle with new method : 0.5569376945495605 time for calcul the mask position with numpy : 0.04070115089416504 nb_pixel_total : 124896 time to create 1 rle with old method : 0.13092589378356934 time for calcul the mask position with numpy : 0.04226398468017578 nb_pixel_total : 425102 time to create 1 rle with new method : 1.3123810291290283 time for calcul the mask position with numpy : 0.04083585739135742 nb_pixel_total : 33507 time to create 1 rle with old method : 0.040415287017822266 time for calcul the mask position with numpy : 0.04339122772216797 nb_pixel_total : 392 time to create 1 rle with old method : 0.0006275177001953125 time for calcul the mask position with numpy : 0.043514251708984375 nb_pixel_total : 37918 time to create 1 rle with old method : 0.04377102851867676 time for calcul the mask position with numpy : 0.039655208587646484 nb_pixel_total : 12 time to create 1 rle with old method : 0.0002498626708984375 time for calcul the mask position with numpy : 0.0392756462097168 nb_pixel_total : 49822 time to create 1 rle with old method : 0.05277419090270996 time for calcul the mask position with numpy : 0.038397789001464844 nb_pixel_total : 13531 time to create 1 rle with old method : 0.01464533805847168 time for calcul the mask position with numpy : 0.03866720199584961 nb_pixel_total : 16130 time to create 1 rle with old method : 0.01728034019470215 time for calcul the mask position with numpy : 0.03866839408874512 nb_pixel_total : 142841 time to create 1 rle with old method : 0.14990472793579102 time for calcul the mask position with numpy : 0.038370609283447266 nb_pixel_total : 50692 time to create 1 rle with old method : 0.0531156063079834 time for calcul the mask position with numpy : 0.038132667541503906 nb_pixel_total : 54224 time to create 1 rle with old method : 0.059240102767944336 time for calcul the mask position with numpy : 0.038831472396850586 nb_pixel_total : 215239 time to create 1 rle with new method : 0.6865370273590088 time for calcul the mask position with numpy : 0.03878593444824219 nb_pixel_total : 31269 time to create 1 rle with old method : 0.03301715850830078 time for calcul the mask position with numpy : 0.03831171989440918 nb_pixel_total : 21601 time to create 1 rle with old method : 0.022846221923828125 time for calcul the mask position with numpy : 0.03813672065734863 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007307529449462891 time for calcul the mask position with numpy : 0.038742780685424805 nb_pixel_total : 4639 time to create 1 rle with old method : 0.005652427673339844 time for calcul the mask position with numpy : 0.04377937316894531 nb_pixel_total : 605912 time to create 1 rle with new method : 0.8973283767700195 time for calcul the mask position with numpy : 0.03961682319641113 nb_pixel_total : 223607 time to create 1 rle with new method : 0.7959880828857422 time for calcul the mask position with numpy : 0.038579463958740234 nb_pixel_total : 20233 time to create 1 rle with old method : 0.024379491806030273 time for calcul the mask position with numpy : 0.03852534294128418 nb_pixel_total : 37961 time to create 1 rle with old method : 0.04077315330505371 time for calcul the mask position with numpy : 0.041275978088378906 nb_pixel_total : 3646 time to create 1 rle with old method : 0.0042781829833984375 time for calcul the mask position with numpy : 0.04065442085266113 nb_pixel_total : 28374 time to create 1 rle with old method : 0.032205820083618164 time for calcul the mask position with numpy : 0.0407404899597168 nb_pixel_total : 1082 time to create 1 rle with old method : 0.0016298294067382812 time for calcul the mask position with numpy : 0.040766000747680664 nb_pixel_total : 20798 time to create 1 rle with old method : 0.02357006072998047 time for calcul the mask position with numpy : 0.04071617126464844 nb_pixel_total : 7779 time to create 1 rle with old method : 0.009048938751220703 time for calcul the mask position with numpy : 0.04065990447998047 nb_pixel_total : 13524 time to create 1 rle with old method : 0.014819145202636719 time for calcul the mask position with numpy : 0.039903879165649414 nb_pixel_total : 196778 time to create 1 rle with new method : 0.6275486946105957 time for calcul the mask position with numpy : 0.038445472717285156 nb_pixel_total : 100866 time to create 1 rle with old method : 0.10477638244628906 time for calcul the mask position with numpy : 0.038594961166381836 nb_pixel_total : 10677 time to create 1 rle with old method : 0.011512994766235352 time for calcul the mask position with numpy : 0.039422035217285156 nb_pixel_total : 13017 time to create 1 rle with old method : 0.014821529388427734 time for calcul the mask position with numpy : 0.0392606258392334 nb_pixel_total : 660 time to create 1 rle with old method : 0.0008740425109863281 time for calcul the mask position with numpy : 0.04016613960266113 nb_pixel_total : 4938 time to create 1 rle with old method : 0.005815982818603516 time for calcul the mask position with numpy : 0.040257930755615234 nb_pixel_total : 28597 time to create 1 rle with old method : 0.032155513763427734 time for calcul the mask position with numpy : 0.0386357307434082 nb_pixel_total : 19996 time to create 1 rle with old method : 0.02220630645751953 time for calcul the mask position with numpy : 0.03847002983093262 nb_pixel_total : 37560 time to create 1 rle with old method : 0.04086112976074219 time for calcul the mask position with numpy : 0.04162788391113281 nb_pixel_total : 327834 time to create 1 rle with new method : 0.788233757019043 time for calcul the mask position with numpy : 0.040143728256225586 nb_pixel_total : 5606 time to create 1 rle with old method : 0.0068242549896240234 time for calcul the mask position with numpy : 0.04007148742675781 nb_pixel_total : 162120 time to create 1 rle with new method : 0.6940610408782959 time for calcul the mask position with numpy : 0.039186716079711914 nb_pixel_total : 82202 time to create 1 rle with old method : 0.08957958221435547 time for calcul the mask position with numpy : 0.03927469253540039 nb_pixel_total : 72185 time to create 1 rle with old method : 0.0760807991027832 time for calcul the mask position with numpy : 0.03800249099731445 nb_pixel_total : 17971 time to create 1 rle with old method : 0.018817901611328125 time for calcul the mask position with numpy : 0.03801989555358887 nb_pixel_total : 23591 time to create 1 rle with old method : 0.024713516235351562 time for calcul the mask position with numpy : 0.04194355010986328 nb_pixel_total : 14279 time to create 1 rle with old method : 0.014850616455078125 time for calcul the mask position with numpy : 0.037894248962402344 nb_pixel_total : 4172 time to create 1 rle with old method : 0.004856586456298828 time for calcul the mask position with numpy : 0.03957772254943848 nb_pixel_total : 127883 time to create 1 rle with old method : 0.1344447135925293 time for calcul the mask position with numpy : 0.03741145133972168 nb_pixel_total : 56 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.040055036544799805 nb_pixel_total : 349835 time to create 1 rle with new method : 1.183222770690918 time for calcul the mask position with numpy : 0.03830671310424805 nb_pixel_total : 2957 time to create 1 rle with old method : 0.003225564956665039 time for calcul the mask position with numpy : 0.03951239585876465 nb_pixel_total : 111423 time to create 1 rle with old method : 0.11692070960998535 time for calcul the mask position with numpy : 0.044149160385131836 nb_pixel_total : 697323 time to create 1 rle with new method : 0.9599728584289551 time for calcul the mask position with numpy : 0.03833770751953125 nb_pixel_total : 62302 time to create 1 rle with old method : 0.06718230247497559 time for calcul the mask position with numpy : 0.03902173042297363 nb_pixel_total : 874 time to create 1 rle with old method : 0.0011320114135742188 time for calcul the mask position with numpy : 0.037821054458618164 nb_pixel_total : 32586 time to create 1 rle with old method : 0.035909175872802734 time for calcul the mask position with numpy : 0.040992021560668945 nb_pixel_total : 15638 time to create 1 rle with old method : 0.01642131805419922 time for calcul the mask position with numpy : 0.03850960731506348 nb_pixel_total : 107289 time to create 1 rle with old method : 0.11241436004638672 time for calcul the mask position with numpy : 0.04155707359313965 nb_pixel_total : 18714 time to create 1 rle with old method : 0.026523828506469727 time for calcul the mask position with numpy : 0.04177355766296387 nb_pixel_total : 228229 time to create 1 rle with new method : 1.161595106124878 time for calcul the mask position with numpy : 0.03803610801696777 nb_pixel_total : 114686 time to create 1 rle with old method : 0.12076759338378906 time for calcul the mask position with numpy : 0.03813004493713379 nb_pixel_total : 8811 time to create 1 rle with old method : 0.009722232818603516 time for calcul the mask position with numpy : 0.038332223892211914 nb_pixel_total : 24162 time to create 1 rle with old method : 0.02701568603515625 time for calcul the mask position with numpy : 0.03780531883239746 nb_pixel_total : 55921 time to create 1 rle with old method : 0.058008432388305664 time for calcul the mask position with numpy : 0.03739738464355469 nb_pixel_total : 1820 time to create 1 rle with old method : 0.002079010009765625 time for calcul the mask position with numpy : 0.03812456130981445 nb_pixel_total : 165431 time to create 1 rle with new method : 1.0218400955200195 time for calcul the mask position with numpy : 0.039087772369384766 nb_pixel_total : 66931 time to create 1 rle with old method : 0.07185721397399902 time for calcul the mask position with numpy : 0.03850722312927246 nb_pixel_total : 129142 time to create 1 rle with old method : 0.13529610633850098 time for calcul the mask position with numpy : 0.03793191909790039 nb_pixel_total : 10830 time to create 1 rle with old method : 0.011423587799072266 time for calcul the mask position with numpy : 0.03957724571228027 nb_pixel_total : 268506 time to create 1 rle with new method : 0.5786886215209961 time for calcul the mask position with numpy : 0.04648399353027344 nb_pixel_total : 64699 time to create 1 rle with old method : 0.0736687183380127 time for calcul the mask position with numpy : 0.03852128982543945 nb_pixel_total : 97928 time to create 1 rle with old method : 0.10218048095703125 time for calcul the mask position with numpy : 0.038288116455078125 nb_pixel_total : 31143 time to create 1 rle with old method : 0.03292369842529297 create new chi : 20.544814348220825 time to delete rle : 0.0052831172943115234 batch 1 Loaded 98 chid ids of type : 4855 Number RLEs to save : 59974 TO DO : save crop sub photo not yet done ! save time : 3.3674116134643555 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 5.885716676712036 time for calcul the mask position with numpy : 0.0686802864074707 nb_pixel_total : 1609315 time to create 1 rle with new method : 1.1058201789855957 time for calcul the mask position with numpy : 0.051836490631103516 nb_pixel_total : 27540 time to create 1 rle with old method : 0.03355741500854492 time for calcul the mask position with numpy : 0.03310036659240723 nb_pixel_total : 213571 time to create 1 rle with new method : 1.0310580730438232 time for calcul the mask position with numpy : 0.041588544845581055 nb_pixel_total : 773956 time to create 1 rle with new method : 0.6104350090026855 time for calcul the mask position with numpy : 0.6688997745513916 nb_pixel_total : 7110018 time to create 1 rle with new method : 0.6721169948577881 create new chi : 4.4761130809783936 time to delete rle : 0.0015270709991455078 batch 1 Loaded 5 chid ids of type : 4855 Number RLEs to save : 11024 TO DO : save crop sub photo not yet done ! save time : 0.6690239906311035 map_output_result : {1379844790: (0.527882039393873, 'Should be the crop_list due to order', 0.215086805750096), 1379844776: (0.527882039393873, 'Should be the crop_list due to order', 0.5763968870067745), 1379844764: (0.527882039393873, 'Should be the crop_list due to order', 0.3200444648186216), 1379844735: (0.527882039393873, 'Should be the crop_list due to order', 1.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379844790, 1379844776, 1379844764, 1379844735] Looping around the photos to save general results len do output : 4 /1379844790.Didn't retrieve data . /1379844776.Didn't retrieve data . /1379844764.Didn't retrieve data . /1379844735.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844790', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844776', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844764', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844735', None, None, None, None, None, '3646766') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.013205766677856445 save_final save missing photos in datou_result : time spend for datou_step_exec : 205.31886410713196 time spend to save output : 0.013506412506103516 total time spend for step 5 : 205.33237051963806 step6:crop_condition Mon Sep 1 16:07:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 257 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3015255 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735658_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 36 photos in the portfolio 3015255 time of upload the photos Elapsed time : 14.608964920043945 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3015255 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735690_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 33 photos in the portfolio 3015255 time of upload the photos Elapsed time : 8.744658708572388 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735701_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.8509917259216309 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3015255 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735709_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.401571035385132 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735715_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.0557315349578857 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735717_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.9184103012084961 we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735722_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.20766282081604 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3015255 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735725_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.1920435428619385 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3015255 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735728_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.862508773803711 we have finished the crop for the class : verre begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3015255 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735749_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 25 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.437973499298096 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3015255 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735767_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.04056453704834 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 41 About to insert : list_path_to_insert length 41 new photo from crops ! About to upload 41 photos upload in portfolio : 3015255 init cache_photo without model_param we have 41 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756735809_4182899 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 41 photos in the portfolio 3015255 time of upload the photos Elapsed time : 11.724331617355347 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379844790, 1379844776, 1379844764, 1379844735] Looping around the photos to save general results len do output : 181 /1380653325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380653854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380654589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844790', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844776', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844764', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844735', None, None, None, None, None, '3646766') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 547 time used for this insertion : 0.05017447471618652 save_final save missing photos in datou_result : time spend for datou_step_exec : 193.473299741745 time spend to save output : 0.0549015998840332 total time spend for step 6 : 193.52820134162903 step7:ventilate_hashtags_in_portfolio Mon Sep 1 16:10:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26290980 get user id for portfolio 26290980 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26290980 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26290980 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26290980 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26290980 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26403456,26403457,26403458,26403459,26403460,26403465,26403467,26403468,26403469,26403470,26403471,26403472,26403474,26403475,26403476,26403477,26403478,26403479,26403480,26403481?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26290980 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379844790, 1379844776, 1379844764, 1379844735] Looping around the photos to save general results len do output : 1 /26290980. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844790', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844776', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844764', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844735', None, None, None, None, None, '3646766') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.011650562286376953 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.44043231010437 time spend to save output : 0.011873722076416016 total time spend for step 7 : 4.452306032180786 step8:final Mon Sep 1 16:10:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379844790: ('0.3827374129701659',), 1379844776: ('0.3827374129701659',), 1379844764: ('0.3827374129701659',), 1379844735: ('0.3827374129701659',)} new output for save of step final : {1379844790: ('0.3827374129701659',), 1379844776: ('0.3827374129701659',), 1379844764: ('0.3827374129701659',), 1379844735: ('0.3827374129701659',)} [1379844790, 1379844776, 1379844764, 1379844735] Looping around the photos to save general results len do output : 4 /1379844790.Didn't retrieve data . /1379844776.Didn't retrieve data . /1379844764.Didn't retrieve data . /1379844735.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844790', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844776', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844764', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844735', None, None, None, None, None, '3646766') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.011683225631713867 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10919713973999023 time spend to save output : 0.011973142623901367 total time spend for step 8 : 0.1211702823638916 step9:velours_tree Mon Sep 1 16:10:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13064908981323242 time spend to save output : 4.5299530029296875e-05 total time spend for step 9 : 0.13069438934326172 step10:send_mail_cod Mon Sep 1 16:10:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26290980_01-09-2025_16_10_27.pdf 26403429 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264034291756735827 26403430 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264034301756735829 26403431 change filename to text .change filename to text .change filename to text .change filename to text .imagette264034311756735830 26403432 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264034321756735831 26403433 change filename to text .change filename to text .imagette264034331756735832 26403434 change filename to text .change filename to text .imagette264034341756735833 26403435 imagette264034351756735833 26403436 imagette264034361756735833 26403437 imagette264034371756735833 26403438 imagette264034381756735833 26403439 change filename to text .change filename to text .change filename to text .change filename to text .imagette264034391756735833 26403440 change filename to text .change filename to text .change filename to text .imagette264034401756735833 26403441 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264034411756735833 26403442 imagette264034421756735834 26403443 imagette264034431756735834 26403444 imagette264034441756735834 26403445 imagette264034451756735834 26403446 imagette264034461756735834 26403447 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264034471756735834 26403449 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264034491756735834 26403450 imagette264034501756735836 26403451 imagette264034511756735836 26403452 imagette264034521756735836 26403453 imagette264034531756735836 26403454 imagette264034541756735836 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26290980 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26403456,26403457,26403458,26403459,26403460,26403465,26403467,26403468,26403469,26403470,26403471,26403472,26403474,26403475,26403476,26403477,26403478,26403479,26403480,26403481?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26290980 your option no_mail is active, we will not send the real mail to your client args[1379844790] : ((1379844790, 694.8644463648399, 492688767), (1379844790, -0.3944769868001172, 496442774), '0.3827374129701659') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379844776] : ((1379844776, 276.5889822210875, 492688767), (1379844776, -0.19674663591715333, 496442774), '0.3827374129701659') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379844764] : ((1379844764, 894.1056424982089, 2107751945), (1379844764, -0.282673285785971, 496442774), '0.3827374129701659') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1379844735] : ((1379844735, 132.6910973724649, 492688767), (1379844735, 0.16212659232213322, 2107752395), '0.3827374129701659') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.3827374129701659 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26290980_01-09-2025_16_10_27.pdf results_Auto_P26290980_01-09-2025_16_10_27.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26290980_01-09-2025_16_10_27.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','26290980','results_Auto_P26290980_01-09-2025_16_10_27.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26290980_01-09-2025_16_10_27.pdf','pdf','','2.08','0.3827374129701659') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379844790, 1379844776, 1379844764, 1379844735] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844790', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844776', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844764', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844735', None, None, None, None, None, '3646766') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.01266789436340332 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.024174451828003 time spend to save output : 0.01292562484741211 total time spend for step 10 : 12.037100076675415 step11:split_time_score Mon Sep 1 16:10:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('49', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 22082025 26290980 Nombre de photos uploadées : 4 / 23040 (0%) 22082025 26290980 Nombre de photos taguées (types de déchets): 0 / 4 (0%) 22082025 26290980 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.0002760887145996094 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.1994941234588623 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.33722517685127956 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26290977_28-08-2025_12_21_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26290977 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26290977 AND mptpi.`type`=4855 To do Qualite : 0.28105211116339807 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26290978_28-08-2025_11_51_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26290978 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26290978 AND mptpi.`type`=4855 To do Qualite : 0.3827374129701659 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26290980_01-09-2025_16_10_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26290980 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26290980 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'22082025': {'nb_upload': 4, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379844790, 1379844776, 1379844764, 1379844735] Looping around the photos to save general results len do output : 1 /26290980Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844790', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844776', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844764', None, None, None, None, None, '3646766') ('4741', None, None, None, None, None, None, None, '3646766') ('4741', '26290980', '1379844735', None, None, None, None, None, '3646766') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013328313827514648 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5744438171386719 time spend to save output : 0.013466596603393555 total time spend for step 11 : 0.5879104137420654 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 372.41user 125.04system 9:14.34elapsed 89%CPU (0avgtext+0avgdata 6002732maxresident)k 1718248inputs+363504outputs (5244major+21791855minor)pagefaults 0swaps