python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3834676 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4133550'] with mtr_portfolio_ids : ['28986877'] and first list_photo_ids : [] new path : /proc/3834676/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 2.6105551719665527 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Nov 28 07:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3362 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-28 07:10:33.733931: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-28 07:10:33.758664: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-28 07:10:33.760385: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f56f8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-28 07:10:33.760437: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-28 07:10:33.763026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-28 07:10:34.010501: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x20ef8b70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-28 07:10:34.010549: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-28 07:10:34.011208: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-28 07:10:34.011506: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-28 07:10:34.013534: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-28 07:10:34.015782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-28 07:10:34.016096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-28 07:10:34.018308: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-28 07:10:34.019386: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-28 07:10:34.023784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-28 07:10:34.024787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-28 07:10:34.024857: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-28 07:10:34.025395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-28 07:10:34.025410: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-28 07:10:34.025419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-28 07:10:34.026304: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2910 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-28 07:10:34.281104: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-28 07:10:34.281225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-28 07:10:34.281242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-28 07:10:34.281256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-28 07:10:34.281270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-28 07:10:34.281283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-28 07:10:34.281296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-28 07:10:34.281310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-28 07:10:34.282071: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-28 07:10:34.283060: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-28 07:10:34.283095: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-28 07:10:34.283110: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-28 07:10:34.283124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-28 07:10:34.283137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-28 07:10:34.283151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-28 07:10:34.283165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-28 07:10:34.283179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-28 07:10:34.283990: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-28 07:10:34.284025: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-28 07:10:34.284034: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-28 07:10:34.284042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-28 07:10:34.284905: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2910 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-28 07:10:44.920673: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-28 07:10:45.088902: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-28 07:10:46.383229: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.383838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.11G (2264806144 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.383872: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.384396: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.384412: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.391476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.391499: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.392039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.392056: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.398559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.398582: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.399125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.399142: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.429862: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.429916: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.430450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.430468: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.436258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.436278: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.436818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.436834: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-28 07:10:46.470743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.471304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.473146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.473692: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.517665: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.518195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.520366: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.520880: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.551146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.551661: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.553299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.553806: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.560176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.560702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.562553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.563062: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.569678: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.570189: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.571850: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.572357: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.603908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.604429: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.604933: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.605436: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.609449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.609957: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.627563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.628083: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.628589: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.629094: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.641521: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.642035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.642550: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.643055: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.647206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.647713: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.652195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.652707: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.664452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.665003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.668996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.669505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.670010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.670536: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.671246: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.671797: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.682341: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.682896: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.683581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.684155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.684703: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.685249: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.700463: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.701160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.724987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.725048: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-11-28 07:10:46.725610: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.726162: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.733521: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.734071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.734640: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.735211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.743134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.743687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.759400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.760061: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.760733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.761281: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.765459: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.766040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.766613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.767161: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.768285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.778428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.779016: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.788143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.788734: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.789290: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.789833: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.790413: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-28 07:10:46.790961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2516451328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 Detection mask done ! Trying to reset tf kernel 3835299 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2169 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3362 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [588, 2136, 1182, 2484] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031516551971435547 nb_pixel_total : 141612 time to create 1 rle with old method : 0.1795508861541748 length of segment : 591 DEBUG bbox = [690, 1122, 798, 1254] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000217437744140625 nb_pixel_total : 9896 time to create 1 rle with old method : 0.011822223663330078 length of segment : 129 DEBUG bbox = [456, 2466, 660, 2724] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005543231964111328 nb_pixel_total : 24994 time to create 1 rle with old method : 0.029205799102783203 length of segment : 198 DEBUG bbox = [1320, 288, 1494, 552] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006287097930908203 nb_pixel_total : 24357 time to create 1 rle with old method : 0.030443429946899414 length of segment : 164 DEBUG bbox = [1470, 1668, 1566, 1806] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00016427040100097656 nb_pixel_total : 7355 time to create 1 rle with old method : 0.009382247924804688 length of segment : 77 DEBUG bbox = [468, 1128, 696, 1296] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003902912139892578 nb_pixel_total : 22528 time to create 1 rle with old method : 0.025860071182250977 length of segment : 194 DEBUG bbox = [492, 1260, 600, 1380] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00018167495727539062 nb_pixel_total : 9781 time to create 1 rle with old method : 0.011483907699584961 length of segment : 105 DEBUG bbox = [228, 3090, 462, 3360] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006203651428222656 nb_pixel_total : 37665 time to create 1 rle with old method : 0.046610355377197266 length of segment : 238 DEBUG bbox = [240, 1134, 486, 1302] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041866302490234375 nb_pixel_total : 27289 time to create 1 rle with old method : 0.03134274482727051 length of segment : 221 DEBUG bbox = [594, 2412, 1242, 2934] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0049991607666015625 nb_pixel_total : 250659 time to create 1 rle with new method : 0.01184701919555664 length of segment : 718 DEBUG bbox = [1956, 2538, 2040, 2616] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001251697540283203 nb_pixel_total : 5008 time to create 1 rle with old method : 0.005903482437133789 length of segment : 77 DEBUG bbox = [1692, 2436, 1896, 2694] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007441043853759766 nb_pixel_total : 38391 time to create 1 rle with old method : 0.04692816734313965 length of segment : 276 DEBUG bbox = [228, 2724, 606, 2964] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008563995361328125 nb_pixel_total : 44718 time to create 1 rle with old method : 0.05054616928100586 length of segment : 395 DEBUG bbox = [978, 2010, 1134, 2160] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00025010108947753906 nb_pixel_total : 13264 time to create 1 rle with old method : 0.015288352966308594 length of segment : 145 DEBUG bbox = [2058, 954, 2154, 1062] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00014257431030273438 nb_pixel_total : 8750 time to create 1 rle with old method : 0.010219812393188477 length of segment : 96 DEBUG bbox = [2064, 1824, 2154, 2016] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 13666 time to create 1 rle with old method : 0.016270875930786133 length of segment : 90 DEBUG bbox = [786, 1050, 888, 1152] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00014328956604003906 nb_pixel_total : 6593 time to create 1 rle with old method : 0.010912656784057617 length of segment : 87 DEBUG bbox = [396, 1938, 666, 2130] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006210803985595703 nb_pixel_total : 30390 time to create 1 rle with old method : 0.03696560859680176 length of segment : 224 DEBUG bbox = [468, 1272, 648, 1464] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00032329559326171875 nb_pixel_total : 19201 time to create 1 rle with old method : 0.021233797073364258 length of segment : 170 DEBUG bbox = [2040, 678, 2142, 810] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00020599365234375 nb_pixel_total : 8660 time to create 1 rle with old method : 0.010093450546264648 length of segment : 105 DEBUG bbox = [1464, 2934, 1764, 3054] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003902912139892578 nb_pixel_total : 17192 time to create 1 rle with old method : 0.019545793533325195 length of segment : 262 DEBUG bbox = [858, 1182, 1074, 1422] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004360675811767578 nb_pixel_total : 25334 time to create 1 rle with old method : 0.02922844886779785 length of segment : 174 DEBUG bbox = [564, 396, 744, 612] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003497600555419922 nb_pixel_total : 24258 time to create 1 rle with old method : 0.027982711791992188 length of segment : 167 DEBUG bbox = [498, 2514, 816, 2760] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007753372192382812 nb_pixel_total : 53235 time to create 1 rle with old method : 0.057799577713012695 length of segment : 320 DEBUG bbox = [618, 876, 948, 1044] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005693435668945312 nb_pixel_total : 41258 time to create 1 rle with old method : 0.04508471488952637 length of segment : 338 DEBUG bbox = [240, 2154, 390, 2340] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002593994140625 nb_pixel_total : 12687 time to create 1 rle with old method : 0.014177799224853516 length of segment : 132 DEBUG bbox = [1704, 2514, 2136, 3000] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015659332275390625 nb_pixel_total : 102330 time to create 1 rle with old method : 0.10943150520324707 length of segment : 427 DEBUG bbox = [366, 1074, 516, 1218] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002219676971435547 nb_pixel_total : 15896 time to create 1 rle with old method : 0.018096923828125 length of segment : 134 DEBUG bbox = [360, 1350, 630, 1608] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00054168701171875 nb_pixel_total : 37274 time to create 1 rle with old method : 0.04086899757385254 length of segment : 245 DEBUG bbox = [114, 2034, 360, 2160] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004189014434814453 nb_pixel_total : 27090 time to create 1 rle with old method : 0.043649911880493164 length of segment : 238 DEBUG bbox = [1542, 2538, 1686, 2784] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002498626708984375 nb_pixel_total : 11804 time to create 1 rle with old method : 0.01348257064819336 length of segment : 106 DEBUG bbox = [6, 1596, 96, 1758] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 9740 time to create 1 rle with old method : 0.01098489761352539 length of segment : 86 DEBUG bbox = [24, 834, 324, 1176] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007510185241699219 nb_pixel_total : 57420 time to create 1 rle with old method : 0.06298995018005371 length of segment : 278 DEBUG bbox = [1710, 1722, 1878, 1860] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002429485321044922 nb_pixel_total : 15933 time to create 1 rle with old method : 0.018123865127563477 length of segment : 156 DEBUG bbox = [204, 2742, 480, 2952] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004749298095703125 nb_pixel_total : 33876 time to create 1 rle with old method : 0.037667036056518555 length of segment : 269 DEBUG bbox = [426, 1422, 1062, 1758] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001528024673461914 nb_pixel_total : 124141 time to create 1 rle with old method : 0.13535594940185547 length of segment : 567 DEBUG bbox = [594, 3048, 822, 3168] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00030875205993652344 nb_pixel_total : 18735 time to create 1 rle with old method : 0.021361112594604492 length of segment : 214 DEBUG bbox = [1848, 810, 2052, 1014] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003600120544433594 nb_pixel_total : 25889 time to create 1 rle with old method : 0.029289960861206055 length of segment : 196 DEBUG bbox = [1014, 708, 1212, 894] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006222724914550781 nb_pixel_total : 16797 time to create 1 rle with old method : 0.01950860023498535 length of segment : 130 DEBUG bbox = [1956, 2868, 2070, 2988] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 7771 time to create 1 rle with old method : 0.009198188781738281 length of segment : 96 DEBUG bbox = [1794, 1434, 1896, 1536] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001308917999267578 nb_pixel_total : 6983 time to create 1 rle with old method : 0.008376359939575195 length of segment : 95 DEBUG bbox = [564, 1422, 846, 1578] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007483959197998047 nb_pixel_total : 31499 time to create 1 rle with old method : 0.034629106521606445 length of segment : 273 DEBUG bbox = [1896, 1578, 2016, 1758] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00021386146545410156 nb_pixel_total : 14754 time to create 1 rle with old method : 0.016913414001464844 length of segment : 105 DEBUG bbox = [1608, 2148, 1848, 2352] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000766754150390625 nb_pixel_total : 26851 time to create 1 rle with old method : 0.02965068817138672 length of segment : 217 DEBUG bbox = [162, 474, 564, 924] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0026035308837890625 nb_pixel_total : 106598 time to create 1 rle with old method : 0.11839079856872559 length of segment : 347 DEBUG bbox = [894, 726, 1248, 900] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012366771697998047 nb_pixel_total : 54165 time to create 1 rle with old method : 0.06584310531616211 length of segment : 354 DEBUG bbox = [1782, 456, 2040, 678] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001241445541381836 nb_pixel_total : 25523 time to create 1 rle with old method : 0.031656503677368164 length of segment : 232 DEBUG bbox = [648, 870, 990, 1266] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018112659454345703 nb_pixel_total : 66310 time to create 1 rle with old method : 0.0765223503112793 length of segment : 291 DEBUG bbox = [498, 396, 936, 846] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002758026123046875 nb_pixel_total : 122435 time to create 1 rle with old method : 0.14689326286315918 length of segment : 363 DEBUG bbox = [390, 2328, 624, 2514] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008494853973388672 nb_pixel_total : 28354 time to create 1 rle with old method : 0.03218245506286621 length of segment : 214 DEBUG bbox = [246, 1812, 828, 2352] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003799915313720703 nb_pixel_total : 164360 time to create 1 rle with new method : 0.010098457336425781 length of segment : 544 DEBUG bbox = [1680, 2400, 2064, 2670] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014955997467041016 nb_pixel_total : 48066 time to create 1 rle with old method : 0.05349230766296387 length of segment : 525 DEBUG bbox = [804, 2364, 1242, 2910] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003242969512939453 nb_pixel_total : 123129 time to create 1 rle with old method : 0.1378183364868164 length of segment : 399 DEBUG bbox = [1518, 3018, 1716, 3198] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007152557373046875 nb_pixel_total : 21597 time to create 1 rle with old method : 0.02451300621032715 length of segment : 190 DEBUG bbox = [576, 2574, 792, 2874] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010402202606201172 nb_pixel_total : 34094 time to create 1 rle with old method : 0.03964710235595703 length of segment : 188 DEBUG bbox = [1476, 1968, 1644, 2154] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000576019287109375 nb_pixel_total : 16832 time to create 1 rle with old method : 0.023244142532348633 length of segment : 150 DEBUG bbox = [834, 1458, 1038, 1752] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008330345153808594 nb_pixel_total : 33736 time to create 1 rle with old method : 0.038785696029663086 length of segment : 198 DEBUG bbox = [0, 1764, 108, 1992] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041103363037109375 nb_pixel_total : 15302 time to create 1 rle with old method : 0.0169522762298584 length of segment : 101 DEBUG bbox = [264, 960, 648, 1338] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017299652099609375 nb_pixel_total : 59463 time to create 1 rle with old method : 0.06529855728149414 length of segment : 285 DEBUG bbox = [1626, 1272, 1848, 1398] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006084442138671875 nb_pixel_total : 20653 time to create 1 rle with old method : 0.0237729549407959 length of segment : 211 DEBUG bbox = [816, 1608, 984, 1830] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003681182861328125 nb_pixel_total : 15943 time to create 1 rle with old method : 0.01778125762939453 length of segment : 186 DEBUG bbox = [306, 1788, 474, 1938] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 15104 time to create 1 rle with old method : 0.01694655418395996 length of segment : 135 DEBUG bbox = [660, 1032, 864, 1332] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008120536804199219 nb_pixel_total : 39609 time to create 1 rle with old method : 0.044632911682128906 length of segment : 178 DEBUG bbox = [1620, 600, 2004, 1074] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020737648010253906 nb_pixel_total : 91308 time to create 1 rle with old method : 0.10187482833862305 length of segment : 301 DEBUG bbox = [240, 804, 426, 960] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005345344543457031 nb_pixel_total : 17534 time to create 1 rle with old method : 0.0198822021484375 length of segment : 188 DEBUG bbox = [582, 2070, 798, 2310] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007576942443847656 nb_pixel_total : 33499 time to create 1 rle with old method : 0.03717684745788574 length of segment : 196 DEBUG bbox = [342, 1506, 948, 1980] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003106832504272461 nb_pixel_total : 153193 time to create 1 rle with new method : 0.012067079544067383 length of segment : 517 DEBUG bbox = [702, 1080, 936, 1260] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005941390991210938 nb_pixel_total : 21505 time to create 1 rle with old method : 0.023919105529785156 length of segment : 231 DEBUG bbox = [1908, 1668, 2142, 1968] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009732246398925781 nb_pixel_total : 41105 time to create 1 rle with old method : 0.046213388442993164 length of segment : 211 DEBUG bbox = [168, 1200, 474, 1530] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010516643524169922 nb_pixel_total : 52870 time to create 1 rle with old method : 0.059734344482421875 length of segment : 280 DEBUG bbox = [516, 2034, 954, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002458810806274414 nb_pixel_total : 101454 time to create 1 rle with old method : 0.11199164390563965 length of segment : 463 DEBUG bbox = [690, 384, 972, 480] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006015300750732422 nb_pixel_total : 15207 time to create 1 rle with old method : 0.016810178756713867 length of segment : 265 DEBUG bbox = [1752, 1896, 1878, 2028] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 12219 time to create 1 rle with old method : 0.013435602188110352 length of segment : 117 DEBUG bbox = [42, 1140, 174, 1320] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00042510032653808594 nb_pixel_total : 8517 time to create 1 rle with old method : 0.009809732437133789 length of segment : 95 DEBUG bbox = [1818, 1434, 1950, 1572] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036334991455078125 nb_pixel_total : 11796 time to create 1 rle with old method : 0.013509273529052734 length of segment : 123 DEBUG bbox = [1752, 834, 1968, 1038] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008723735809326172 nb_pixel_total : 24810 time to create 1 rle with old method : 0.027923107147216797 length of segment : 188 time spent for convertir_results : 5.544136047363281 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 76 chid ids of type : 3594 Number RLEs to save : 17791 save missing photos in datou_result : time spend for datou_step_exec : 60.3392972946167 time spend to save output : 1.278230905532837 total time spend for step 1 : 61.617528200149536 step2:crop_condition Fri Nov 28 07:11:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 76 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 3736932 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764310305_3834676 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576480_0.png', 0, 315, 591, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576481_0.png', 0, 120, 106, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576482_0.png', 0, 237, 198, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576484_0.png', 0, 130, 76, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576485_0.png', 0, 144, 194, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576486_0.png', 0, 116, 103, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576487_0.png', 0, 252, 222, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576489_0.png', 0, 502, 610, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576490_0.png', 0, 76, 76, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576491_0.png', 0, 258, 178, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576492_0.png', 0, 235, 335, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576494_0.png', 0, 108, 94, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576495_0.png', 0, 180, 90, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576496_0.png', 0, 92, 87, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576499_0.png', 0, 124, 100, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576500_0.png', 0, 106, 262, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576501_0.png', 0, 218, 163, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576504_0.png', 0, 167, 323, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576505_0.png', 0, 167, 132, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576507_0.png', 0, 143, 134, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576509_0.png', 0, 125, 238, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576510_0.png', 0, 218, 105, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576513_0.png', 0, 137, 156, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576517_0.png', 0, 200, 196, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576519_0.png', 0, 111, 96, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576520_0.png', 0, 97, 95, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576522_0.png', 0, 178, 97, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576523_0.png', 0, 199, 203, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576524_0.png', 0, 435, 347, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576525_0.png', 0, 165, 348, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576526_0.png', 0, 200, 217, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576527_0.png', 0, 357, 244, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576530_0.png', 0, 453, 544, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576532_0.png', 0, 519, 399, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576533_0.png', 0, 162, 189, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576535_0.png', 0, 164, 150, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576539_0.png', 0, 120, 211, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576544_0.png', 0, 140, 172, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576545_0.png', 0, 233, 194, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576546_0.png', 0, 388, 515, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576548_0.png', 0, 299, 201, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576549_0.png', 0, 324, 237, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576550_0.png', 0, 471, 393, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576551_0.png', 0, 81, 265, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310312), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576554_0.png', 0, 130, 123, 0, 1764310312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 45 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.08152723312378 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764310319_3834676 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576483_0.png', 0, 248, 156, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576488_0.png', 0, 163, 221, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576493_0.png', 0, 133, 145, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576497_0.png', 0, 185, 224, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576498_0.png', 0, 163, 170, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576502_0.png', 0, 208, 167, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576503_0.png', 0, 216, 313, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576514_0.png', 0, 209, 269, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576516_0.png', 0, 115, 214, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576518_0.png', 0, 173, 127, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576521_0.png', 0, 143, 273, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576534_0.png', 0, 270, 185, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576536_0.png', 0, 286, 177, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576540_0.png', 0, 162, 151, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310321), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576547_0.png', 0, 167, 231, 0, 1764310321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.2782607078552246 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764310324_3834676 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310325), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576541_0.png', 0, 135, 135, 0, 1764310325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310325), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576555_0.png', 0, 168, 188, 0, 1764310325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.90191650390625 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764310330_3834676 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576506_0.png', 0, 381, 421, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576508_0.png', 0, 230, 245, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576511_0.png', 0, 148, 85, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576512_0.png', 0, 314, 278, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576515_0.png', 0, 316, 556, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576529_0.png', 0, 178, 204, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576531_0.png', 0, 236, 337, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576537_0.png', 0, 225, 96, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576538_0.png', 0, 337, 279, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576542_0.png', 0, 261, 177, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576543_0.png', 0, 422, 297, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310332), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576553_0.png', 0, 146, 95, 0, 1764310332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.7413010597229004 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764310334_3834676 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310334), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576552_0.png', 0, 124, 117, 0, 1764310334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6356565952301025 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764310337_3834676 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764310337), 0.0, 0.0, 14, '', 0, 0, '1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576528_0.png', 0, 413, 361, 0, 1764310337,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5955207347869873 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1396555282, 1396555280, 1396555276, 1396555252, 1396555250, 1396555247, 1396555244, 1396555240, 1396555237, 1396555209] Looping around the photos to save general results len do output : 76 /1396562725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396562808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555282', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555280', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555276', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555252', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555250', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555247', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555244', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555240', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555237', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555209', None, None, None, None, None, '4133550') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 238 time used for this insertion : 0.04182910919189453 save_final save missing photos in datou_result : time spend for datou_step_exec : 45.27554798126221 time spend to save output : 0.04406142234802246 total time spend for step 2 : 45.31960940361023 step3:rle_unique_nms_with_priority Fri Nov 28 07:12:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 76 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 8.614035367965698 time for calcul the mask position with numpy : 0.7056193351745605 nb_pixel_total : 7636883 time to create 1 rle with new method : 0.6466383934020996 time for calcul the mask position with numpy : 0.025545358657836914 nb_pixel_total : 13264 time to create 1 rle with old method : 0.015002250671386719 time for calcul the mask position with numpy : 0.024634599685668945 nb_pixel_total : 44718 time to create 1 rle with old method : 0.05009150505065918 time for calcul the mask position with numpy : 0.04293942451477051 nb_pixel_total : 38391 time to create 1 rle with old method : 0.04810619354248047 time for calcul the mask position with numpy : 0.036652565002441406 nb_pixel_total : 5008 time to create 1 rle with old method : 0.0055506229400634766 time for calcul the mask position with numpy : 0.0271909236907959 nb_pixel_total : 250659 time to create 1 rle with new method : 0.577892541885376 time for calcul the mask position with numpy : 0.025834321975708008 nb_pixel_total : 27289 time to create 1 rle with old method : 0.031302452087402344 time for calcul the mask position with numpy : 0.02580428123474121 nb_pixel_total : 37665 time to create 1 rle with old method : 0.04329729080200195 time for calcul the mask position with numpy : 0.024972915649414062 nb_pixel_total : 9781 time to create 1 rle with old method : 0.010978221893310547 time for calcul the mask position with numpy : 0.02654552459716797 nb_pixel_total : 22528 time to create 1 rle with old method : 0.027849435806274414 time for calcul the mask position with numpy : 0.025517940521240234 nb_pixel_total : 7355 time to create 1 rle with old method : 0.009257078170776367 time for calcul the mask position with numpy : 0.024392366409301758 nb_pixel_total : 24357 time to create 1 rle with old method : 0.027350187301635742 time for calcul the mask position with numpy : 0.024858713150024414 nb_pixel_total : 24994 time to create 1 rle with old method : 0.02975296974182129 time for calcul the mask position with numpy : 0.02641010284423828 nb_pixel_total : 9896 time to create 1 rle with old method : 0.011400938034057617 time for calcul the mask position with numpy : 0.024663209915161133 nb_pixel_total : 141612 time to create 1 rle with old method : 0.15816712379455566 create new chi : 2.8544809818267822 time to delete rle : 0.040052175521850586 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9216 TO DO : save crop sub photo not yet done ! save time : 0.7142252922058105 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 6.091793060302734 time for calcul the mask position with numpy : 0.9446501731872559 nb_pixel_total : 8045863 time to create 1 rle with new method : 0.6691915988922119 time for calcul the mask position with numpy : 0.04029679298400879 nb_pixel_total : 41258 time to create 1 rle with old method : 0.0440211296081543 time for calcul the mask position with numpy : 0.03651285171508789 nb_pixel_total : 53235 time to create 1 rle with old method : 0.06817340850830078 time for calcul the mask position with numpy : 0.02840566635131836 nb_pixel_total : 24258 time to create 1 rle with old method : 0.04314541816711426 time for calcul the mask position with numpy : 0.02701878547668457 nb_pixel_total : 25334 time to create 1 rle with old method : 0.03217577934265137 time for calcul the mask position with numpy : 0.027130126953125 nb_pixel_total : 17192 time to create 1 rle with old method : 0.027543306350708008 time for calcul the mask position with numpy : 0.027771949768066406 nb_pixel_total : 8660 time to create 1 rle with old method : 0.01211094856262207 time for calcul the mask position with numpy : 0.02581191062927246 nb_pixel_total : 19201 time to create 1 rle with old method : 0.021373510360717773 time for calcul the mask position with numpy : 0.02669525146484375 nb_pixel_total : 30390 time to create 1 rle with old method : 0.03414726257324219 time for calcul the mask position with numpy : 0.0433354377746582 nb_pixel_total : 6593 time to create 1 rle with old method : 0.007153987884521484 time for calcul the mask position with numpy : 0.040415048599243164 nb_pixel_total : 13666 time to create 1 rle with old method : 0.015105009078979492 time for calcul the mask position with numpy : 0.04024863243103027 nb_pixel_total : 8750 time to create 1 rle with old method : 0.009783744812011719 create new chi : 2.3375015258789062 time to delete rle : 0.0010542869567871094 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 6226 TO DO : save crop sub photo not yet done ! save time : 0.44844913482666016 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 5.669359922409058 time for calcul the mask position with numpy : 1.0710294246673584 nb_pixel_total : 8020159 time to create 1 rle with new method : 0.9380810260772705 time for calcul the mask position with numpy : 0.05474734306335449 nb_pixel_total : 57420 time to create 1 rle with old method : 0.06254935264587402 time for calcul the mask position with numpy : 0.03897547721862793 nb_pixel_total : 9740 time to create 1 rle with old method : 0.010288238525390625 time for calcul the mask position with numpy : 0.03954815864562988 nb_pixel_total : 11804 time to create 1 rle with old method : 0.013052701950073242 time for calcul the mask position with numpy : 0.039298057556152344 nb_pixel_total : 27090 time to create 1 rle with old method : 0.028668642044067383 time for calcul the mask position with numpy : 0.03699064254760742 nb_pixel_total : 37274 time to create 1 rle with old method : 0.038565635681152344 time for calcul the mask position with numpy : 0.03714466094970703 nb_pixel_total : 15896 time to create 1 rle with old method : 0.01685047149658203 time for calcul the mask position with numpy : 0.03166556358337402 nb_pixel_total : 102330 time to create 1 rle with old method : 0.11966228485107422 time for calcul the mask position with numpy : 0.027354955673217773 nb_pixel_total : 12687 time to create 1 rle with old method : 0.01658463478088379 create new chi : 2.671552896499634 time to delete rle : 0.0008296966552734375 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 5452 TO DO : save crop sub photo not yet done ! save time : 0.4044332504272461 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 8.330618619918823 time for calcul the mask position with numpy : 1.2735047340393066 nb_pixel_total : 8075826 time to create 1 rle with new method : 1.949031114578247 time for calcul the mask position with numpy : 0.023975849151611328 nb_pixel_total : 25889 time to create 1 rle with old method : 0.027547359466552734 time for calcul the mask position with numpy : 0.022997140884399414 nb_pixel_total : 18735 time to create 1 rle with old method : 0.02000713348388672 time for calcul the mask position with numpy : 0.023720741271972656 nb_pixel_total : 124141 time to create 1 rle with old method : 0.13208675384521484 time for calcul the mask position with numpy : 0.024713993072509766 nb_pixel_total : 33876 time to create 1 rle with old method : 0.036537885665893555 time for calcul the mask position with numpy : 0.024760723114013672 nb_pixel_total : 15933 time to create 1 rle with old method : 0.017148733139038086 create new chi : 3.619251012802124 time to delete rle : 0.0008862018585205078 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4964 TO DO : save crop sub photo not yet done ! save time : 0.3487553596496582 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 4.340940952301025 time for calcul the mask position with numpy : 0.6022002696990967 nb_pixel_total : 8216596 time to create 1 rle with new method : 0.7540485858917236 time for calcul the mask position with numpy : 0.0238955020904541 nb_pixel_total : 14754 time to create 1 rle with old method : 0.015492677688598633 time for calcul the mask position with numpy : 0.023658275604248047 nb_pixel_total : 31499 time to create 1 rle with old method : 0.03378033638000488 time for calcul the mask position with numpy : 0.022514820098876953 nb_pixel_total : 6983 time to create 1 rle with old method : 0.007459878921508789 time for calcul the mask position with numpy : 0.02379775047302246 nb_pixel_total : 7771 time to create 1 rle with old method : 0.008489131927490234 time for calcul the mask position with numpy : 0.024055004119873047 nb_pixel_total : 16797 time to create 1 rle with old method : 0.017986059188842773 create new chi : 1.5983986854553223 time to delete rle : 0.0005066394805908203 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3558 TO DO : save crop sub photo not yet done ! save time : 0.2874600887298584 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 2.813809394836426 time for calcul the mask position with numpy : 0.5259137153625488 nb_pixel_total : 7651738 time to create 1 rle with new method : 0.6092894077301025 time for calcul the mask position with numpy : 0.0236968994140625 nb_pixel_total : 48066 time to create 1 rle with old method : 0.05134391784667969 time for calcul the mask position with numpy : 0.023667335510253906 nb_pixel_total : 164360 time to create 1 rle with new method : 0.6082921028137207 time for calcul the mask position with numpy : 0.02647256851196289 nb_pixel_total : 28354 time to create 1 rle with old method : 0.03136396408081055 time for calcul the mask position with numpy : 0.023587465286254883 nb_pixel_total : 122435 time to create 1 rle with old method : 0.1324610710144043 time for calcul the mask position with numpy : 0.024430036544799805 nb_pixel_total : 66310 time to create 1 rle with old method : 0.06923294067382812 time for calcul the mask position with numpy : 0.02397608757019043 nb_pixel_total : 25523 time to create 1 rle with old method : 0.02754974365234375 time for calcul the mask position with numpy : 0.023794889450073242 nb_pixel_total : 54165 time to create 1 rle with old method : 0.05663275718688965 time for calcul the mask position with numpy : 0.0241849422454834 nb_pixel_total : 106598 time to create 1 rle with old method : 0.11367058753967285 time for calcul the mask position with numpy : 0.026224613189697266 nb_pixel_total : 26851 time to create 1 rle with old method : 0.038440704345703125 create new chi : 2.5493414402008057 time to delete rle : 0.0015416145324707031 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 8334 TO DO : save crop sub photo not yet done ! save time : 0.5937538146972656 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.8931710720062256 time for calcul the mask position with numpy : 0.5211341381072998 nb_pixel_total : 8098748 time to create 1 rle with new method : 0.6950347423553467 time for calcul the mask position with numpy : 0.025190114974975586 nb_pixel_total : 16832 time to create 1 rle with old method : 0.018413305282592773 time for calcul the mask position with numpy : 0.023450374603271484 nb_pixel_total : 34094 time to create 1 rle with old method : 0.03640937805175781 time for calcul the mask position with numpy : 0.02288031578063965 nb_pixel_total : 21597 time to create 1 rle with old method : 0.02303910255432129 time for calcul the mask position with numpy : 0.024313688278198242 nb_pixel_total : 123129 time to create 1 rle with old method : 0.13366150856018066 create new chi : 1.5697684288024902 time to delete rle : 0.0005922317504882812 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4014 TO DO : save crop sub photo not yet done ! save time : 0.3291966915130615 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 3.3984506130218506 time for calcul the mask position with numpy : 0.424746036529541 nb_pixel_total : 8007917 time to create 1 rle with new method : 0.7249977588653564 time for calcul the mask position with numpy : 0.023702144622802734 nb_pixel_total : 91308 time to create 1 rle with old method : 0.09469890594482422 time for calcul the mask position with numpy : 0.023138999938964844 nb_pixel_total : 39609 time to create 1 rle with old method : 0.04138922691345215 time for calcul the mask position with numpy : 0.024181842803955078 nb_pixel_total : 15104 time to create 1 rle with old method : 0.016000032424926758 time for calcul the mask position with numpy : 0.022933483123779297 nb_pixel_total : 11308 time to create 1 rle with old method : 0.011663436889648438 time for calcul the mask position with numpy : 0.037825584411621094 nb_pixel_total : 20653 time to create 1 rle with old method : 0.02131962776184082 time for calcul the mask position with numpy : 0.0296475887298584 nb_pixel_total : 59463 time to create 1 rle with old method : 0.06240677833557129 time for calcul the mask position with numpy : 0.024028301239013672 nb_pixel_total : 15302 time to create 1 rle with old method : 0.016244888305664062 time for calcul the mask position with numpy : 0.02310347557067871 nb_pixel_total : 33736 time to create 1 rle with old method : 0.036902666091918945 create new chi : 1.7004759311676025 time to delete rle : 0.0008528232574462891 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 5186 TO DO : save crop sub photo not yet done ! save time : 0.39400243759155273 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 1.4098894596099854 time for calcul the mask position with numpy : 0.5963735580444336 nb_pixel_total : 7974694 time to create 1 rle with new method : 0.771815299987793 time for calcul the mask position with numpy : 0.022267580032348633 nb_pixel_total : 52870 time to create 1 rle with old method : 0.056069374084472656 time for calcul the mask position with numpy : 0.022471189498901367 nb_pixel_total : 41105 time to create 1 rle with old method : 0.043580055236816406 time for calcul the mask position with numpy : 0.02362823486328125 nb_pixel_total : 21505 time to create 1 rle with old method : 0.022584199905395508 time for calcul the mask position with numpy : 0.03699231147766113 nb_pixel_total : 153193 time to create 1 rle with new method : 0.669234037399292 time for calcul the mask position with numpy : 0.03996157646179199 nb_pixel_total : 33499 time to create 1 rle with old method : 0.038626670837402344 time for calcul the mask position with numpy : 0.026346206665039062 nb_pixel_total : 17534 time to create 1 rle with old method : 0.019693613052368164 create new chi : 2.4563992023468018 time to delete rle : 0.0008406639099121094 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5406 TO DO : save crop sub photo not yet done ! save time : 0.41949462890625 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 2.186169385910034 time for calcul the mask position with numpy : 0.6348612308502197 nb_pixel_total : 8120397 time to create 1 rle with new method : 0.687025785446167 time for calcul the mask position with numpy : 0.022952795028686523 nb_pixel_total : 24810 time to create 1 rle with old method : 0.026129484176635742 time for calcul the mask position with numpy : 0.03306460380554199 nb_pixel_total : 11796 time to create 1 rle with old method : 0.012543201446533203 time for calcul the mask position with numpy : 0.023899316787719727 nb_pixel_total : 8517 time to create 1 rle with old method : 0.009235143661499023 time for calcul the mask position with numpy : 0.023066282272338867 nb_pixel_total : 12219 time to create 1 rle with old method : 0.013209342956542969 time for calcul the mask position with numpy : 0.02826690673828125 nb_pixel_total : 15207 time to create 1 rle with old method : 0.024409055709838867 time for calcul the mask position with numpy : 0.027922391891479492 nb_pixel_total : 101454 time to create 1 rle with old method : 0.1139230728149414 create new chi : 1.7233140468597412 time to delete rle : 0.0007114410400390625 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4662 TO DO : save crop sub photo not yet done ! save time : 0.3613910675048828 map_output_result : {1396555282: (0.0, 'Should be the crop_list due to order', 0), 1396555280: (0.0, 'Should be the crop_list due to order', 0), 1396555276: (0.0, 'Should be the crop_list due to order', 0), 1396555252: (0.0, 'Should be the crop_list due to order', 0), 1396555250: (0.0, 'Should be the crop_list due to order', 0), 1396555247: (0.0, 'Should be the crop_list due to order', 0), 1396555244: (0.0, 'Should be the crop_list due to order', 0), 1396555240: (0.0, 'Should be the crop_list due to order', 0), 1396555237: (0.0, 'Should be the crop_list due to order', 0), 1396555209: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1396555282, 1396555280, 1396555276, 1396555252, 1396555250, 1396555247, 1396555244, 1396555240, 1396555237, 1396555209] Looping around the photos to save general results len do output : 10 /1396555282.Didn't retrieve data . /1396555280.Didn't retrieve data . /1396555276.Didn't retrieve data . /1396555252.Didn't retrieve data . /1396555250.Didn't retrieve data . /1396555247.Didn't retrieve data . /1396555244.Didn't retrieve data . /1396555240.Didn't retrieve data . /1396555237.Didn't retrieve data . /1396555209.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555282', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555280', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555276', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555252', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555250', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555247', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555244', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555240', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555237', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555209', None, None, None, None, None, '4133550') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.018906593322753906 save_final save missing photos in datou_result : time spend for datou_step_exec : 72.75518560409546 time spend to save output : 0.019349098205566406 total time spend for step 3 : 72.77453470230103 step4:ventilate_hashtags_in_portfolio Fri Nov 28 07:13:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28986877 get user id for portfolio 28986877 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28986877 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','flou','autre','carton','metal','environnement','mal_croppe','background','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28986877 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','flou','autre','carton','metal','environnement','mal_croppe','background','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28986877 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','flou','autre','carton','metal','environnement','mal_croppe','background','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28987097,28987098,28987099,28987100,28987101,28987102,28987103,28987104,28987105,28987106,28987107?tags=papier,pehd,flou,autre,carton,metal,environnement,mal_croppe,background,pet_fonce,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1396555282, 1396555280, 1396555276, 1396555252, 1396555250, 1396555247, 1396555244, 1396555240, 1396555237, 1396555209] Looping around the photos to save general results len do output : 1 /28986877. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555282', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555280', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555276', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555252', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555250', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555247', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555244', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555240', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555237', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555209', None, None, None, None, None, '4133550') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.017113685607910156 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.1229329109191895 time spend to save output : 0.017400741577148438 total time spend for step 4 : 2.140333652496338 step5:final Fri Nov 28 07:13:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1396555282: ('0.03731649064429013',), 1396555280: ('0.03731649064429013',), 1396555276: ('0.03731649064429013',), 1396555252: ('0.03731649064429013',), 1396555250: ('0.03731649064429013',), 1396555247: ('0.03731649064429013',), 1396555244: ('0.03731649064429013',), 1396555240: ('0.03731649064429013',), 1396555237: ('0.03731649064429013',), 1396555209: ('0.03731649064429013',)} new output for save of step final : {1396555282: ('0.03731649064429013',), 1396555280: ('0.03731649064429013',), 1396555276: ('0.03731649064429013',), 1396555252: ('0.03731649064429013',), 1396555250: ('0.03731649064429013',), 1396555247: ('0.03731649064429013',), 1396555244: ('0.03731649064429013',), 1396555240: ('0.03731649064429013',), 1396555237: ('0.03731649064429013',), 1396555209: ('0.03731649064429013',)} [1396555282, 1396555280, 1396555276, 1396555252, 1396555250, 1396555247, 1396555244, 1396555240, 1396555237, 1396555209] Looping around the photos to save general results len do output : 10 /1396555282.Didn't retrieve data . /1396555280.Didn't retrieve data . /1396555276.Didn't retrieve data . /1396555252.Didn't retrieve data . /1396555250.Didn't retrieve data . /1396555247.Didn't retrieve data . /1396555244.Didn't retrieve data . /1396555240.Didn't retrieve data . /1396555237.Didn't retrieve data . /1396555209.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555282', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555280', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555276', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555252', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555250', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555247', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555244', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555240', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555237', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555209', None, None, None, None, None, '4133550') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.016708850860595703 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1380150318145752 time spend to save output : 0.017227888107299805 total time spend for step 5 : 0.155242919921875 step6:blur_detection Fri Nov 28 07:13:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb.jpg resize: (2160, 3840) 1396555282 -6.221428905252958 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb.jpg resize: (2160, 3840) 1396555280 -7.075627793479307 treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f.jpg resize: (2160, 3840) 1396555276 -7.112653636620956 treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7.jpg resize: (2160, 3840) 1396555252 -7.048413093373003 treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c.jpg resize: (2160, 3840) 1396555250 -7.085514243266859 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f.jpg resize: (2160, 3840) 1396555247 -7.1935015093605 treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec.jpg resize: (2160, 3840) 1396555244 -7.039283505870748 treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30.jpg resize: (2160, 3840) 1396555240 -7.153503499056239 treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5.jpg resize: (2160, 3840) 1396555237 -7.161189852456508 treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc.jpg resize: (2160, 3840) 1396555209 -6.1390939735290555 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576480_0.png resize: (591, 315) 1396562725 -4.572207993112672 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576481_0.png resize: (106, 120) 1396562726 -2.761262250431937 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576482_0.png resize: (198, 237) 1396562727 -4.054133624933 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576484_0.png resize: (76, 130) 1396562728 -2.9581375994911614 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576485_0.png resize: (194, 144) 1396562729 -2.9896395989004882 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576486_0.png resize: (103, 116) 1396562730 -4.016492397816572 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576487_0.png resize: (222, 252) 1396562732 -3.432841166533881 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576489_0.png resize: (610, 502) 1396562734 -5.081311231123932 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576490_0.png resize: (76, 76) 1396562735 -2.135791507134797 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576491_0.png resize: (178, 258) 1396562736 -4.359132365664322 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576492_0.png resize: (335, 235) 1396562737 -3.5035525820986826 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576494_0.png resize: (94, 108) 1396562738 -3.320201011283873 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576495_0.png resize: (90, 180) 1396562739 -3.9472104139060376 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576496_0.png resize: (87, 92) 1396562740 -3.6579176951363688 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576499_0.png resize: (100, 124) 1396562741 -4.07744364608852 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576500_0.png resize: (262, 106) 1396562742 -4.00468132822466 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576501_0.png resize: (163, 218) 1396562743 -4.508694485227432 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576504_0.png resize: (323, 167) 1396562744 -3.947798573393831 treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576505_0.png resize: (132, 167) 1396562745 -3.770135555432874 treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576507_0.png resize: (134, 143) 1396562746 -4.5063396435768075 treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576509_0.png resize: (238, 125) 1396562747 -2.1859941784998957 treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576510_0.png resize: (105, 218) 1396562748 -4.393166132037774 treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576513_0.png resize: (156, 137) 1396562749 -3.613443497360859 treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576517_0.png resize: (196, 200) 1396562750 -3.799426376776284 treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576519_0.png resize: (96, 111) 1396562751 -3.4064758512587505 treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576520_0.png resize: (95, 97) 1396562752 -4.47880715092324 treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576522_0.png resize: (97, 178) 1396562753 -4.082426436218226 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576523_0.png resize: (203, 199) 1396562754 -4.7913980053171645 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576524_0.png resize: (347, 435) 1396562755 -3.544907083730293 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576525_0.png resize: (348, 165) 1396562756 -4.961059797975586 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576526_0.png resize: (217, 200) 1396562757 -4.926919574270944 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576527_0.png resize: (244, 357) 1396562758 -4.921149031748141 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576530_0.png resize: (544, 453) 1396562759 -4.340084019927128 treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576532_0.png resize: (399, 519) 1396562760 -4.583731992877417 treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576533_0.png resize: (189, 162) 1396562761 -4.102086070293703 treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576535_0.png resize: (150, 164) 1396562762 -4.775129033526551 treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576539_0.png resize: (211, 120) 1396562763 -4.236229877359936 treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576544_0.png resize: (172, 140) 1396562764 -2.0157387235324173 treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576545_0.png resize: (194, 233) 1396562765 -3.431434129568237 treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576546_0.png resize: (515, 388) 1396562766 -4.783754418744005 treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576548_0.png resize: (201, 299) 1396562767 -4.8795274047453985 treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576549_0.png resize: (237, 324) 1396562768 -4.1583266263794805 treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576550_0.png resize: (393, 471) 1396562769 -4.2976148473487195 treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576551_0.png resize: (265, 81) 1396562770 -3.7899276721976127 treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576554_0.png resize: (123, 130) 1396562771 -3.846212697629912 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576483_0.png resize: (156, 248) 1396562774 -3.4110138259480647 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576488_0.png resize: (221, 163) 1396562775 -2.3816486710882128 treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576493_0.png resize: (145, 133) 1396562776 -2.808993319494861 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576497_0.png resize: (224, 185) 1396562777 -1.976589767069033 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576498_0.png resize: (170, 163) 1396562778 -2.565604063534333 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576502_0.png resize: (167, 208) 1396562779 -4.08534688044166 treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576503_0.png resize: (313, 216) 1396562780 -4.807832391849555 treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576514_0.png resize: (269, 209) 1396562781 -3.0243586891816 treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576516_0.png resize: (214, 115) 1396562782 -2.3514814641397486 treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576518_0.png resize: (127, 173) 1396562783 -2.241250093262989 treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576521_0.png resize: (273, 143) 1396562784 -3.5494648127640755 treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576534_0.png resize: (185, 270) 1396562785 -4.468615973892269 treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576536_0.png resize: (177, 286) 1396562786 -4.352714945840639 treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576540_0.png resize: (151, 162) 1396562787 -3.4850668017838826 treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576547_0.png resize: (231, 167) 1396562788 -2.8235358104839294 treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576541_0.png resize: (135, 135) 1396562791 -4.12410999356335 treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576555_0.png resize: (188, 168) 1396562792 -4.795538374382871 treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576506_0.png resize: (421, 381) 1396562794 -4.939943070878278 treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576508_0.png resize: (245, 230) 1396562795 -3.6497454162337686 treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576511_0.png resize: (85, 148) 1396562796 -2.8698511417901518 treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576512_0.png resize: (278, 314) 1396562797 -4.746075838783477 treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576515_0.png resize: (556, 316) 1396562798 -4.627105396146778 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576529_0.png resize: (204, 178) 1396562799 -3.6535659960198923 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576531_0.png resize: (337, 236) 1396562800 -5.64297207036731 treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576537_0.png resize: (96, 225) 1396562801 -4.240411771082091 treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576538_0.png resize: (279, 337) 1396562802 -3.7873264950558796 treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576542_0.png resize: (177, 261) 1396562803 -4.675458029346543 treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576543_0.png resize: (297, 422) 1396562804 -5.017923266446586 treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576553_0.png resize: (95, 146) 1396562805 -3.85416332177141 treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576552_0.png resize: (117, 124) 1396562807 -4.500632851011627 treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576528_0.png resize: (361, 413) 1396562808 -4.677496502536427 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 86 time used for this insertion : 0.01904916763305664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 86 time used for this insertion : 0.019866943359375 save missing photos in datou_result : time spend for datou_step_exec : 33.42977452278137 time spend to save output : 0.04447007179260254 total time spend for step 6 : 33.474244594573975 step7:brightness Fri Nov 28 07:14:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb.jpg treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb.jpg treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f.jpg treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7.jpg treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c.jpg treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f.jpg treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec.jpg treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30.jpg treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5.jpg treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc.jpg treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576480_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576481_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576482_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576484_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576485_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576486_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576487_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576489_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576490_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576491_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576492_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576494_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576495_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576496_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576499_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576500_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576501_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576504_0.png treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576505_0.png treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576507_0.png treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576509_0.png treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576510_0.png treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576513_0.png treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576517_0.png treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576519_0.png treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576520_0.png treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576522_0.png treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576523_0.png treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576524_0.png treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576525_0.png treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576526_0.png treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576527_0.png treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576530_0.png treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576532_0.png treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576533_0.png treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576535_0.png treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576539_0.png treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576544_0.png treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576545_0.png treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576546_0.png treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576548_0.png treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576549_0.png treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576550_0.png treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576551_0.png treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576554_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576483_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576488_0.png treat image : temp/1764310228_3834676_1396555282_bcdd6f2f397e958f03f37f24ffada9cb_rle_crop_4048576493_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576497_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576498_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576502_0.png treat image : temp/1764310228_3834676_1396555280_38d33dfc95d72289103396e303c884eb_rle_crop_4048576503_0.png treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576514_0.png treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576516_0.png treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576518_0.png treat image : temp/1764310228_3834676_1396555250_ff977679f60e8f896b7f8cfd1db3d97c_rle_crop_4048576521_0.png treat image : temp/1764310228_3834676_1396555244_9c425d1ea581dbb82bf0f6f3108bccec_rle_crop_4048576534_0.png treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576536_0.png treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576540_0.png treat image : temp/1764310228_3834676_1396555237_2cd66d11dc586397f3360493182feef5_rle_crop_4048576547_0.png treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576541_0.png treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576555_0.png treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576506_0.png treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576508_0.png treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576511_0.png treat image : temp/1764310228_3834676_1396555276_bb9f2277101e08ee9c9ed9dba280223f_rle_crop_4048576512_0.png treat image : temp/1764310228_3834676_1396555252_7a7b422dd9cb03ca96ead050f1c9a2b7_rle_crop_4048576515_0.png treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576529_0.png treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576531_0.png treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576537_0.png treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576538_0.png treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576542_0.png treat image : temp/1764310228_3834676_1396555240_ecf6f02ad79b6531edf5414f2bb27c30_rle_crop_4048576543_0.png treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576553_0.png treat image : temp/1764310228_3834676_1396555209_f2f1a13337cc87a7f1bae229446beffc_rle_crop_4048576552_0.png treat image : temp/1764310228_3834676_1396555247_67021927632ad1541b63f64029bcc59f_rle_crop_4048576528_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 86 time used for this insertion : 0.02025604248046875 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 86 time used for this insertion : 0.02098369598388672 save missing photos in datou_result : time spend for datou_step_exec : 8.891720056533813 time spend to save output : 0.04646182060241699 total time spend for step 7 : 8.93818187713623 step8:velours_tree Fri Nov 28 07:14:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09439492225646973 time spend to save output : 5.14984130859375e-05 total time spend for step 8 : 0.09444642066955566 step9:send_mail_cod Fri Nov 28 07:14:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28986877_28-11-2025_07_14_15.pdf 28987097 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289870971764310455 28987098 imagette289870981764310457 28987099 imagette289870991764310457 28987100 change filename to text .imagette289871001764310457 28987101 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289871011764310457 28987102 change filename to text .change filename to text .imagette289871021764310458 28987104 imagette289871041764310458 28987105 imagette289871051764310458 28987106 change filename to text .imagette289871061764310458 28987107 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289871071764310459 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28986877 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28987097,28987098,28987099,28987100,28987101,28987102,28987103,28987104,28987105,28987106,28987107?tags=papier,pehd,flou,autre,carton,metal,environnement,mal_croppe,background,pet_fonce,pet_clair args[1396555282] : ((1396555282, -6.221428905252958, 492609224), (1396555282, -0.1544849342269916, 496442774), '0.03731649064429013') We are sending mail with results at report@fotonower.com args[1396555280] : ((1396555280, -7.075627793479307, 492609224), (1396555280, -0.03323340303506028, 2107752395), '0.03731649064429013') We are sending mail with results at report@fotonower.com args[1396555276] : ((1396555276, -7.112653636620956, 492609224), (1396555276, -0.028997480304569865, 2107752395), '0.03731649064429013') We are sending mail with results at report@fotonower.com args[1396555252] : ((1396555252, -7.048413093373003, 492609224), (1396555252, -0.03550010808979684, 2107752395), '0.03731649064429013') We are sending mail with results at report@fotonower.com args[1396555250] : ((1396555250, -7.085514243266859, 492609224), (1396555250, -0.08761429560314613, 496442774), '0.03731649064429013') We are sending mail with results at report@fotonower.com args[1396555247] : ((1396555247, -7.1935015093605, 492609224), (1396555247, -0.0043181835612299616, 2107752395), '0.03731649064429013') We are sending mail with results at report@fotonower.com args[1396555244] : ((1396555244, -7.039283505870748, 492609224), (1396555244, -0.05287902790318834, 2107752395), '0.03731649064429013') We are sending mail with results at report@fotonower.com args[1396555240] : ((1396555240, -7.153503499056239, 492609224), (1396555240, -0.06092232961338793, 2107752395), '0.03731649064429013') We are sending mail with results at report@fotonower.com args[1396555237] : ((1396555237, -7.161189852456508, 492609224), (1396555237, 0.0027321067637420195, 2107752395), '0.03731649064429013') We are sending mail with results at report@fotonower.com args[1396555209] : ((1396555209, -6.1390939735290555, 492609224), (1396555209, -0.4076336278456545, 496442774), '0.03731649064429013') We are sending mail with results at report@fotonower.com refus_total : 0.03731649064429013 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28986877 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28986877_28-11-2025_07_14_15.pdf results_Auto_P28986877_28-11-2025_07_14_15.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28986877_28-11-2025_07_14_15.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28986877','results_Auto_P28986877_28-11-2025_07_14_15.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28986877_28-11-2025_07_14_15.pdf','pdf','','0.61','0.03731649064429013') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28986877

https://www.fotonower.com/image?json=false&list_photos_id=1396555282
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396555280
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396555276
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396555252
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396555250
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396555247
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396555244
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396555240
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396555237
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396555209
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 3.73%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/28987097?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28987100?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28987101?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28987102?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28987106?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28987107?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28986877_28-11-2025_07_14_15.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28987097,28987098,28987099,28987100,28987101,28987102,28987103,28987104,28987105,28987106,28987107?tags=papier,pehd,flou,autre,carton,metal,environnement,mal_croppe,background,pet_fonce,pet_clair.


L'équipe Fotonower HTTP Error 401: Unauthorized Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1396555282, 1396555280, 1396555276, 1396555252, 1396555250, 1396555247, 1396555244, 1396555240, 1396555237, 1396555209] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555282', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555280', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555276', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555252', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555250', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555247', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555244', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555240', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555237', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555209', None, None, None, None, None, '4133550') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.018239259719848633 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.425010919570923 time spend to save output : 0.01849055290222168 total time spend for step 9 : 7.4435014724731445 step10:split_time_score Fri Nov 28 07:14:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('05', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28112025 28986877 Nombre de photos uploadées : 10 / 23040 (0%) 28112025 28986877 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 28112025 28986877 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004673004150390625 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2479541301727295 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03731649064429013 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28986877_28-11-2025_07_14_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28986877 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28986877 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28112025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1396555282, 1396555280, 1396555276, 1396555252, 1396555250, 1396555247, 1396555244, 1396555240, 1396555237, 1396555209] Looping around the photos to save general results len do output : 1 /28986877Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555282', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555280', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555276', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555252', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555250', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555247', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555244', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555240', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555237', None, None, None, None, None, '4133550') ('3318', None, None, None, None, None, None, None, '4133550') ('3318', '28986877', '1396555209', None, None, None, None, None, '4133550') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01793193817138672 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5331282615661621 time spend to save output : 0.0181581974029541 total time spend for step 10 : 0.5512864589691162 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 98.67user 108.10system 3:59.25elapsed 86%CPU (0avgtext+0avgdata 4329128maxresident)k 511808inputs+84952outputs (164major+9636790minor)pagefaults 0swaps