python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1395259 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4335449'] with mtr_portfolio_ids : ['30213190'] and first list_photo_ids : [] new path : /proc/1395259/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 2.887216567993164 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Jan 26 09:10:32 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3177 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-26 09:10:35.723068: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-26 09:10:35.750435: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-26 09:10:35.752708: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9214000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-26 09:10:35.752768: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-26 09:10:35.756856: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-26 09:10:35.993753: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4186fed0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-26 09:10:35.993815: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-26 09:10:35.994973: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-26 09:10:35.995441: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-26 09:10:35.998940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-26 09:10:36.001797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-26 09:10:36.002356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-26 09:10:36.005382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-26 09:10:36.006946: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-26 09:10:36.011758: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-26 09:10:36.012857: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-26 09:10:36.012963: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-26 09:10:36.013518: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-26 09:10:36.013535: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-26 09:10:36.013544: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-26 09:10:36.014471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2725 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-26 09:10:36.297756: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-26 09:10:36.297895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-26 09:10:36.297924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-26 09:10:36.297951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-26 09:10:36.297976: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-26 09:10:36.298000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-26 09:10:36.298024: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-26 09:10:36.298049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-26 09:10:36.299321: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-26 09:10:36.300260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-26 09:10:36.300301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-26 09:10:36.300319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-26 09:10:36.300336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-26 09:10:36.300352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-26 09:10:36.300368: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-26 09:10:36.300384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-26 09:10:36.300400: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-26 09:10:36.301203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-26 09:10:36.301242: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-26 09:10:36.301250: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-26 09:10:36.301257: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-26 09:10:36.302294: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2725 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-26 09:10:47.576916: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-26 09:10:47.743139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-26 09:10:48.918485: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.918534: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:48.919052: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.919067: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:48.925957: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.925976: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:48.926498: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.926514: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:48.932929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.932947: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:48.933460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.933474: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:48.963824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.963849: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:48.964374: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.964388: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:48.970064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.970082: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:48.970609: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:48.970625: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-26 09:10:49.003393: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.003916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.005698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.006285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.048793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.049329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.051483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.052022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.081584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.082172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.083851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.084427: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.090629: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.091206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.093047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.093621: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.100054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.100630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.102326: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.102911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.133033: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.133559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.134074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.134606: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.138445: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.138967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.156721: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.157238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.157753: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.158262: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.173440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.173978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.174540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.175115: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.179996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.180524: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.185544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.186082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.198641: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.199229: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.203420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.203976: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.204492: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.205006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.205674: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.206195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.217262: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.217845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.218443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.219020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.219591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.220133: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.234865: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.235399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.296760: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.297371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.315208: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.315984: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.316744: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.317475: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.321816: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.322570: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.323295: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.324022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.324946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.324967: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2026-01-26 09:10:49.335307: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.335910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.344816: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.345342: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.345922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.346530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.347113: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-26 09:10:49.347683: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 Detection mask done ! Trying to reset tf kernel 1395565 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1984 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3177 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1626, 2484, 2088, 2940] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0026521682739257812 nb_pixel_total : 81516 time to create 1 rle with old method : 0.09120821952819824 length of segment : 445 DEBUG bbox = [1098, 2100, 1554, 2694] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0034346580505371094 nb_pixel_total : 163296 time to create 1 rle with new method : 0.009246349334716797 length of segment : 423 DEBUG bbox = [1746, 834, 1938, 1008] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00038242340087890625 nb_pixel_total : 25766 time to create 1 rle with old method : 0.026939868927001953 length of segment : 189 DEBUG bbox = [720, 2412, 1116, 2712] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009105205535888672 nb_pixel_total : 51244 time to create 1 rle with old method : 0.05569791793823242 length of segment : 384 DEBUG bbox = [1272, 408, 1686, 522] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005369186401367188 nb_pixel_total : 32867 time to create 1 rle with old method : 0.034769535064697266 length of segment : 395 DEBUG bbox = [294, 1680, 522, 1824] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003261566162109375 nb_pixel_total : 18907 time to create 1 rle with old method : 0.01952385902404785 length of segment : 224 DEBUG bbox = [6, 1044, 96, 1170] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00013899803161621094 nb_pixel_total : 8521 time to create 1 rle with old method : 0.008946895599365234 length of segment : 85 DEBUG bbox = [1200, 2874, 1476, 3036] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004398822784423828 nb_pixel_total : 30955 time to create 1 rle with old method : 0.0318303108215332 length of segment : 271 DEBUG bbox = [1848, 2514, 2094, 2802] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006067752838134766 nb_pixel_total : 40668 time to create 1 rle with old method : 0.042282819747924805 length of segment : 225 DEBUG bbox = [1896, 1416, 2064, 1674] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003681182861328125 nb_pixel_total : 14101 time to create 1 rle with old method : 0.01512908935546875 length of segment : 204 DEBUG bbox = [1866, 1176, 2004, 1332] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002334117889404297 nb_pixel_total : 15528 time to create 1 rle with old method : 0.01614665985107422 length of segment : 135 DEBUG bbox = [1434, 2304, 1578, 2502] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002818107604980469 nb_pixel_total : 18225 time to create 1 rle with old method : 0.019132614135742188 length of segment : 136 DEBUG bbox = [1044, 540, 1236, 702] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002982616424560547 nb_pixel_total : 16117 time to create 1 rle with old method : 0.016715049743652344 length of segment : 190 DEBUG bbox = [618, 642, 960, 948] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008587837219238281 nb_pixel_total : 55786 time to create 1 rle with old method : 0.05670499801635742 length of segment : 331 DEBUG bbox = [1722, 1752, 1956, 1938] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040650367736816406 nb_pixel_total : 22495 time to create 1 rle with old method : 0.023168563842773438 length of segment : 182 DEBUG bbox = [990, 1296, 1494, 1524] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009398460388183594 nb_pixel_total : 47404 time to create 1 rle with old method : 0.04862523078918457 length of segment : 488 DEBUG bbox = [1440, 1536, 1656, 1752] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004134178161621094 nb_pixel_total : 21611 time to create 1 rle with old method : 0.022940397262573242 length of segment : 202 DEBUG bbox = [1482, 2244, 1812, 2790] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012202262878417969 nb_pixel_total : 89535 time to create 1 rle with old method : 0.09554457664489746 length of segment : 297 DEBUG bbox = [1218, 2652, 1542, 3012] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009660720825195312 nb_pixel_total : 79349 time to create 1 rle with old method : 0.08107352256774902 length of segment : 300 DEBUG bbox = [924, 1314, 1158, 1512] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004172325134277344 nb_pixel_total : 26373 time to create 1 rle with old method : 0.027586936950683594 length of segment : 205 DEBUG bbox = [690, 2322, 960, 2388] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00021696090698242188 nb_pixel_total : 12358 time to create 1 rle with old method : 0.012774944305419922 length of segment : 315 DEBUG bbox = [180, 2712, 414, 2898] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00035953521728515625 nb_pixel_total : 13286 time to create 1 rle with old method : 0.01388692855834961 length of segment : 184 DEBUG bbox = [204, 1866, 846, 2760] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.011729001998901367 nb_pixel_total : 325759 time to create 1 rle with new method : 0.029122114181518555 length of segment : 690 DEBUG bbox = [318, 2742, 660, 3540] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002001523971557617 nb_pixel_total : 126022 time to create 1 rle with old method : 0.12942218780517578 length of segment : 256 DEBUG bbox = [1014, 1824, 1224, 2046] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00044155120849609375 nb_pixel_total : 24455 time to create 1 rle with old method : 0.02536487579345703 length of segment : 184 DEBUG bbox = [276, 3414, 672, 3672] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001016855239868164 nb_pixel_total : 54289 time to create 1 rle with old method : 0.05617880821228027 length of segment : 435 DEBUG bbox = [564, 1440, 942, 1860] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012323856353759766 nb_pixel_total : 77491 time to create 1 rle with old method : 0.0796055793762207 length of segment : 327 DEBUG bbox = [1590, 1620, 1866, 1836] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005207061767578125 nb_pixel_total : 33157 time to create 1 rle with old method : 0.03419947624206543 length of segment : 242 DEBUG bbox = [1026, 1710, 1338, 2028] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007214546203613281 nb_pixel_total : 51319 time to create 1 rle with old method : 0.052870988845825195 length of segment : 286 DEBUG bbox = [342, 1752, 546, 2052] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004520416259765625 nb_pixel_total : 28246 time to create 1 rle with old method : 0.029526233673095703 length of segment : 161 DEBUG bbox = [480, 480, 672, 678] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031375885009765625 nb_pixel_total : 19661 time to create 1 rle with old method : 0.020748138427734375 length of segment : 177 DEBUG bbox = [510, 138, 684, 282] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00025582313537597656 nb_pixel_total : 15539 time to create 1 rle with old method : 0.016149044036865234 length of segment : 165 DEBUG bbox = [1062, 204, 1194, 330] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00017833709716796875 nb_pixel_total : 9339 time to create 1 rle with old method : 0.009917259216308594 length of segment : 109 DEBUG bbox = [0, 1254, 504, 1932] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002729654312133789 nb_pixel_total : 224448 time to create 1 rle with new method : 0.010868549346923828 length of segment : 482 DEBUG bbox = [1602, 1566, 1950, 2052] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014615058898925781 nb_pixel_total : 111979 time to create 1 rle with old method : 0.1150825023651123 length of segment : 373 DEBUG bbox = [1614, 1476, 1968, 2076] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015909671783447266 nb_pixel_total : 121334 time to create 1 rle with old method : 0.12464570999145508 length of segment : 348 DEBUG bbox = [1620, 1938, 1800, 2100] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 17087 time to create 1 rle with old method : 0.017681121826171875 length of segment : 175 DEBUG bbox = [180, 6, 348, 216] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003314018249511719 nb_pixel_total : 23114 time to create 1 rle with old method : 0.023963212966918945 length of segment : 143 DEBUG bbox = [408, 108, 966, 552] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019326210021972656 nb_pixel_total : 137519 time to create 1 rle with old method : 0.14337611198425293 length of segment : 488 DEBUG bbox = [606, 1422, 876, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000759124755859375 nb_pixel_total : 43694 time to create 1 rle with old method : 0.05038166046142578 length of segment : 253 DEBUG bbox = [714, 894, 1356, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0065190792083740234 nb_pixel_total : 207163 time to create 1 rle with new method : 0.027814626693725586 length of segment : 495 DEBUG bbox = [408, 3108, 882, 3384] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002035379409790039 nb_pixel_total : 67711 time to create 1 rle with old method : 0.07637763023376465 length of segment : 444 DEBUG bbox = [1902, 2100, 2154, 2304] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009236335754394531 nb_pixel_total : 31622 time to create 1 rle with old method : 0.03376197814941406 length of segment : 250 DEBUG bbox = [6, 2358, 108, 2502] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003173351287841797 nb_pixel_total : 8118 time to create 1 rle with old method : 0.008625030517578125 length of segment : 83 DEBUG bbox = [78, 2706, 492, 2856] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012230873107910156 nb_pixel_total : 43620 time to create 1 rle with old method : 0.044121742248535156 length of segment : 453 DEBUG bbox = [642, 384, 930, 498] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007436275482177734 nb_pixel_total : 20672 time to create 1 rle with old method : 0.021027803421020508 length of segment : 253 DEBUG bbox = [1476, 1770, 1974, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023756027221679688 nb_pixel_total : 80761 time to create 1 rle with old method : 0.08109736442565918 length of segment : 497 DEBUG bbox = [1704, 1650, 1944, 1902] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013332366943359375 nb_pixel_total : 29207 time to create 1 rle with old method : 0.029613971710205078 length of segment : 220 DEBUG bbox = [1098, 1836, 1680, 2136] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0033791065216064453 nb_pixel_total : 88092 time to create 1 rle with old method : 0.08791470527648926 length of segment : 561 DEBUG bbox = [1758, 690, 2004, 894] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011913776397705078 nb_pixel_total : 28949 time to create 1 rle with old method : 0.029723644256591797 length of segment : 228 DEBUG bbox = [1692, 1848, 2148, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036089420318603516 nb_pixel_total : 157576 time to create 1 rle with new method : 0.006598949432373047 length of segment : 443 DEBUG bbox = [954, 1512, 1152, 1752] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010232925415039062 nb_pixel_total : 23200 time to create 1 rle with old method : 0.024036407470703125 length of segment : 156 DEBUG bbox = [1908, 1524, 2124, 1668] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008280277252197266 nb_pixel_total : 23469 time to create 1 rle with old method : 0.024736881256103516 length of segment : 202 DEBUG bbox = [978, 996, 1164, 1110] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006058216094970703 nb_pixel_total : 14503 time to create 1 rle with old method : 0.015311479568481445 length of segment : 150 DEBUG bbox = [1134, 2148, 1734, 2598] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004283905029296875 nb_pixel_total : 114070 time to create 1 rle with old method : 0.1225287914276123 length of segment : 562 DEBUG bbox = [1698, 870, 2070, 1170] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002155780792236328 nb_pixel_total : 74805 time to create 1 rle with old method : 0.07694625854492188 length of segment : 360 DEBUG bbox = [276, 1182, 744, 1506] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0030579566955566406 nb_pixel_total : 86753 time to create 1 rle with old method : 0.08930850028991699 length of segment : 468 DEBUG bbox = [1170, 1980, 1416, 2328] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013096332550048828 nb_pixel_total : 32109 time to create 1 rle with old method : 0.03431272506713867 length of segment : 212 DEBUG bbox = [408, 3252, 558, 3378] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000461578369140625 nb_pixel_total : 11912 time to create 1 rle with old method : 0.01254892349243164 length of segment : 133 DEBUG bbox = [486, 1752, 960, 2094] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002743959426879883 nb_pixel_total : 115491 time to create 1 rle with old method : 0.13962769508361816 length of segment : 460 DEBUG bbox = [882, 1332, 1332, 1866] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003274202346801758 nb_pixel_total : 125359 time to create 1 rle with old method : 0.12938809394836426 length of segment : 346 DEBUG bbox = [360, 2124, 618, 2490] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014426708221435547 nb_pixel_total : 51070 time to create 1 rle with old method : 0.05271577835083008 length of segment : 280 DEBUG bbox = [1722, 2130, 1836, 2208] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 6719 time to create 1 rle with old method : 0.0073566436767578125 length of segment : 110 DEBUG bbox = [516, 2838, 918, 3072] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016331672668457031 nb_pixel_total : 63411 time to create 1 rle with old method : 0.06777715682983398 length of segment : 405 DEBUG bbox = [366, 2478, 960, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0029375553131103516 nb_pixel_total : 130464 time to create 1 rle with old method : 0.13773202896118164 length of segment : 527 DEBUG bbox = [342, 3036, 858, 3222] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013606548309326172 nb_pixel_total : 57294 time to create 1 rle with old method : 0.05921292304992676 length of segment : 514 DEBUG bbox = [0, 1056, 180, 1242] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006539821624755859 nb_pixel_total : 24765 time to create 1 rle with old method : 0.02580738067626953 length of segment : 166 DEBUG bbox = [1026, 2724, 1170, 2898] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004935264587402344 nb_pixel_total : 15537 time to create 1 rle with old method : 0.0166323184967041 length of segment : 131 DEBUG bbox = [1392, 990, 1740, 1134] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010204315185546875 nb_pixel_total : 26468 time to create 1 rle with old method : 0.0270845890045166 length of segment : 336 DEBUG bbox = [1170, 1662, 1512, 1914] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001425027847290039 nb_pixel_total : 54333 time to create 1 rle with old method : 0.05669260025024414 length of segment : 300 DEBUG bbox = [1614, 2292, 1878, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010116100311279297 nb_pixel_total : 38384 time to create 1 rle with old method : 0.04012298583984375 length of segment : 255 DEBUG bbox = [372, 1854, 684, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017962455749511719 nb_pixel_total : 59807 time to create 1 rle with old method : 0.061795949935913086 length of segment : 300 DEBUG bbox = [342, 1008, 762, 1602] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00421452522277832 nb_pixel_total : 148597 time to create 1 rle with old method : 0.16754436492919922 length of segment : 382 DEBUG bbox = [432, 1584, 690, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008516311645507812 nb_pixel_total : 29695 time to create 1 rle with old method : 0.03705334663391113 length of segment : 242 DEBUG bbox = [48, 2274, 252, 2418] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010607242584228516 nb_pixel_total : 14898 time to create 1 rle with old method : 0.018559694290161133 length of segment : 182 DEBUG bbox = [108, 1614, 324, 1824] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001287698745727539 nb_pixel_total : 33175 time to create 1 rle with old method : 0.04061484336853027 length of segment : 212 DEBUG bbox = [1458, 1632, 1566, 1914] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009326934814453125 nb_pixel_total : 21913 time to create 1 rle with old method : 0.028212547302246094 length of segment : 110 DEBUG bbox = [624, 270, 846, 444] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012459754943847656 nb_pixel_total : 16534 time to create 1 rle with old method : 0.021369457244873047 length of segment : 189 time spent for convertir_results : 7.060932159423828 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 78 chid ids of type : 3594 Number RLEs to save : 22721 save missing photos in datou_result : time spend for datou_step_exec : 71.23856449127197 time spend to save output : 1.5767035484313965 total time spend for step 1 : 72.81526803970337 step2:crop_condition Mon Jan 26 09:11:45 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3736932 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769415114_1395259 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498103_0.png', 0, 569, 422, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498107_0.png', 0, 140, 224, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498110_0.png', 0, 277, 221, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498112_0.png', 0, 151, 135, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498113_0.png', 0, 193, 136, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498114_0.png', 0, 152, 190, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498117_0.png', 0, 177, 488, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498118_0.png', 0, 211, 199, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533177_99e5a1dc85ef0337c12da46ae223bf87_rle_crop_4112498119_0.png', 0, 533, 297, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac_rle_crop_4112498120_0.png', 0, 357, 300, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac_rle_crop_4112498122_0.png', 0, 65, 238, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498123_0.png', 0, 138, 184, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498128_0.png', 0, 414, 327, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498129_0.png', 0, 192, 242, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498130_0.png', 0, 303, 256, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498136_0.png', 0, 486, 296, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498138_0.png', 0, 145, 175, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498143_0.png', 0, 243, 443, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498144_0.png', 0, 194, 250, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498146_0.png', 0, 139, 406, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498147_0.png', 0, 98, 252, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498150_0.png', 0, 253, 504, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498154_0.png', 0, 143, 202, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498156_0.png', 0, 403, 508, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498158_0.png', 0, 295, 432, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498159_0.png', 0, 324, 207, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498160_0.png', 0, 111, 130, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498164_0.png', 0, 74, 110, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498171_0.png', 0, 241, 300, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415120), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498176_0.png', 0, 136, 182, 0, 1769415120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 30 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.5952863693237305 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769415125_1395259 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415126), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498105_0.png', 0, 246, 381, 0, 1769415126,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415126), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac_rle_crop_4112498121_0.png', 0, 195, 191, 0, 1769415126,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415126), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498126_0.png', 0, 196, 172, 0, 1769415126,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415126), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498132_0.png', 0, 173, 176, 0, 1769415126,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415126), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498139_0.png', 0, 199, 143, 0, 1769415126,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415126), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498149_0.png', 0, 219, 220, 0, 1769415126,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415126), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498151_0.png', 0, 192, 228, 0, 1769415126,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415126), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498153_0.png', 0, 216, 156, 0, 1769415126,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415126), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498179_0.png', 0, 125, 189, 0, 1769415126,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2363243103027344 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769415129_1395259 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415129), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498109_0.png', 0, 139, 271, 0, 1769415129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415129), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498133_0.png', 0, 131, 165, 0, 1769415129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415129), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498134_0.png', 0, 104, 109, 0, 1769415129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9678235054016113 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769415142_1395259 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498102_0.png', 0, 406, 445, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498106_0.png', 0, 110, 395, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498108_0.png', 0, 116, 85, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498111_0.png', 0, 210, 152, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498124_0.png', 0, 874, 610, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498125_0.png', 0, 691, 242, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498127_0.png', 0, 214, 392, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498131_0.png', 0, 265, 161, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498135_0.png', 0, 632, 481, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498137_0.png', 0, 535, 309, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498140_0.png', 0, 415, 488, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498141_0.png', 0, 307, 249, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498142_0.png', 0, 724, 478, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498145_0.png', 0, 125, 83, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498148_0.png', 0, 323, 397, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498152_0.png', 0, 429, 438, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498157_0.png', 0, 296, 342, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498161_0.png', 0, 335, 460, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498162_0.png', 0, 506, 345, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498163_0.png', 0, 274, 234, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498165_0.png', 0, 215, 383, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498166_0.png', 0, 329, 527, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498167_0.png', 0, 184, 514, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498168_0.png', 0, 184, 166, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498173_0.png', 0, 289, 297, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498174_0.png', 0, 528, 381, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498175_0.png', 0, 195, 242, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415147), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498177_0.png', 0, 207, 212, 0, 1769415147,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.300312280654907 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769415152_1395259 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415153), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498104_0.png', 0, 171, 189, 0, 1769415153,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415153), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498116_0.png', 0, 164, 182, 0, 1769415153,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415153), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498155_0.png', 0, 110, 150, 0, 1769415153,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415153), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498169_0.png', 0, 158, 123, 0, 1769415153,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415153), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498170_0.png', 0, 113, 336, 0, 1769415153,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415153), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498172_0.png', 0, 214, 255, 0, 1769415153,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2218267917633057 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769415156_1395259 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415156), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498115_0.png', 0, 225, 331, 0, 1769415156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769415156), 0.0, 0.0, 14, '', 0, 0, '1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498178_0.png', 0, 282, 104, 0, 1769415156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7260115146636963 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1405533179, 1405533178, 1405533177, 1405533176, 1405533175, 1405533173, 1405533171, 1405533170, 1405533154, 1405533146, 1405533143, 1405533124] Looping around the photos to save general results len do output : 78 /1405538784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405538999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405539024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533179', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533178', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533177', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533176', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533175', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533173', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533171', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533170', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533154', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533146', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533143', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533124', None, None, None, None, None, '4335449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 246 time used for this insertion : 0.0459749698638916 save_final save missing photos in datou_result : time spend for datou_step_exec : 50.75366926193237 time spend to save output : 0.04896688461303711 total time spend for step 2 : 50.80263614654541 step3:rle_unique_nms_with_priority Mon Jan 26 09:12:36 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 5 time to prepare the origin masks : 4.389508962631226 time for calcul the mask position with numpy : 0.49100470542907715 nb_pixel_total : 7881328 time to create 1 rle with new method : 0.8333432674407959 time for calcul the mask position with numpy : 0.023137569427490234 nb_pixel_total : 30955 time to create 1 rle with old method : 0.03186774253845215 time for calcul the mask position with numpy : 0.024268388748168945 nb_pixel_total : 8521 time to create 1 rle with old method : 0.0096435546875 time for calcul the mask position with numpy : 0.024370908737182617 nb_pixel_total : 18907 time to create 1 rle with old method : 0.02047586441040039 time for calcul the mask position with numpy : 0.024265289306640625 nb_pixel_total : 32867 time to create 1 rle with old method : 0.03492999076843262 time for calcul the mask position with numpy : 0.023272037506103516 nb_pixel_total : 51244 time to create 1 rle with old method : 0.053746938705444336 time for calcul the mask position with numpy : 0.02349996566772461 nb_pixel_total : 25766 time to create 1 rle with old method : 0.026508092880249023 time for calcul the mask position with numpy : 0.023860931396484375 nb_pixel_total : 163296 time to create 1 rle with new method : 0.8743183612823486 time for calcul the mask position with numpy : 0.02527165412902832 nb_pixel_total : 81516 time to create 1 rle with old method : 0.08930253982543945 create new chi : 2.7185158729553223 time to delete rle : 0.04232645034790039 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6992 TO DO : save crop sub photo not yet done ! save time : 0.5104632377624512 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 4.794433116912842 time for calcul the mask position with numpy : 0.5486266613006592 nb_pixel_total : 8042465 time to create 1 rle with new method : 0.8009121417999268 time for calcul the mask position with numpy : 0.025220632553100586 nb_pixel_total : 21611 time to create 1 rle with old method : 0.023001670837402344 time for calcul the mask position with numpy : 0.02449655532836914 nb_pixel_total : 47404 time to create 1 rle with old method : 0.05072617530822754 time for calcul the mask position with numpy : 0.02329564094543457 nb_pixel_total : 22495 time to create 1 rle with old method : 0.0237274169921875 time for calcul the mask position with numpy : 0.023014307022094727 nb_pixel_total : 55786 time to create 1 rle with old method : 0.05850410461425781 time for calcul the mask position with numpy : 0.023914575576782227 nb_pixel_total : 16117 time to create 1 rle with old method : 0.01705145835876465 time for calcul the mask position with numpy : 0.02371072769165039 nb_pixel_total : 18225 time to create 1 rle with old method : 0.019361257553100586 time for calcul the mask position with numpy : 0.024049758911132812 nb_pixel_total : 15528 time to create 1 rle with old method : 0.0164947509765625 time for calcul the mask position with numpy : 0.02387857437133789 nb_pixel_total : 14101 time to create 1 rle with old method : 0.014917850494384766 time for calcul the mask position with numpy : 0.023617267608642578 nb_pixel_total : 40668 time to create 1 rle with old method : 0.04316425323486328 create new chi : 1.8733243942260742 time to delete rle : 0.0008242130279541016 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 6346 TO DO : save crop sub photo not yet done ! save time : 0.45537638664245605 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.9137172698974609 time for calcul the mask position with numpy : 0.5748825073242188 nb_pixel_total : 8204865 time to create 1 rle with new method : 0.8782835006713867 time for calcul the mask position with numpy : 0.022684335708618164 nb_pixel_total : 89535 time to create 1 rle with old method : 0.09305047988891602 create new chi : 1.6084957122802734 time to delete rle : 0.00025582313537597656 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2754 TO DO : save crop sub photo not yet done ! save time : 0.22460126876831055 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 1.7249138355255127 time for calcul the mask position with numpy : 0.8298182487487793 nb_pixel_total : 8176320 time to create 1 rle with new method : 0.8289389610290527 time for calcul the mask position with numpy : 0.02212214469909668 nb_pixel_total : 12358 time to create 1 rle with old method : 0.012652873992919922 time for calcul the mask position with numpy : 0.022150039672851562 nb_pixel_total : 26373 time to create 1 rle with old method : 0.027241230010986328 time for calcul the mask position with numpy : 0.02333664894104004 nb_pixel_total : 79349 time to create 1 rle with old method : 0.0828866958618164 create new chi : 1.8892993927001953 time to delete rle : 0.0005815029144287109 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3800 TO DO : save crop sub photo not yet done ! save time : 0.29080700874328613 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.943650960922241 time for calcul the mask position with numpy : 0.6920385360717773 nb_pixel_total : 7673165 time to create 1 rle with new method : 0.6592483520507812 time for calcul the mask position with numpy : 0.022819995880126953 nb_pixel_total : 77491 time to create 1 rle with old method : 0.07960152626037598 time for calcul the mask position with numpy : 0.02281785011291504 nb_pixel_total : 54222 time to create 1 rle with old method : 0.055716514587402344 time for calcul the mask position with numpy : 0.02307295799255371 nb_pixel_total : 24455 time to create 1 rle with old method : 0.02514505386352539 time for calcul the mask position with numpy : 0.023983478546142578 nb_pixel_total : 126022 time to create 1 rle with old method : 0.1310586929321289 time for calcul the mask position with numpy : 0.023940086364746094 nb_pixel_total : 325759 time to create 1 rle with new method : 0.7807157039642334 time for calcul the mask position with numpy : 0.0237579345703125 nb_pixel_total : 13286 time to create 1 rle with old method : 0.013834714889526367 create new chi : 2.6414923667907715 time to delete rle : 0.0009350776672363281 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 6275 TO DO : save crop sub photo not yet done ! save time : 0.4557361602783203 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.498502492904663 time for calcul the mask position with numpy : 0.7752618789672852 nb_pixel_total : 8162017 time to create 1 rle with new method : 0.799074649810791 time for calcul the mask position with numpy : 0.022317171096801758 nb_pixel_total : 19661 time to create 1 rle with old method : 0.02109670639038086 time for calcul the mask position with numpy : 0.02271413803100586 nb_pixel_total : 28246 time to create 1 rle with old method : 0.029405832290649414 time for calcul the mask position with numpy : 0.022268056869506836 nb_pixel_total : 51319 time to create 1 rle with old method : 0.05311989784240723 time for calcul the mask position with numpy : 0.023559093475341797 nb_pixel_total : 33157 time to create 1 rle with old method : 0.034505367279052734 create new chi : 1.8422174453735352 time to delete rle : 0.0005426406860351562 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3892 TO DO : save crop sub photo not yet done ! save time : 0.2963078022003174 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 4.391892433166504 time for calcul the mask position with numpy : 0.683013916015625 nb_pixel_total : 7701104 time to create 1 rle with new method : 0.7473340034484863 time for calcul the mask position with numpy : 0.022549152374267578 nb_pixel_total : 43694 time to create 1 rle with old method : 0.04497671127319336 time for calcul the mask position with numpy : 0.024641752243041992 nb_pixel_total : 137518 time to create 1 rle with old method : 0.14212679862976074 time for calcul the mask position with numpy : 0.022452116012573242 nb_pixel_total : 23114 time to create 1 rle with old method : 0.02380514144897461 time for calcul the mask position with numpy : 0.022352218627929688 nb_pixel_total : 17087 time to create 1 rle with old method : 0.018225908279418945 time for calcul the mask position with numpy : 0.023444414138793945 nb_pixel_total : 10578 time to create 1 rle with old method : 0.011370420455932617 time for calcul the mask position with numpy : 0.023064374923706055 nb_pixel_total : 111979 time to create 1 rle with old method : 0.11775422096252441 time for calcul the mask position with numpy : 0.0244905948638916 nb_pixel_total : 224448 time to create 1 rle with new method : 0.7985610961914062 time for calcul the mask position with numpy : 0.02252507209777832 nb_pixel_total : 9339 time to create 1 rle with old method : 0.009800910949707031 time for calcul the mask position with numpy : 0.02355360984802246 nb_pixel_total : 15539 time to create 1 rle with old method : 0.01639866828918457 create new chi : 2.885709524154663 time to delete rle : 0.0009741783142089844 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 6973 TO DO : save crop sub photo not yet done ! save time : 0.5857160091400146 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.2310574054718018 time for calcul the mask position with numpy : 0.5295135974884033 nb_pixel_total : 7834733 time to create 1 rle with new method : 0.8449552059173584 time for calcul the mask position with numpy : 0.02469611167907715 nb_pixel_total : 80761 time to create 1 rle with old method : 0.0918428897857666 time for calcul the mask position with numpy : 0.024344444274902344 nb_pixel_total : 20672 time to create 1 rle with old method : 0.023447751998901367 time for calcul the mask position with numpy : 0.02517080307006836 nb_pixel_total : 43620 time to create 1 rle with old method : 0.04943394660949707 time for calcul the mask position with numpy : 0.025255441665649414 nb_pixel_total : 8118 time to create 1 rle with old method : 0.009206295013427734 time for calcul the mask position with numpy : 0.024651288986206055 nb_pixel_total : 31622 time to create 1 rle with old method : 0.035747528076171875 time for calcul the mask position with numpy : 0.025536537170410156 nb_pixel_total : 67711 time to create 1 rle with old method : 0.0762169361114502 time for calcul the mask position with numpy : 0.0264284610748291 nb_pixel_total : 207163 time to create 1 rle with new method : 0.8137850761413574 create new chi : 2.7160298824310303 time to delete rle : 0.001005411148071289 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 7110 TO DO : save crop sub photo not yet done ! save time : 0.5142941474914551 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 4.796902894973755 time for calcul the mask position with numpy : 0.6514458656311035 nb_pixel_total : 7653776 time to create 1 rle with new method : 0.7642116546630859 time for calcul the mask position with numpy : 0.024007558822631836 nb_pixel_total : 86753 time to create 1 rle with old method : 0.0964207649230957 time for calcul the mask position with numpy : 0.024079322814941406 nb_pixel_total : 74805 time to create 1 rle with old method : 0.07905340194702148 time for calcul the mask position with numpy : 0.024274826049804688 nb_pixel_total : 114070 time to create 1 rle with old method : 0.11926507949829102 time for calcul the mask position with numpy : 0.022826433181762695 nb_pixel_total : 14503 time to create 1 rle with old method : 0.0149078369140625 time for calcul the mask position with numpy : 0.024865388870239258 nb_pixel_total : 23469 time to create 1 rle with old method : 0.02399277687072754 time for calcul the mask position with numpy : 0.022619247436523438 nb_pixel_total : 23200 time to create 1 rle with old method : 0.023938655853271484 time for calcul the mask position with numpy : 0.024295330047607422 nb_pixel_total : 157576 time to create 1 rle with new method : 0.7396683692932129 time for calcul the mask position with numpy : 0.023179292678833008 nb_pixel_total : 28949 time to create 1 rle with old method : 0.03077864646911621 time for calcul the mask position with numpy : 0.024598121643066406 nb_pixel_total : 88092 time to create 1 rle with old method : 0.09145832061767578 time for calcul the mask position with numpy : 0.022991418838500977 nb_pixel_total : 29207 time to create 1 rle with old method : 0.031526803970336914 create new chi : 2.9698569774627686 time to delete rle : 0.0011873245239257812 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8860 TO DO : save crop sub photo not yet done ! save time : 0.6287052631378174 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 2.6064655780792236 time for calcul the mask position with numpy : 0.6987676620483398 nb_pixel_total : 7958459 time to create 1 rle with new method : 0.773118257522583 time for calcul the mask position with numpy : 0.022458553314208984 nb_pixel_total : 51070 time to create 1 rle with old method : 0.05134248733520508 time for calcul the mask position with numpy : 0.02237987518310547 nb_pixel_total : 125359 time to create 1 rle with old method : 0.12873625755310059 time for calcul the mask position with numpy : 0.02415323257446289 nb_pixel_total : 115491 time to create 1 rle with old method : 0.11920022964477539 time for calcul the mask position with numpy : 0.022225141525268555 nb_pixel_total : 11912 time to create 1 rle with old method : 0.012228727340698242 time for calcul the mask position with numpy : 0.022342443466186523 nb_pixel_total : 32109 time to create 1 rle with old method : 0.03314995765686035 create new chi : 1.971796989440918 time to delete rle : 0.0007081031799316406 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 5022 TO DO : save crop sub photo not yet done ! save time : 0.4006035327911377 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.7827041149139404 time for calcul the mask position with numpy : 0.5522122383117676 nb_pixel_total : 7877025 time to create 1 rle with new method : 1.0490307807922363 time for calcul the mask position with numpy : 0.023967742919921875 nb_pixel_total : 38384 time to create 1 rle with old method : 0.042623043060302734 time for calcul the mask position with numpy : 0.02374410629272461 nb_pixel_total : 54333 time to create 1 rle with old method : 0.0583953857421875 time for calcul the mask position with numpy : 0.02501392364501953 nb_pixel_total : 26468 time to create 1 rle with old method : 0.028975248336791992 time for calcul the mask position with numpy : 0.025530338287353516 nb_pixel_total : 15537 time to create 1 rle with old method : 0.016933917999267578 time for calcul the mask position with numpy : 0.024849653244018555 nb_pixel_total : 24765 time to create 1 rle with old method : 0.026105642318725586 time for calcul the mask position with numpy : 0.025237083435058594 nb_pixel_total : 57294 time to create 1 rle with old method : 0.06070876121520996 time for calcul the mask position with numpy : 0.024389266967773438 nb_pixel_total : 130464 time to create 1 rle with old method : 0.1692640781402588 time for calcul the mask position with numpy : 0.02459549903869629 nb_pixel_total : 63411 time to create 1 rle with old method : 0.06552529335021973 time for calcul the mask position with numpy : 0.02345418930053711 nb_pixel_total : 6719 time to create 1 rle with old method : 0.008310794830322266 create new chi : 2.3426778316497803 time to delete rle : 0.0014624595642089844 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 7648 TO DO : save crop sub photo not yet done ! save time : 0.5620665550231934 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 4.087329387664795 time for calcul the mask position with numpy : 0.6329391002655029 nb_pixel_total : 7969781 time to create 1 rle with new method : 0.6471121311187744 time for calcul the mask position with numpy : 0.02472853660583496 nb_pixel_total : 16534 time to create 1 rle with old method : 0.018746614456176758 time for calcul the mask position with numpy : 0.024782419204711914 nb_pixel_total : 21913 time to create 1 rle with old method : 0.025144100189208984 time for calcul the mask position with numpy : 0.024855375289916992 nb_pixel_total : 33175 time to create 1 rle with old method : 0.03648233413696289 time for calcul the mask position with numpy : 0.026032209396362305 nb_pixel_total : 14898 time to create 1 rle with old method : 0.016443490982055664 time for calcul the mask position with numpy : 0.02476954460144043 nb_pixel_total : 29695 time to create 1 rle with old method : 0.03212881088256836 time for calcul the mask position with numpy : 0.02720332145690918 nb_pixel_total : 148597 time to create 1 rle with old method : 0.15990543365478516 time for calcul the mask position with numpy : 0.024356603622436523 nb_pixel_total : 59807 time to create 1 rle with old method : 0.06456208229064941 create new chi : 1.8541457653045654 time to delete rle : 0.0008783340454101562 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5394 TO DO : save crop sub photo not yet done ! save time : 0.3860013484954834 map_output_result : {1405533179: (0.0, 'Should be the crop_list due to order', 0), 1405533178: (0.0, 'Should be the crop_list due to order', 0), 1405533177: (0.0, 'Should be the crop_list due to order', 0), 1405533176: (0.0, 'Should be the crop_list due to order', 0), 1405533175: (0.0, 'Should be the crop_list due to order', 0), 1405533173: (0.0, 'Should be the crop_list due to order', 0), 1405533171: (0.0, 'Should be the crop_list due to order', 0), 1405533170: (0.0, 'Should be the crop_list due to order', 0), 1405533154: (0.0, 'Should be the crop_list due to order', 0), 1405533146: (0.0, 'Should be the crop_list due to order', 0), 1405533143: (0.0, 'Should be the crop_list due to order', 0), 1405533124: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1405533179, 1405533178, 1405533177, 1405533176, 1405533175, 1405533173, 1405533171, 1405533170, 1405533154, 1405533146, 1405533143, 1405533124] Looping around the photos to save general results len do output : 12 /1405533179.Didn't retrieve data . /1405533178.Didn't retrieve data . /1405533177.Didn't retrieve data . /1405533176.Didn't retrieve data . /1405533175.Didn't retrieve data . /1405533173.Didn't retrieve data . /1405533171.Didn't retrieve data . /1405533170.Didn't retrieve data . /1405533154.Didn't retrieve data . /1405533146.Didn't retrieve data . /1405533143.Didn't retrieve data . /1405533124.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533179', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533178', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533177', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533176', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533175', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533173', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533171', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533170', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533154', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533146', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533143', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533124', None, None, None, None, None, '4335449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.0154876708984375 save_final save missing photos in datou_result : time spend for datou_step_exec : 74.43547296524048 time spend to save output : 0.015933752059936523 total time spend for step 3 : 74.45140671730042 step4:ventilate_hashtags_in_portfolio Mon Jan 26 09:13:51 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30213190 get user id for portfolio 30213190 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30213190 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','environnement','papier','metal','flou','pet_fonce','pet_clair','autre','pehd','carton','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30213190 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','environnement','papier','metal','flou','pet_fonce','pet_clair','autre','pehd','carton','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30213190 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','environnement','papier','metal','flou','pet_fonce','pet_clair','autre','pehd','carton','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30213564,30213565,30213566,30213567,30213568,30213569,30213570,30213571,30213572,30213573,30213574?tags=mal_croppe,environnement,papier,metal,flou,pet_fonce,pet_clair,autre,pehd,carton,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1405533179, 1405533178, 1405533177, 1405533176, 1405533175, 1405533173, 1405533171, 1405533170, 1405533154, 1405533146, 1405533143, 1405533124] Looping around the photos to save general results len do output : 1 /30213190. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533179', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533178', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533177', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533176', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533175', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533173', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533171', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533170', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533154', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533146', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533143', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533124', None, None, None, None, None, '4335449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.0178678035736084 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9377222061157227 time spend to save output : 0.018163442611694336 total time spend for step 4 : 1.955885648727417 step5:final Mon Jan 26 09:13:53 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1405533179: ('0.04418404787165636',), 1405533178: ('0.04418404787165636',), 1405533177: ('0.04418404787165636',), 1405533176: ('0.04418404787165636',), 1405533175: ('0.04418404787165636',), 1405533173: ('0.04418404787165636',), 1405533171: ('0.04418404787165636',), 1405533170: ('0.04418404787165636',), 1405533154: ('0.04418404787165636',), 1405533146: ('0.04418404787165636',), 1405533143: ('0.04418404787165636',), 1405533124: ('0.04418404787165636',)} new output for save of step final : {1405533179: ('0.04418404787165636',), 1405533178: ('0.04418404787165636',), 1405533177: ('0.04418404787165636',), 1405533176: ('0.04418404787165636',), 1405533175: ('0.04418404787165636',), 1405533173: ('0.04418404787165636',), 1405533171: ('0.04418404787165636',), 1405533170: ('0.04418404787165636',), 1405533154: ('0.04418404787165636',), 1405533146: ('0.04418404787165636',), 1405533143: ('0.04418404787165636',), 1405533124: ('0.04418404787165636',)} [1405533179, 1405533178, 1405533177, 1405533176, 1405533175, 1405533173, 1405533171, 1405533170, 1405533154, 1405533146, 1405533143, 1405533124] Looping around the photos to save general results len do output : 12 /1405533179.Didn't retrieve data . /1405533178.Didn't retrieve data . /1405533177.Didn't retrieve data . /1405533176.Didn't retrieve data . /1405533175.Didn't retrieve data . /1405533173.Didn't retrieve data . /1405533171.Didn't retrieve data . /1405533170.Didn't retrieve data . /1405533154.Didn't retrieve data . /1405533146.Didn't retrieve data . /1405533143.Didn't retrieve data . /1405533124.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533179', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533178', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533177', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533176', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533175', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533173', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533171', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533170', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533154', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533146', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533143', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533124', None, None, None, None, None, '4335449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.01786947250366211 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14167189598083496 time spend to save output : 0.018308639526367188 total time spend for step 5 : 0.15998053550720215 step6:blur_detection Mon Jan 26 09:13:53 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556.jpg resize: (2160, 3840) 1405533179 -6.35779637555302 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0.jpg resize: (2160, 3840) 1405533178 -6.435452847617301 treat image : temp/1769415030_1395259_1405533177_99e5a1dc85ef0337c12da46ae223bf87.jpg resize: (2160, 3840) 1405533177 -6.770646986657616 treat image : temp/1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac.jpg resize: (2160, 3840) 1405533176 -6.400007739714555 treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d.jpg resize: (2160, 3840) 1405533175 -6.9380126702286 treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff.jpg resize: (2160, 3840) 1405533173 -7.000495028432958 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e.jpg resize: (2160, 3840) 1405533171 -7.105883715923746 treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf.jpg resize: (2160, 3840) 1405533170 -6.737257146362756 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972.jpg resize: (2160, 3840) 1405533154 -6.689655521435716 treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e.jpg resize: (2160, 3840) 1405533146 -7.038965032040771 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55.jpg resize: (2160, 3840) 1405533143 -6.981046097726744 treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749.jpg resize: (2160, 3840) 1405533124 -6.154335331523991 treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498103_0.png resize: (422, 569) 1405538784 -4.261349744744997 treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498107_0.png resize: (224, 140) 1405538785 -3.146654291354004 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498110_0.png resize: (221, 277) 1405538786 -3.4433543305133085 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498112_0.png resize: (135, 151) 1405538787 -4.49429980991203 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498113_0.png resize: (136, 193) 1405538788 -4.4307808156209045 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498114_0.png resize: (190, 152) 1405538789 -3.628428206704069 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498117_0.png resize: (488, 177) 1405538790 -3.8077325028408557 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498118_0.png resize: (199, 211) 1405538791 -4.398427879337863 treat image : temp/1769415030_1395259_1405533177_99e5a1dc85ef0337c12da46ae223bf87_rle_crop_4112498119_0.png resize: (297, 533) 1405538792 -3.283519462011885 treat image : temp/1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac_rle_crop_4112498120_0.png resize: (300, 357) 1405538793 -4.450995043677772 treat image : temp/1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac_rle_crop_4112498122_0.png resize: (238, 65) 1405538794 -4.346731966174906 treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498123_0.png resize: (184, 138) 1405538795 -4.21090706721431 treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498128_0.png resize: (327, 414) 1405538796 -3.935199240208615 treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498129_0.png resize: (242, 192) 1405538797 -3.8366150239158934 treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498130_0.png resize: (256, 303) 1405538798 -4.941660358142543 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498136_0.png resize: (296, 486) 1405538799 -5.530086006336683 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498138_0.png resize: (175, 145) 1405538800 -4.3780582992396635 treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498143_0.png resize: (443, 243) 1405538801 -4.172349955325338 treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498144_0.png resize: (250, 194) 1405538802 -3.757569378252008 treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498146_0.png resize: (406, 139) 1405538803 -4.8816263314022645 treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498147_0.png resize: (252, 98) 1405538804 -4.779895393546931 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498150_0.png resize: (504, 253) 1405538805 -5.283731183445071 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498154_0.png resize: (202, 143) 1405538807 -3.4774013857279154 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498156_0.png resize: (508, 403) 1405538808 -5.193051051226955 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498158_0.png resize: (432, 295) 1405538809 -2.6787391693755267 treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498159_0.png resize: (207, 324) 1405538810 -3.7171738458678547 treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498160_0.png resize: (130, 111) 1405538811 -4.095012770865694 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498164_0.png resize: (110, 74) 1405538812 -2.080016374633831 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498171_0.png resize: (300, 241) 1405538813 -5.7679916010532555 treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498176_0.png resize: (182, 136) 1405538814 -2.4393652110384263 treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498105_0.png resize: (381, 246) 1405538815 -4.310887880116893 treat image : temp/1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac_rle_crop_4112498121_0.png resize: (191, 195) 1405538816 -3.7565098243030004 treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498126_0.png resize: (172, 196) 1405538817 -3.9537176102839897 treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498132_0.png resize: (176, 173) 1405538818 -3.270856215501327 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498139_0.png resize: (143, 199) 1405538819 -4.093743409461239 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498149_0.png resize: (220, 219) 1405538820 -2.904754122734734 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498151_0.png resize: (228, 192) 1405538821 -3.5249829883443327 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498153_0.png resize: (156, 216) 1405538822 -2.84167772987366 treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498179_0.png resize: (189, 125) 1405538823 -4.931587696081515 treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498109_0.png resize: (271, 139) 1405538824 -5.1128354433365635 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498133_0.png resize: (165, 131) 1405538826 -4.835732452685751 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498134_0.png resize: (109, 104) 1405538827 -4.588701366654877 treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498102_0.png resize: (445, 406) 1405538969 -3.7870177000355096 treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498106_0.png resize: (395, 110) 1405538970 -5.178203741697956 treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498108_0.png resize: (85, 116) 1405538971 -4.22582839258926 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498111_0.png resize: (152, 210) 1405538973 -5.276199298322719 treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498124_0.png resize: (610, 874) 1405538974 -4.517791758365214 treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498125_0.png resize: (242, 691) 1405538976 -3.4095216376668036 treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498127_0.png resize: (392, 214) 1405538978 -5.071718819927521 treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498131_0.png resize: (161, 265) 1405538979 -4.198162616767308 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498135_0.png resize: (481, 632) 1405538981 -4.93427233943442 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498137_0.png resize: (309, 535) 1405538982 -5.506061467847256 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498140_0.png resize: (488, 415) 1405538983 -5.6285628276502875 treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498141_0.png resize: (249, 307) 1405538985 -4.985822787080817 treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498142_0.png resize: (478, 724) 1405538986 -3.069046133772023 treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498145_0.png resize: (83, 125) 1405538987 -3.7783101275820536 treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498148_0.png resize: (397, 323) 1405538989 -4.486813744060117 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498152_0.png resize: (438, 429) 1405538990 -3.973024892717555 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498157_0.png resize: (342, 296) 1405538992 -5.173512769214002 treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498161_0.png resize: (460, 335) 1405538993 -5.249618244962678 treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498162_0.png resize: (345, 506) 1405538995 -6.0036806940008605 treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498163_0.png resize: (234, 274) 1405538996 -4.483860576520467 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498165_0.png resize: (383, 215) 1405538997 -5.519583516813041 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498166_0.png resize: (527, 329) 1405538999 -4.811037103755344 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498167_0.png resize: (514, 184) 1405539000 -4.127690061591551 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498168_0.png resize: (166, 184) 1405539001 -3.608982013947267 treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498173_0.png resize: (297, 289) 1405539003 -5.858283904869981 treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498174_0.png resize: (381, 528) 1405539004 -5.2837295721413 treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498175_0.png resize: (242, 195) 1405539005 -4.6898321120283075 treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498177_0.png resize: (212, 207) 1405539007 -5.427413697079922 treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498104_0.png resize: (189, 171) 1405539017 -4.455318278583454 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498116_0.png resize: (182, 164) 1405539018 -4.723728845135176 treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498155_0.png resize: (150, 110) 1405539019 -3.362194507395122 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498169_0.png resize: (123, 158) 1405539020 -2.251392745120644 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498170_0.png resize: (336, 113) 1405539021 -4.734229580215005 treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498172_0.png resize: (255, 214) 1405539022 -2.161893327756219 treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498115_0.png resize: (331, 225) 1405539023 -5.788611090172831 treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498178_0.png resize: (104, 282) 1405539024 -5.3144463444704195 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.019024133682250977 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.02705526351928711 save missing photos in datou_result : time spend for datou_step_exec : 47.74113368988037 time spend to save output : 0.05229830741882324 total time spend for step 6 : 47.793431997299194 step7:brightness Mon Jan 26 09:14:40 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556.jpg treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0.jpg treat image : temp/1769415030_1395259_1405533177_99e5a1dc85ef0337c12da46ae223bf87.jpg treat image : temp/1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac.jpg treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d.jpg treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff.jpg treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e.jpg treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf.jpg treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972.jpg treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e.jpg treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55.jpg treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749.jpg treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498103_0.png treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498107_0.png treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498110_0.png treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498112_0.png treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498113_0.png treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498114_0.png treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498117_0.png treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498118_0.png treat image : temp/1769415030_1395259_1405533177_99e5a1dc85ef0337c12da46ae223bf87_rle_crop_4112498119_0.png treat image : temp/1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac_rle_crop_4112498120_0.png treat image : temp/1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac_rle_crop_4112498122_0.png treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498123_0.png treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498128_0.png treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498129_0.png treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498130_0.png treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498136_0.png treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498138_0.png treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498143_0.png treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498144_0.png treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498146_0.png treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498147_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498150_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498154_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498156_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498158_0.png treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498159_0.png treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498160_0.png treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498164_0.png treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498171_0.png treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498176_0.png treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498105_0.png treat image : temp/1769415030_1395259_1405533176_b746a2dc41e6ad56a6c2fbaaf1dc30ac_rle_crop_4112498121_0.png treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498126_0.png treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498132_0.png treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498139_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498149_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498151_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498153_0.png treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498179_0.png treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498109_0.png treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498133_0.png treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498134_0.png treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498102_0.png treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498106_0.png treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498108_0.png treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498111_0.png treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498124_0.png treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498125_0.png treat image : temp/1769415030_1395259_1405533175_5dfb620542a7cad5cd6475738d2b7a8d_rle_crop_4112498127_0.png treat image : temp/1769415030_1395259_1405533173_8e33ae97df54f0b738e6b2d5700355ff_rle_crop_4112498131_0.png treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498135_0.png treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498137_0.png treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498140_0.png treat image : temp/1769415030_1395259_1405533171_8e5be1eac953e103c4d00137def0cf9e_rle_crop_4112498141_0.png treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498142_0.png treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498145_0.png treat image : temp/1769415030_1395259_1405533170_675e9f2c094e7c47d14d694ada240abf_rle_crop_4112498148_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498152_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498157_0.png treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498161_0.png treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498162_0.png treat image : temp/1769415030_1395259_1405533146_e48dfe06f228537f62a776079dd2ac8e_rle_crop_4112498163_0.png treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498165_0.png treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498166_0.png treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498167_0.png treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498168_0.png treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498173_0.png treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498174_0.png treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498175_0.png treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498177_0.png treat image : temp/1769415030_1395259_1405533179_6d5efab3adb82d90325fa545932a8556_rle_crop_4112498104_0.png treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498116_0.png treat image : temp/1769415030_1395259_1405533154_91e8f88cd389c1c452018f523d9b0972_rle_crop_4112498155_0.png treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498169_0.png treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498170_0.png treat image : temp/1769415030_1395259_1405533143_cb33ca5c407a0a4efca3a6e2b0e97f55_rle_crop_4112498172_0.png treat image : temp/1769415030_1395259_1405533178_753c8e2707eedc83fccb56400c59b5a0_rle_crop_4112498115_0.png treat image : temp/1769415030_1395259_1405533124_3452c69413d3f262741ad095bfbef749_rle_crop_4112498178_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.03493452072143555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.025677204132080078 save missing photos in datou_result : time spend for datou_step_exec : 12.283660888671875 time spend to save output : 0.06636595726013184 total time spend for step 7 : 12.350026845932007 step8:velours_tree Mon Jan 26 09:14:53 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.11228537559509277 time spend to save output : 4.029273986816406e-05 total time spend for step 8 : 0.11232566833496094 step9:send_mail_cod Mon Jan 26 09:14:53 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30213190_26-01-2026_09_14_53.pdf 30213564 imagette302135641769415293 30213566 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette302135661769415293 30213567 change filename to text .change filename to text .change filename to text .imagette302135671769415295 30213568 imagette302135681769415295 30213569 change filename to text .change filename to text .imagette302135691769415295 30213570 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette302135701769415295 30213571 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette302135711769415297 30213572 imagette302135721769415298 30213573 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette302135731769415298 30213574 imagette302135741769415299 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30213190 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30213564,30213565,30213566,30213567,30213568,30213569,30213570,30213571,30213572,30213573,30213574?tags=mal_croppe,environnement,papier,metal,flou,pet_fonce,pet_clair,autre,pehd,carton,background your option no_mail is active, we will not send the real mail to your client args[1405533179] : ((1405533179, -6.35779637555302, 492609224), (1405533179, -0.39053301115263883, 496442774), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533178] : ((1405533178, -6.435452847617301, 492609224), (1405533178, -0.5336194783593423, 501862349), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533177] : ((1405533177, -6.770646986657616, 492609224), (1405533177, -0.3150185090526591, 496442774), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533176] : ((1405533176, -6.400007739714555, 492609224), (1405533176, -0.3060112274895801, 496442774), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533175] : ((1405533175, -6.9380126702286, 492609224), (1405533175, -0.16905279281205018, 496442774), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533173] : ((1405533173, -7.000495028432958, 492609224), (1405533173, -0.27330997763707043, 496442774), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533171] : ((1405533171, -7.105883715923746, 492609224), (1405533171, -0.04395526442155728, 2107752395), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533170] : ((1405533170, -6.737257146362756, 492609224), (1405533170, -0.09527216875071874, 496442774), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533154] : ((1405533154, -6.689655521435716, 492609224), (1405533154, -0.43627985574554357, 496442774), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533146] : ((1405533146, -7.038965032040771, 492609224), (1405533146, -0.3012469032893552, 496442774), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533143] : ((1405533143, -6.981046097726744, 492609224), (1405533143, -0.3175832581898115, 496442774), '0.04418404787165636') We are sending mail with results at report@fotonower.com args[1405533124] : ((1405533124, -6.154335331523991, 492609224), (1405533124, -1.0445765127029087, 501862349), '0.04418404787165636') We are sending mail with results at report@fotonower.com refus_total : 0.04418404787165636 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30213190 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30213190_26-01-2026_09_14_53.pdf results_Auto_P30213190_26-01-2026_09_14_53.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30213190_26-01-2026_09_14_53.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30213190','results_Auto_P30213190_26-01-2026_09_14_53.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30213190_26-01-2026_09_14_53.pdf','pdf','','0.81','0.04418404787165636') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1405533179, 1405533178, 1405533177, 1405533176, 1405533175, 1405533173, 1405533171, 1405533170, 1405533154, 1405533146, 1405533143, 1405533124] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533179', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533178', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533177', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533176', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533175', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533173', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533171', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533170', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533154', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533146', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533143', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533124', None, None, None, None, None, '4335449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016232967376708984 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.208889961242676 time spend to save output : 0.016640186309814453 total time spend for step 9 : 8.22553014755249 step10:split_time_score Mon Jan 26 09:15:01 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26012026 30213190 Nombre de photos uploadées : 12 / 23040 (0%) 26012026 30213190 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 26012026 30213190 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008461475372314453 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24271893501281738 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07853695485413846 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30211971_26-01-2026_07_05_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30211971 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30211971 AND mptpi.`type`=3726 To do Qualite : 0.04418404787165636 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30213190_26-01-2026_09_14_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30213190 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30213190 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26012026': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1405533179, 1405533178, 1405533177, 1405533176, 1405533175, 1405533173, 1405533171, 1405533170, 1405533154, 1405533146, 1405533143, 1405533124] Looping around the photos to save general results len do output : 1 /30213190Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533179', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533178', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533177', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533176', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533175', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533173', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533171', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533170', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533154', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533146', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533143', None, None, None, None, None, '4335449') ('3318', None, None, None, None, None, None, None, '4335449') ('3318', '30213190', '1405533124', None, None, None, None, None, '4335449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.019453048706054688 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6043806076049805 time spend to save output : 0.019656658172607422 total time spend for step 10 : 0.6240372657775879 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 114.96user 127.19system 4:36.52elapsed 87%CPU (0avgtext+0avgdata 4487836maxresident)k 57840inputs+117536outputs (2729major+10882395minor)pagefaults 0swaps