python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1876288 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4332974'] with mtr_portfolio_ids : ['30164735'] and first list_photo_ids : [] new path : /proc/1876288/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.2754096984863281 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Jan 20 15:10:31 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3177 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-20 15:10:35.483968: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-20 15:10:35.514637: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-20 15:10:35.516944: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f92a4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-20 15:10:35.516997: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-20 15:10:35.521705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-20 15:10:35.782512: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x20d25090 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-20 15:10:35.782561: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-20 15:10:35.783976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-20 15:10:35.785787: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-20 15:10:35.816596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-20 15:10:35.835151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-20 15:10:35.839157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-20 15:10:35.869457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-20 15:10:35.874550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-20 15:10:35.931578: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-20 15:10:35.933227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-20 15:10:35.933621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-20 15:10:35.934986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-20 15:10:35.935007: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-20 15:10:35.935018: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-20 15:10:35.936569: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2725 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-20 15:10:36.356278: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-20 15:10:36.356378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-20 15:10:36.356403: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-20 15:10:36.356426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-20 15:10:36.356449: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-20 15:10:36.356471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-20 15:10:36.356492: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-20 15:10:36.356514: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-20 15:10:36.357539: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-20 15:10:36.358621: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-20 15:10:36.358662: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-20 15:10:36.358684: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-20 15:10:36.358704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-20 15:10:36.358724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-20 15:10:36.358744: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-20 15:10:36.358763: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-20 15:10:36.358783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-20 15:10:36.359842: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-20 15:10:36.359871: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-20 15:10:36.359882: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-20 15:10:36.359892: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-20 15:10:36.360958: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2725 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-20 15:10:48.683848: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-20 15:10:49.047480: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-20 15:10:50.916244: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.916351: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:50.916987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.917023: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:50.925069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.925105: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:50.925714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.925738: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:50.932856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.932900: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:50.933518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.933542: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:50.965986: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.966045: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:50.966905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.966933: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:50.972856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.972878: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:50.973410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:50.973425: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-20 15:10:51.008679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.009254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.011133: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.011703: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.055570: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.056132: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.058375: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.058965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.086211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.086897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.088402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.088950: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.096054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.096608: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.098251: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.098844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.104450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.104999: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.106612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.107202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.133825: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.134443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.135034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.135620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.139600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.140158: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.156709: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.157266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.157830: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.158443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.171358: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.171910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.172453: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.172994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.177245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.177796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.182241: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.182817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.194581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.195138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.199177: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.199729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.200276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.200824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.201529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.202080: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.212661: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.213207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.213762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.214319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.214862: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.215403: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.230019: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.230574: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.295627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.296269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.317559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.318150: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.318719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.319270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.338195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.338761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.339305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.339845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.341407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.341424: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2026-01-20 15:10:51.351150: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.351754: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.360756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.361349: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.361902: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.362459: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.363012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-20 15:10:51.363552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 1876620 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 791 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1984 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [606, 888, 1176, 1290] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0035431385040283203 nb_pixel_total : 108876 time to create 1 rle with old method : 0.12731170654296875 length of segment : 475 DEBUG bbox = [1188, 1506, 1392, 1722] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005846023559570312 nb_pixel_total : 30077 time to create 1 rle with old method : 0.03647875785827637 length of segment : 200 DEBUG bbox = [222, 2586, 474, 2838] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006229877471923828 nb_pixel_total : 32601 time to create 1 rle with old method : 0.03938937187194824 length of segment : 230 DEBUG bbox = [1674, 1170, 2034, 1452] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012176036834716797 nb_pixel_total : 66106 time to create 1 rle with old method : 0.07231640815734863 length of segment : 309 DEBUG bbox = [18, 2148, 108, 2358] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024580955505371094 nb_pixel_total : 13567 time to create 1 rle with old method : 0.01570582389831543 length of segment : 90 DEBUG bbox = [1680, 1146, 2004, 1458] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008983612060546875 nb_pixel_total : 65126 time to create 1 rle with old method : 0.07401084899902344 length of segment : 301 DEBUG bbox = [486, 1374, 756, 1806] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001142740249633789 nb_pixel_total : 53089 time to create 1 rle with old method : 0.06165647506713867 length of segment : 217 DEBUG bbox = [1596, 3024, 2010, 3234] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009732246398925781 nb_pixel_total : 35733 time to create 1 rle with old method : 0.038068294525146484 length of segment : 373 DEBUG bbox = [1542, 978, 1704, 1338] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005578994750976562 nb_pixel_total : 32450 time to create 1 rle with old method : 0.03680777549743652 length of segment : 152 DEBUG bbox = [492, 306, 678, 438] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003440380096435547 nb_pixel_total : 15219 time to create 1 rle with old method : 0.017208099365234375 length of segment : 156 DEBUG bbox = [1572, 3114, 1746, 3282] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 18170 time to create 1 rle with old method : 0.020257234573364258 length of segment : 160 DEBUG bbox = [1674, 792, 1866, 1014] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004355907440185547 nb_pixel_total : 24228 time to create 1 rle with old method : 0.027327775955200195 length of segment : 188 DEBUG bbox = [534, 1200, 1248, 1938] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00577092170715332 nb_pixel_total : 177212 time to create 1 rle with new method : 0.026675939559936523 length of segment : 642 DEBUG bbox = [1722, 312, 2088, 558] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013434886932373047 nb_pixel_total : 61197 time to create 1 rle with old method : 0.06706762313842773 length of segment : 401 DEBUG bbox = [636, 2034, 798, 2220] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004343986511230469 nb_pixel_total : 16784 time to create 1 rle with old method : 0.01889204978942871 length of segment : 150 DEBUG bbox = [1788, 510, 2118, 780] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009305477142333984 nb_pixel_total : 50863 time to create 1 rle with old method : 0.059874534606933594 length of segment : 314 DEBUG bbox = [1632, 876, 2136, 1386] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002658843994140625 nb_pixel_total : 172568 time to create 1 rle with new method : 0.008229970932006836 length of segment : 483 DEBUG bbox = [1140, 2946, 1344, 3048] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00028443336486816406 nb_pixel_total : 12852 time to create 1 rle with old method : 0.014092206954956055 length of segment : 194 DEBUG bbox = [1194, 1170, 1524, 1416] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000789642333984375 nb_pixel_total : 41859 time to create 1 rle with old method : 0.04975461959838867 length of segment : 286 DEBUG bbox = [642, 2802, 1236, 3102] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036287307739257812 nb_pixel_total : 94551 time to create 1 rle with old method : 0.10620570182800293 length of segment : 636 DEBUG bbox = [798, 2298, 1410, 2436] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002367734909057617 nb_pixel_total : 59192 time to create 1 rle with old method : 0.06636691093444824 length of segment : 541 DEBUG bbox = [156, 612, 402, 774] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010528564453125 nb_pixel_total : 25987 time to create 1 rle with old method : 0.029668807983398438 length of segment : 226 DEBUG bbox = [1092, 1692, 1548, 2118] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036525726318359375 nb_pixel_total : 92698 time to create 1 rle with old method : 0.10568380355834961 length of segment : 616 DEBUG bbox = [6, 240, 612, 1056] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00855708122253418 nb_pixel_total : 224493 time to create 1 rle with new method : 0.01881718635559082 length of segment : 588 DEBUG bbox = [552, 240, 1038, 684] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0034279823303222656 nb_pixel_total : 108263 time to create 1 rle with old method : 0.13230562210083008 length of segment : 425 DEBUG bbox = [66, 156, 396, 294] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009355545043945312 nb_pixel_total : 22937 time to create 1 rle with old method : 0.025849342346191406 length of segment : 324 DEBUG bbox = [1812, 408, 2154, 864] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002305746078491211 nb_pixel_total : 100646 time to create 1 rle with old method : 0.1088571548461914 length of segment : 333 DEBUG bbox = [756, 1902, 1236, 2082] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017654895782470703 nb_pixel_total : 52801 time to create 1 rle with old method : 0.05754375457763672 length of segment : 406 DEBUG bbox = [420, 1356, 846, 1806] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002660989761352539 nb_pixel_total : 83856 time to create 1 rle with old method : 0.09203267097473145 length of segment : 373 DEBUG bbox = [1326, 1380, 1596, 1536] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009341239929199219 nb_pixel_total : 22904 time to create 1 rle with old method : 0.025307893753051758 length of segment : 263 DEBUG bbox = [2028, 1572, 2154, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006048679351806641 nb_pixel_total : 14936 time to create 1 rle with old method : 0.01761484146118164 length of segment : 122 DEBUG bbox = [54, 1044, 228, 1170] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004420280456542969 nb_pixel_total : 8171 time to create 1 rle with old method : 0.009217977523803711 length of segment : 173 DEBUG bbox = [666, 312, 906, 516] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011162757873535156 nb_pixel_total : 15472 time to create 1 rle with old method : 0.01710963249206543 length of segment : 202 DEBUG bbox = [1530, 1806, 1656, 1908] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004127025604248047 nb_pixel_total : 9000 time to create 1 rle with old method : 0.01059865951538086 length of segment : 119 DEBUG bbox = [1740, 1032, 2160, 1632] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004808902740478516 nb_pixel_total : 152913 time to create 1 rle with new method : 0.010248184204101562 length of segment : 376 DEBUG bbox = [1602, 2430, 2106, 2754] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003207683563232422 nb_pixel_total : 85493 time to create 1 rle with old method : 0.09394240379333496 length of segment : 474 DEBUG bbox = [234, 2682, 432, 2808] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006422996520996094 nb_pixel_total : 11780 time to create 1 rle with old method : 0.013591766357421875 length of segment : 153 DEBUG bbox = [336, 636, 594, 882] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001195669174194336 nb_pixel_total : 30065 time to create 1 rle with old method : 0.03331494331359863 length of segment : 261 DEBUG bbox = [780, 456, 1194, 966] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0027265548706054688 nb_pixel_total : 127655 time to create 1 rle with old method : 0.14166569709777832 length of segment : 436 DEBUG bbox = [1368, 1626, 1554, 1788] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005438327789306641 nb_pixel_total : 20161 time to create 1 rle with old method : 0.022670269012451172 length of segment : 162 DEBUG bbox = [264, 618, 1002, 1344] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.01633453369140625 nb_pixel_total : 313738 time to create 1 rle with new method : 0.02382683753967285 length of segment : 714 DEBUG bbox = [1134, 780, 1530, 1026] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015041828155517578 nb_pixel_total : 39836 time to create 1 rle with old method : 0.04473137855529785 length of segment : 346 DEBUG bbox = [96, 486, 576, 942] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0032520294189453125 nb_pixel_total : 126719 time to create 1 rle with old method : 0.1427903175354004 length of segment : 474 DEBUG bbox = [24, 0, 594, 186] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023589134216308594 nb_pixel_total : 51126 time to create 1 rle with old method : 0.05768942832946777 length of segment : 478 DEBUG bbox = [84, 1164, 336, 1566] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001486063003540039 nb_pixel_total : 50484 time to create 1 rle with old method : 0.057952880859375 length of segment : 358 DEBUG bbox = [1920, 486, 2160, 846] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013704299926757812 nb_pixel_total : 50610 time to create 1 rle with old method : 0.05798792839050293 length of segment : 234 DEBUG bbox = [1710, 1458, 1890, 1698] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007202625274658203 nb_pixel_total : 22301 time to create 1 rle with old method : 0.025307178497314453 length of segment : 161 DEBUG bbox = [1476, 1536, 1770, 1962] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017256736755371094 nb_pixel_total : 63953 time to create 1 rle with old method : 0.07338619232177734 length of segment : 256 DEBUG bbox = [18, 2208, 156, 2406] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005323886871337891 nb_pixel_total : 18714 time to create 1 rle with old method : 0.020926713943481445 length of segment : 127 DEBUG bbox = [864, 1296, 1170, 1602] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013616085052490234 nb_pixel_total : 45933 time to create 1 rle with old method : 0.05086255073547363 length of segment : 248 DEBUG bbox = [714, 1080, 846, 1362] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006000995635986328 nb_pixel_total : 21864 time to create 1 rle with old method : 0.02425861358642578 length of segment : 116 DEBUG bbox = [1884, 1416, 2148, 1596] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007882118225097656 nb_pixel_total : 28841 time to create 1 rle with old method : 0.032233476638793945 length of segment : 259 DEBUG bbox = [1350, 1542, 1548, 1794] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007076263427734375 nb_pixel_total : 18385 time to create 1 rle with old method : 0.02116990089416504 length of segment : 180 DEBUG bbox = [1410, 348, 1878, 858] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003477334976196289 nb_pixel_total : 144606 time to create 1 rle with old method : 0.15851831436157227 length of segment : 556 DEBUG bbox = [1260, 1248, 1488, 1500] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006239414215087891 nb_pixel_total : 18789 time to create 1 rle with old method : 0.021231889724731445 length of segment : 193 DEBUG bbox = [1116, 894, 1296, 1092] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006000995635986328 nb_pixel_total : 25021 time to create 1 rle with old method : 0.029249191284179688 length of segment : 178 DEBUG bbox = [1836, 660, 2148, 1404] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002821683883666992 nb_pixel_total : 148974 time to create 1 rle with old method : 0.16115689277648926 length of segment : 285 DEBUG bbox = [1494, 846, 1740, 1044] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 22655 time to create 1 rle with old method : 0.02519989013671875 length of segment : 224 time spent for convertir_results : 5.734785795211792 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 58 chid ids of type : 3594 Number RLEs to save : 17917 save missing photos in datou_result : time spend for datou_step_exec : 65.65889143943787 time spend to save output : 1.137803077697754 total time spend for step 1 : 66.79669451713562 step2:crop_condition Tue Jan 20 15:11:38 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 58 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3736932 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768918306_1876288 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075189_0.png', 0, 354, 469, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075196_0.png', 0, 180, 373, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075197_0.png', 0, 356, 146, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075198_0.png', 0, 127, 155, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075207_0.png', 0, 235, 241, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075209_0.png', 0, 136, 537, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075210_0.png', 0, 143, 226, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075212_0.png', 0, 767, 481, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075213_0.png', 0, 436, 425, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075218_0.png', 0, 139, 263, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075219_0.png', 0, 203, 122, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075220_0.png', 0, 113, 171, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075225_0.png', 0, 103, 153, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075226_0.png', 0, 238, 252, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075227_0.png', 0, 495, 339, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075230_0.png', 0, 224, 337, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075232_0.png', 0, 166, 478, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075235_0.png', 0, 203, 158, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075238_0.png', 0, 286, 247, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075240_0.png', 0, 175, 259, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075241_0.png', 0, 212, 180, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075242_0.png', 0, 483, 423, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075243_0.png', 0, 224, 193, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075244_0.png', 0, 193, 178, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918312), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075246_0.png', 0, 164, 220, 0, 1768918312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 25 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.195827960968018 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768918317_1876288 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918318), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075199_0.png', 0, 165, 160, 0, 1768918318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918318), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075206_0.png', 0, 97, 193, 0, 1768918318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918318), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075208_0.png', 0, 285, 486, 0, 1768918318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918318), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075214_0.png', 0, 114, 324, 0, 1768918318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918318), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075221_0.png', 0, 179, 202, 0, 1768918318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918318), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075229_0.png', 0, 700, 679, 0, 1768918318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9274353981018066 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768918320_1876288 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918321), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075190_0.png', 0, 193, 200, 0, 1768918321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918321), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075193_0.png', 0, 176, 90, 0, 1768918321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918321), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075237_0.png', 0, 185, 123, 0, 1768918321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0953865051269531 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3736932 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768918330_1876288 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075191_0.png', 0, 202, 230, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075192_0.png', 0, 260, 308, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075195_0.png', 0, 344, 203, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075200_0.png', 0, 208, 178, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075201_0.png', 0, 517, 659, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075202_0.png', 0, 241, 351, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075203_0.png', 0, 162, 150, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075204_0.png', 0, 244, 289, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075205_0.png', 0, 494, 477, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075211_0.png', 0, 403, 399, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075215_0.png', 0, 384, 331, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075216_0.png', 0, 171, 406, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075217_0.png', 0, 420, 330, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075223_0.png', 0, 531, 364, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075224_0.png', 0, 266, 467, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075231_0.png', 0, 421, 474, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075233_0.png', 0, 376, 234, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075234_0.png', 0, 330, 231, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075239_0.png', 0, 266, 111, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918333), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075245_0.png', 0, 735, 234, 0, 1768918333,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 20 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.939212322235107 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768918336_1876288 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918337), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075222_0.png', 0, 93, 119, 0, 1768918337,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918337), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075228_0.png', 0, 158, 162, 0, 1768918337,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918337), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075236_0.png', 0, 381, 251, 0, 1768918337,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0631413459777832 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768918339_1876288 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768918339), 0.0, 0.0, 14, '', 0, 0, '1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075194_0.png', 0, 261, 300, 0, 1768918339,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6876165866851807 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1404708497, 1404708495, 1404708494, 1404708493, 1404708492, 1404708436, 1404708435] Looping around the photos to save general results len do output : 58 /1404711500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1404711608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708497', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708495', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708494', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708493', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708492', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708436', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708435', None, None, None, None, None, '4332974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 181 time used for this insertion : 0.03633236885070801 save_final save missing photos in datou_result : time spend for datou_step_exec : 40.97830891609192 time spend to save output : 0.03877878189086914 total time spend for step 2 : 41.01708769798279 step3:rle_unique_nms_with_priority Tue Jan 20 15:12:19 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 58 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 4.236732006072998 time for calcul the mask position with numpy : 1.29087233543396 nb_pixel_total : 8042377 time to create 1 rle with new method : 1.5889596939086914 time for calcul the mask position with numpy : 0.026807069778442383 nb_pixel_total : 796 time to create 1 rle with old method : 0.001132965087890625 time for calcul the mask position with numpy : 0.02574634552001953 nb_pixel_total : 13567 time to create 1 rle with old method : 0.015172958374023438 time for calcul the mask position with numpy : 0.02502298355102539 nb_pixel_total : 66106 time to create 1 rle with old method : 0.07407641410827637 time for calcul the mask position with numpy : 0.026057004928588867 nb_pixel_total : 32601 time to create 1 rle with old method : 0.03673410415649414 time for calcul the mask position with numpy : 0.02822422981262207 nb_pixel_total : 30077 time to create 1 rle with old method : 0.07285428047180176 time for calcul the mask position with numpy : 0.05628705024719238 nb_pixel_total : 108876 time to create 1 rle with old method : 0.13490772247314453 create new chi : 3.4411027431488037 time to delete rle : 0.021407604217529297 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5068 TO DO : save crop sub photo not yet done ! save time : 0.36243343353271484 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 8.905888319015503 time for calcul the mask position with numpy : 0.774939775466919 nb_pixel_total : 7152407 time to create 1 rle with new method : 1.005946397781372 time for calcul the mask position with numpy : 0.026230573654174805 nb_pixel_total : 200300 time to create 1 rle with new method : 0.8733494281768799 time for calcul the mask position with numpy : 0.02973341941833496 nb_pixel_total : 92698 time to create 1 rle with old method : 0.10244870185852051 time for calcul the mask position with numpy : 0.02643299102783203 nb_pixel_total : 25987 time to create 1 rle with old method : 0.028864622116088867 time for calcul the mask position with numpy : 0.027200937271118164 nb_pixel_total : 59192 time to create 1 rle with old method : 0.06562924385070801 time for calcul the mask position with numpy : 0.026211977005004883 nb_pixel_total : 94171 time to create 1 rle with old method : 0.10418581962585449 time for calcul the mask position with numpy : 0.027042150497436523 nb_pixel_total : 41859 time to create 1 rle with old method : 0.04671144485473633 time for calcul the mask position with numpy : 0.026571035385131836 nb_pixel_total : 12852 time to create 1 rle with old method : 0.01446843147277832 time for calcul the mask position with numpy : 0.02598261833190918 nb_pixel_total : 172568 time to create 1 rle with new method : 0.769474983215332 time for calcul the mask position with numpy : 0.026403427124023438 nb_pixel_total : 50652 time to create 1 rle with old method : 0.0564885139465332 time for calcul the mask position with numpy : 0.025348663330078125 nb_pixel_total : 16784 time to create 1 rle with old method : 0.01880478858947754 time for calcul the mask position with numpy : 0.02571558952331543 nb_pixel_total : 61197 time to create 1 rle with old method : 0.06835031509399414 time for calcul the mask position with numpy : 0.027364015579223633 nb_pixel_total : 135527 time to create 1 rle with old method : 0.1501755714416504 time for calcul the mask position with numpy : 0.026738643646240234 nb_pixel_total : 24228 time to create 1 rle with old method : 0.027055025100708008 time for calcul the mask position with numpy : 0.02460169792175293 nb_pixel_total : 17487 time to create 1 rle with old method : 0.019629716873168945 time for calcul the mask position with numpy : 0.02559638023376465 nb_pixel_total : 15219 time to create 1 rle with old method : 0.017029762268066406 time for calcul the mask position with numpy : 0.02582836151123047 nb_pixel_total : 32450 time to create 1 rle with old method : 0.03632831573486328 time for calcul the mask position with numpy : 0.026685476303100586 nb_pixel_total : 35733 time to create 1 rle with old method : 0.039658308029174805 time for calcul the mask position with numpy : 0.025334835052490234 nb_pixel_total : 53089 time to create 1 rle with old method : 0.05848240852355957 create new chi : 4.854112386703491 time to delete rle : 0.0015909671783447266 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14242 TO DO : save crop sub photo not yet done ! save time : 0.8716859817504883 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 4.242743253707886 time for calcul the mask position with numpy : 0.7313017845153809 nb_pixel_total : 7925897 time to create 1 rle with new method : 0.7899065017700195 time for calcul the mask position with numpy : 0.02982497215270996 nb_pixel_total : 83856 time to create 1 rle with old method : 0.11431336402893066 time for calcul the mask position with numpy : 0.03161764144897461 nb_pixel_total : 52801 time to create 1 rle with old method : 0.0668182373046875 time for calcul the mask position with numpy : 0.02869272232055664 nb_pixel_total : 100646 time to create 1 rle with old method : 0.12064337730407715 time for calcul the mask position with numpy : 0.02525186538696289 nb_pixel_total : 22937 time to create 1 rle with old method : 0.024091005325317383 time for calcul the mask position with numpy : 0.025246620178222656 nb_pixel_total : 108263 time to create 1 rle with old method : 0.11583471298217773 create new chi : 2.156409740447998 time to delete rle : 0.0011858940124511719 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 5882 TO DO : save crop sub photo not yet done ! save time : 0.4074728488922119 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 5.397522211074829 time for calcul the mask position with numpy : 0.9024147987365723 nb_pixel_total : 7943666 time to create 1 rle with new method : 1.319082498550415 time for calcul the mask position with numpy : 0.028152942657470703 nb_pixel_total : 30065 time to create 1 rle with old method : 0.03484153747558594 time for calcul the mask position with numpy : 0.02600550651550293 nb_pixel_total : 11780 time to create 1 rle with old method : 0.012738704681396484 time for calcul the mask position with numpy : 0.02467513084411621 nb_pixel_total : 85493 time to create 1 rle with old method : 0.08952975273132324 time for calcul the mask position with numpy : 0.02721238136291504 nb_pixel_total : 152913 time to create 1 rle with new method : 0.8389132022857666 time for calcul the mask position with numpy : 0.025974273681640625 nb_pixel_total : 9000 time to create 1 rle with old method : 0.009995222091674805 time for calcul the mask position with numpy : 0.023491621017456055 nb_pixel_total : 15472 time to create 1 rle with old method : 0.016405344009399414 time for calcul the mask position with numpy : 0.02437567710876465 nb_pixel_total : 8171 time to create 1 rle with old method : 0.00889277458190918 time for calcul the mask position with numpy : 0.026453256607055664 nb_pixel_total : 14936 time to create 1 rle with old method : 0.016643762588500977 time for calcul the mask position with numpy : 0.024744749069213867 nb_pixel_total : 22904 time to create 1 rle with old method : 0.02444911003112793 create new chi : 3.5883936882019043 time to delete rle : 0.0008933544158935547 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6446 TO DO : save crop sub photo not yet done ! save time : 0.42307424545288086 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 4.313717603683472 time for calcul the mask position with numpy : 1.4981307983398438 nb_pixel_total : 7793010 time to create 1 rle with new method : 1.0946660041809082 time for calcul the mask position with numpy : 0.04416775703430176 nb_pixel_total : 39836 time to create 1 rle with old method : 0.04438161849975586 time for calcul the mask position with numpy : 0.04546666145324707 nb_pixel_total : 313738 time to create 1 rle with new method : 1.4941394329071045 time for calcul the mask position with numpy : 0.04138898849487305 nb_pixel_total : 20161 time to create 1 rle with old method : 0.021913528442382812 time for calcul the mask position with numpy : 0.04013204574584961 nb_pixel_total : 127655 time to create 1 rle with old method : 0.1365365982055664 create new chi : 4.534553289413452 time to delete rle : 0.0008711814880371094 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 5476 TO DO : save crop sub photo not yet done ! save time : 0.3853020668029785 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 6.828040838241577 time for calcul the mask position with numpy : 1.0103585720062256 nb_pixel_total : 7842696 time to create 1 rle with new method : 1.193366527557373 time for calcul the mask position with numpy : 0.027191638946533203 nb_pixel_total : 21864 time to create 1 rle with old method : 0.024562358856201172 time for calcul the mask position with numpy : 0.02704477310180664 nb_pixel_total : 45933 time to create 1 rle with old method : 0.05135393142700195 time for calcul the mask position with numpy : 0.025299787521362305 nb_pixel_total : 18714 time to create 1 rle with old method : 0.020642995834350586 time for calcul the mask position with numpy : 0.02542853355407715 nb_pixel_total : 63953 time to create 1 rle with old method : 0.07021164894104004 time for calcul the mask position with numpy : 0.02539372444152832 nb_pixel_total : 22301 time to create 1 rle with old method : 0.024806737899780273 time for calcul the mask position with numpy : 0.02849102020263672 nb_pixel_total : 50610 time to create 1 rle with old method : 0.05411052703857422 time for calcul the mask position with numpy : 0.02470231056213379 nb_pixel_total : 50484 time to create 1 rle with old method : 0.05310773849487305 time for calcul the mask position with numpy : 0.02592754364013672 nb_pixel_total : 51126 time to create 1 rle with old method : 0.054108619689941406 time for calcul the mask position with numpy : 0.025432109832763672 nb_pixel_total : 126719 time to create 1 rle with old method : 0.13356518745422363 create new chi : 2.969219923019409 time to delete rle : 0.0010843276977539062 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7064 TO DO : save crop sub photo not yet done ! save time : 0.5113818645477295 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 4.731362581253052 time for calcul the mask position with numpy : 0.9936881065368652 nb_pixel_total : 7887129 time to create 1 rle with new method : 0.9696917533874512 time for calcul the mask position with numpy : 0.03879189491271973 nb_pixel_total : 22655 time to create 1 rle with old method : 0.02552652359008789 time for calcul the mask position with numpy : 0.028721094131469727 nb_pixel_total : 148974 time to create 1 rle with old method : 0.16539430618286133 time for calcul the mask position with numpy : 0.026180744171142578 nb_pixel_total : 25021 time to create 1 rle with old method : 0.02794671058654785 time for calcul the mask position with numpy : 0.02600550651550293 nb_pixel_total : 18789 time to create 1 rle with old method : 0.02117300033569336 time for calcul the mask position with numpy : 0.026827573776245117 nb_pixel_total : 144606 time to create 1 rle with old method : 0.15984535217285156 time for calcul the mask position with numpy : 0.025370121002197266 nb_pixel_total : 18385 time to create 1 rle with old method : 0.02023625373840332 time for calcul the mask position with numpy : 0.026302576065063477 nb_pixel_total : 28841 time to create 1 rle with old method : 0.03224778175354004 create new chi : 2.6606438159942627 time to delete rle : 0.0009341239929199219 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5910 TO DO : save crop sub photo not yet done ! save time : 0.44481754302978516 map_output_result : {1404708497: (0.0, 'Should be the crop_list due to order', 0), 1404708495: (0.0, 'Should be the crop_list due to order', 0), 1404708494: (0.0, 'Should be the crop_list due to order', 0), 1404708493: (0.0, 'Should be the crop_list due to order', 0), 1404708492: (0.0, 'Should be the crop_list due to order', 0), 1404708436: (0.0, 'Should be the crop_list due to order', 0), 1404708435: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1404708497, 1404708495, 1404708494, 1404708493, 1404708492, 1404708436, 1404708435] Looping around the photos to save general results len do output : 7 /1404708497.Didn't retrieve data . /1404708495.Didn't retrieve data . /1404708494.Didn't retrieve data . /1404708493.Didn't retrieve data . /1404708492.Didn't retrieve data . /1404708436.Didn't retrieve data . /1404708435.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708497', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708495', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708494', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708493', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708492', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708436', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708435', None, None, None, None, None, '4332974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.01749277114868164 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.28144907951355 time spend to save output : 0.018009185791015625 total time spend for step 3 : 67.29945826530457 step4:ventilate_hashtags_in_portfolio Tue Jan 20 15:13:26 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30164735 get user id for portfolio 30164735 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30164735 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pehd','background','carton','papier','environnement','flou','metal','autre','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30164735 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pehd','background','carton','papier','environnement','flou','metal','autre','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30164735 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pehd','background','carton','papier','environnement','flou','metal','autre','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30164940,30164941,30164942,30164943,30164944,30164945,30164946,30164947,30164948,30164949,30164950?tags=mal_croppe,pehd,background,carton,papier,environnement,flou,metal,autre,pet_fonce,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1404708497, 1404708495, 1404708494, 1404708493, 1404708492, 1404708436, 1404708435] Looping around the photos to save general results len do output : 1 /30164735. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708497', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708495', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708494', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708493', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708492', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708436', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708435', None, None, None, None, None, '4332974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.018720626831054688 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0696609020233154 time spend to save output : 0.018959999084472656 total time spend for step 4 : 2.088620901107788 step5:final Tue Jan 20 15:13:28 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1404708497: ('0.05982725005511461',), 1404708495: ('0.05982725005511461',), 1404708494: ('0.05982725005511461',), 1404708493: ('0.05982725005511461',), 1404708492: ('0.05982725005511461',), 1404708436: ('0.05982725005511461',), 1404708435: ('0.05982725005511461',)} new output for save of step final : {1404708497: ('0.05982725005511461',), 1404708495: ('0.05982725005511461',), 1404708494: ('0.05982725005511461',), 1404708493: ('0.05982725005511461',), 1404708492: ('0.05982725005511461',), 1404708436: ('0.05982725005511461',), 1404708435: ('0.05982725005511461',)} [1404708497, 1404708495, 1404708494, 1404708493, 1404708492, 1404708436, 1404708435] Looping around the photos to save general results len do output : 7 /1404708497.Didn't retrieve data . /1404708495.Didn't retrieve data . /1404708494.Didn't retrieve data . /1404708493.Didn't retrieve data . /1404708492.Didn't retrieve data . /1404708436.Didn't retrieve data . /1404708435.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708497', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708495', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708494', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708493', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708492', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708436', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708435', None, None, None, None, None, '4332974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.018077373504638672 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15359997749328613 time spend to save output : 0.018328428268432617 total time spend for step 5 : 0.17192840576171875 step6:blur_detection Tue Jan 20 15:13:28 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695.jpg resize: (2160, 3840) 1404708497 -7.0496472677405535 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277.jpg resize: (2160, 3840) 1404708495 -7.012370966241532 treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969.jpg resize: (2160, 3840) 1404708494 -7.1621732740509625 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4.jpg resize: (2160, 3840) 1404708493 -7.086132131117958 treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d.jpg resize: (2160, 3840) 1404708492 -6.889567468876658 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54.jpg resize: (2160, 3840) 1404708436 -6.111536654982145 treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1.jpg resize: (2160, 3840) 1404708435 -4.533119749506298 treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075189_0.png resize: (469, 354) 1404711500 -3.748645293047159 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075196_0.png resize: (373, 180) 1404711501 -3.263479496554415 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075197_0.png resize: (146, 356) 1404711502 -3.087006068666706 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075198_0.png resize: (155, 127) 1404711503 -1.8293709433021141 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075207_0.png resize: (241, 235) 1404711504 -4.6407076829980145 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075209_0.png resize: (537, 136) 1404711505 -4.827435289602159 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075210_0.png resize: (226, 143) 1404711506 -4.547104208790486 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075212_0.png resize: (481, 767) 1404711507 -5.248335597287059 treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075213_0.png resize: (425, 436) 1404711508 -5.0687971535021505 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075218_0.png resize: (263, 139) 1404711509 -4.5482732901757394 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075219_0.png resize: (122, 203) 1404711510 -4.217880096928353 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075220_0.png resize: (171, 113) 1404711511 -3.2073792044384417 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075225_0.png resize: (153, 103) 1404711512 -3.5902745996269827 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075226_0.png resize: (252, 238) 1404711513 -3.192626767215696 treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075227_0.png resize: (339, 495) 1404711514 -4.480143167198949 treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075230_0.png resize: (337, 224) 1404711515 -3.4408003330335135 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075232_0.png resize: (478, 166) 1404711516 -2.585953716296288 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075235_0.png resize: (158, 203) 1404711517 -4.904775301765623 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075238_0.png resize: (247, 286) 1404711518 -4.097986240943465 treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075240_0.png resize: (259, 175) 1404711519 -3.9281335518528206 treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075241_0.png resize: (180, 212) 1404711520 -4.190427348620271 treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075242_0.png resize: (423, 483) 1404711521 -4.77881574367637 treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075243_0.png resize: (193, 224) 1404711522 -3.767768254480339 treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075244_0.png resize: (178, 193) 1404711523 -4.55202593947798 treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075246_0.png resize: (220, 164) 1404711524 -4.4122845017467265 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075199_0.png resize: (160, 165) 1404711525 -3.668995011253001 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075206_0.png resize: (193, 97) 1404711526 -3.5814656758031993 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075208_0.png resize: (486, 285) 1404711527 -4.700681828310976 treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075214_0.png resize: (324, 114) 1404711528 -4.468878624630811 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075221_0.png resize: (202, 179) 1404711529 -4.327615214336891 treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075229_0.png resize: (679, 700) 1404711530 -4.37263572447961 treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075190_0.png resize: (200, 193) 1404711531 -4.86218957927106 treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075193_0.png resize: (90, 176) 1404711532 -3.247308591466409 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075237_0.png resize: (123, 185) 1404711533 -3.891169253455729 treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075191_0.png resize: (230, 202) 1404711573 -3.229651675998921 treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075192_0.png resize: (308, 260) 1404711574 -6.283482081625751 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075195_0.png resize: (203, 344) 1404711575 -3.605376335182864 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075200_0.png resize: (178, 208) 1404711576 -4.824365307244074 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075201_0.png resize: (659, 517) 1404711577 -4.177071113675598 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075202_0.png resize: (351, 241) 1404711578 -4.6832791412595265 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075203_0.png resize: (150, 162) 1404711579 -4.3073082330183725 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075204_0.png resize: (289, 244) 1404711580 -4.91400050199901 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075205_0.png resize: (477, 494) 1404711581 -5.629614275318715 treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075211_0.png resize: (399, 403) 1404711582 -4.804190845164868 treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075215_0.png resize: (331, 384) 1404711583 -5.469805527657601 treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075216_0.png resize: (406, 171) 1404711584 -4.554040260022532 treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075217_0.png resize: (330, 420) 1404711585 -4.207317722966968 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075223_0.png resize: (364, 531) 1404711586 -5.184501430263068 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075224_0.png resize: (467, 266) 1404711587 -5.332861941869897 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075231_0.png resize: (474, 421) 1404711588 -4.412091225115977 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075233_0.png resize: (234, 376) 1404711589 -4.02973347718555 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075234_0.png resize: (231, 330) 1404711590 -4.9768519688949855 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075239_0.png resize: (111, 266) 1404711591 -4.232913936773407 treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075245_0.png resize: (234, 735) 1404711592 -5.528645780090124 treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075222_0.png resize: (119, 93) 1404711601 -4.183821153682738 treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075228_0.png resize: (162, 158) 1404711602 -5.31202652143808 treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075236_0.png resize: (251, 381) 1404711603 -5.315148127804887 treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075194_0.png resize: (300, 261) 1404711608 -6.284725942576372 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 65 time used for this insertion : 0.018301963806152344 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 65 time used for this insertion : 0.018449068069458008 save missing photos in datou_result : time spend for datou_step_exec : 29.99593186378479 time spend to save output : 0.04284501075744629 total time spend for step 6 : 30.038776874542236 step7:brightness Tue Jan 20 15:13:59 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695.jpg treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277.jpg treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969.jpg treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4.jpg treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d.jpg treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54.jpg treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1.jpg treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075189_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075196_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075197_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075198_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075207_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075209_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075210_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075212_0.png treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075213_0.png treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075218_0.png treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075219_0.png treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075220_0.png treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075225_0.png treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075226_0.png treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075227_0.png treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075230_0.png treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075232_0.png treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075235_0.png treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075238_0.png treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075240_0.png treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075241_0.png treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075242_0.png treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075243_0.png treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075244_0.png treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075246_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075199_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075206_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075208_0.png treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075214_0.png treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075221_0.png treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075229_0.png treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075190_0.png treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075193_0.png treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075237_0.png treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075191_0.png treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075192_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075195_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075200_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075201_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075202_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075203_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075204_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075205_0.png treat image : temp/1768918230_1876288_1404708495_40cabdee2033da9b4d9dd6db7e59d277_rle_crop_4106075211_0.png treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075215_0.png treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075216_0.png treat image : temp/1768918230_1876288_1404708494_394465f194693be91244d98b1b718969_rle_crop_4106075217_0.png treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075223_0.png treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075224_0.png treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075231_0.png treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075233_0.png treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075234_0.png treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075239_0.png treat image : temp/1768918230_1876288_1404708435_a901023826d0eb645de065b4b3bdffe1_rle_crop_4106075245_0.png treat image : temp/1768918230_1876288_1404708493_486972568646feae61b1422f773ca7d4_rle_crop_4106075222_0.png treat image : temp/1768918230_1876288_1404708492_af00d00c0ad2d198bfbfd7c7c392925d_rle_crop_4106075228_0.png treat image : temp/1768918230_1876288_1404708436_dd12ce6662b5142a17a08ee1ab8ffc54_rle_crop_4106075236_0.png treat image : temp/1768918230_1876288_1404708497_0eeeb4b45cd380135efcfb5c50e89695_rle_crop_4106075194_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 65 time used for this insertion : 0.022832393646240234 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 65 time used for this insertion : 0.01825690269470215 save missing photos in datou_result : time spend for datou_step_exec : 7.790786981582642 time spend to save output : 0.04730415344238281 total time spend for step 7 : 7.838091135025024 step8:velours_tree Tue Jan 20 15:14:06 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.18024659156799316 time spend to save output : 4.57763671875e-05 total time spend for step 8 : 0.18029236793518066 step9:send_mail_cod Tue Jan 20 15:14:07 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30164735_20-01-2026_15_14_07.pdf 30164940 imagette301649401768918447 30164941 imagette301649411768918447 30164942 imagette301649421768918447 30164943 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301649431768918447 30164944 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301649441768918447 30164946 imagette301649461768918449 30164947 change filename to text .change filename to text .change filename to text .imagette301649471768918449 30164948 change filename to text .change filename to text .change filename to text .imagette301649481768918449 30164949 change filename to text .imagette301649491768918450 30164950 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301649501768918450 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30164735 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30164940,30164941,30164942,30164943,30164944,30164945,30164946,30164947,30164948,30164949,30164950?tags=mal_croppe,pehd,background,carton,papier,environnement,flou,metal,autre,pet_fonce,pet_clair your option no_mail is active, we will not send the real mail to your client args[1404708497] : ((1404708497, -7.0496472677405535, 492609224), (1404708497, 0.2547147221392094, 2107752395), '0.05982725005511461') We are sending mail with results at report@fotonower.com args[1404708495] : ((1404708495, -7.012370966241532, 492609224), (1404708495, 0.262240224218689, 2107752395), '0.05982725005511461') We are sending mail with results at report@fotonower.com args[1404708494] : ((1404708494, -7.1621732740509625, 492609224), (1404708494, 0.26692460777397764, 2107752395), '0.05982725005511461') We are sending mail with results at report@fotonower.com args[1404708493] : ((1404708493, -7.086132131117958, 492609224), (1404708493, 0.21187953697263426, 2107752395), '0.05982725005511461') We are sending mail with results at report@fotonower.com args[1404708492] : ((1404708492, -6.889567468876658, 492609224), (1404708492, 0.09628110766900276, 2107752395), '0.05982725005511461') We are sending mail with results at report@fotonower.com args[1404708436] : ((1404708436, -6.111536654982145, 492609224), (1404708436, -0.16820017033478937, 496442774), '0.05982725005511461') We are sending mail with results at report@fotonower.com args[1404708435] : ((1404708435, -4.533119749506298, 492609224), (1404708435, -0.9275859940965595, 501862349), '0.05982725005511461') We are sending mail with results at report@fotonower.com refus_total : 0.05982725005511461 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30164735 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30164735_20-01-2026_15_14_07.pdf results_Auto_P30164735_20-01-2026_15_14_07.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30164735_20-01-2026_15_14_07.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30164735','results_Auto_P30164735_20-01-2026_15_14_07.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30164735_20-01-2026_15_14_07.pdf','pdf','','0.7','0.05982725005511461') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1404708497, 1404708495, 1404708494, 1404708493, 1404708492, 1404708436, 1404708435] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708497', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708495', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708494', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708493', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708492', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708436', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708435', None, None, None, None, None, '4332974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.015434741973876953 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.339515209197998 time spend to save output : 0.015628576278686523 total time spend for step 9 : 7.355143785476685 step10:split_time_score Tue Jan 20 15:14:14 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20012026 30164735 Nombre de photos uploadées : 7 / 23040 (0%) 20012026 30164735 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 20012026 30164735 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 4.76837158203125e-06 elapsed_time : order_list_meta_photo_and_scores 1.4781951904296875e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0004870891571044922 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.27370405197143555 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03135075874485597 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30162003_20-01-2026_07_10_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30162003 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30162003 AND mptpi.`type`=3594 To do Qualite : 0.016256524502513473 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30162004_20-01-2026_07_04_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30162004 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30162004 AND mptpi.`type`=3726 To do Qualite : 0.04846866168471896 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30164223_20-01-2026_14_09_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30164223 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30164223 AND mptpi.`type`=3726 To do Qualite : 0.020007085972476326 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30164725_20-01-2026_15_12_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30164725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30164725 AND mptpi.`type`=3726 To do Qualite : 0.07843573173868315 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30164728 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30164728 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30164731 order by id desc limit 1 Qualite : 0.05982725005511461 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30164735_20-01-2026_15_14_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30164735 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30164735 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20012026': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1404708497, 1404708495, 1404708494, 1404708493, 1404708492, 1404708436, 1404708435] Looping around the photos to save general results len do output : 1 /30164735Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708497', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708495', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708494', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708493', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708492', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708436', None, None, None, None, None, '4332974') ('3318', None, None, None, None, None, None, None, '4332974') ('3318', '30164735', '1404708435', None, None, None, None, None, '4332974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.018294334411621094 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.341125726699829 time spend to save output : 0.018613815307617188 total time spend for step 10 : 3.3597395420074463 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 86.24user 112.92system 3:51.86elapsed 85%CPU (0avgtext+0avgdata 3921604maxresident)k 2343616inputs+97616outputs (9026major+8443877minor)pagefaults 0swaps