python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1310661 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4053628'] with mtr_portfolio_ids : ['28571214'] and first list_photo_ids : [] new path : /proc/1310661/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.2635130882263184 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Nov 15 13:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3701 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-15 13:10:34.428222: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-15 13:10:34.454543: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-15 13:10:34.457356: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7118000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-15 13:10:34.457435: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-15 13:10:34.462435: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-15 13:10:34.707969: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3269f040 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-15 13:10:34.708031: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-15 13:10:34.709000: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-15 13:10:34.709493: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-15 13:10:34.716184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-15 13:10:34.719198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-15 13:10:34.719948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-15 13:10:34.724606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-15 13:10:34.726190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-15 13:10:34.740068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-15 13:10:34.741534: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-15 13:10:34.741636: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-15 13:10:34.742417: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-15 13:10:34.742440: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-15 13:10:34.742452: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-15 13:10:34.743681: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3249 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-15 13:10:35.010087: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-15 13:10:35.010221: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-15 13:10:35.010249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-15 13:10:35.010288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-15 13:10:35.010315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-15 13:10:35.010339: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-15 13:10:35.010361: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-15 13:10:35.010384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-15 13:10:35.011527: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-15 13:10:35.012759: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-15 13:10:35.012796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-15 13:10:35.012815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-15 13:10:35.012833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-15 13:10:35.012850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-15 13:10:35.012867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-15 13:10:35.012888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-15 13:10:35.012905: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-15 13:10:35.013959: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-15 13:10:35.013999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-15 13:10:35.014011: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-15 13:10:35.014022: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-15 13:10:35.015249: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3249 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-15 13:10:48.026550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-15 13:10:48.215472: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-15 13:10:49.865345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.865922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.41G (2584726784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.866456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2326254080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.866485: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.867026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.867040: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.874002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.874021: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.874571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.874588: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.881035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.881054: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.881586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.881601: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.912171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.912195: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.912736: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.912750: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.918515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.918534: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.919071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.919086: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-15 13:10:49.952591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.953158: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.955004: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.955547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.993393: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.993938: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.995832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:49.996371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.021148: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.021695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.023185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.023725: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.029052: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.029592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.031204: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.031743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.037231: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.037771: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.039260: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.039800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.065705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.066249: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.066792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.067328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.070790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.071331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.090448: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.091175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.091816: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.092354: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.104650: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.105196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.105733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.106308: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.110556: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.111121: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.115625: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.116168: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.128108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.128652: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.132728: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.133271: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.133808: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.134362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.135046: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.135590: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.146143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.146699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.147333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.147913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.148490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.149040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.149573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.150107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.164990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.165530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.193905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.193969: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-11-15 13:10:50.195054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.196111: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.203650: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.204265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.204851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.205387: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.213209: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.213790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.231315: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.232066: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.232793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.233504: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.237712: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.238450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.239165: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.239873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.240801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.250979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.251517: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.260360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.260903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.261448: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.262001: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.262556: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-15 13:10:50.263092: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2871918592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 1311275 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1315 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2508 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0053441524505615234 nb_pixel_total : 141921 time to create 1 rle with old method : 0.16158699989318848 length of segment : 470 time for calcul the mask position with numpy : 0.0008730888366699219 nb_pixel_total : 31982 time to create 1 rle with old method : 0.05184507369995117 length of segment : 202 time for calcul the mask position with numpy : 0.002027750015258789 nb_pixel_total : 89989 time to create 1 rle with old method : 0.09957718849182129 length of segment : 399 time for calcul the mask position with numpy : 0.00022482872009277344 nb_pixel_total : 5812 time to create 1 rle with old method : 0.006682395935058594 length of segment : 109 time for calcul the mask position with numpy : 0.0004863739013671875 nb_pixel_total : 23009 time to create 1 rle with old method : 0.025745630264282227 length of segment : 322 time for calcul the mask position with numpy : 0.0016789436340332031 nb_pixel_total : 39099 time to create 1 rle with old method : 0.0446314811706543 length of segment : 221 time for calcul the mask position with numpy : 0.0024034976959228516 nb_pixel_total : 98712 time to create 1 rle with old method : 0.11111783981323242 length of segment : 354 time for calcul the mask position with numpy : 0.004583835601806641 nb_pixel_total : 174555 time to create 1 rle with new method : 0.011887311935424805 length of segment : 460 time for calcul the mask position with numpy : 0.0006580352783203125 nb_pixel_total : 14853 time to create 1 rle with old method : 0.017175912857055664 length of segment : 171 time for calcul the mask position with numpy : 0.0006322860717773438 nb_pixel_total : 23216 time to create 1 rle with old method : 0.026240825653076172 length of segment : 139 time for calcul the mask position with numpy : 0.0012845993041992188 nb_pixel_total : 32274 time to create 1 rle with old method : 0.03579974174499512 length of segment : 147 time for calcul the mask position with numpy : 0.0011038780212402344 nb_pixel_total : 23341 time to create 1 rle with old method : 0.028066396713256836 length of segment : 187 time for calcul the mask position with numpy : 0.0014090538024902344 nb_pixel_total : 59347 time to create 1 rle with old method : 0.06531882286071777 length of segment : 332 time for calcul the mask position with numpy : 0.0038509368896484375 nb_pixel_total : 174180 time to create 1 rle with new method : 0.014661312103271484 length of segment : 455 time for calcul the mask position with numpy : 0.00024080276489257812 nb_pixel_total : 7902 time to create 1 rle with old method : 0.009127378463745117 length of segment : 103 time for calcul the mask position with numpy : 0.017606735229492188 nb_pixel_total : 363860 time to create 1 rle with new method : 0.040663719177246094 length of segment : 597 time for calcul the mask position with numpy : 0.006624460220336914 nb_pixel_total : 371828 time to create 1 rle with new method : 0.03251028060913086 length of segment : 598 time for calcul the mask position with numpy : 0.0007658004760742188 nb_pixel_total : 21334 time to create 1 rle with old method : 0.024434566497802734 length of segment : 267 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 17605 time to create 1 rle with old method : 0.019225358963012695 length of segment : 134 time for calcul the mask position with numpy : 0.0002949237823486328 nb_pixel_total : 12006 time to create 1 rle with old method : 0.014202356338500977 length of segment : 120 time for calcul the mask position with numpy : 0.0003800392150878906 nb_pixel_total : 7372 time to create 1 rle with old method : 0.010477066040039062 length of segment : 97 time for calcul the mask position with numpy : 0.0025339126586914062 nb_pixel_total : 102069 time to create 1 rle with old method : 0.13630914688110352 length of segment : 245 time for calcul the mask position with numpy : 0.0014014244079589844 nb_pixel_total : 37617 time to create 1 rle with old method : 0.04328322410583496 length of segment : 247 time for calcul the mask position with numpy : 0.0007529258728027344 nb_pixel_total : 11890 time to create 1 rle with old method : 0.013785839080810547 length of segment : 170 time for calcul the mask position with numpy : 0.0011878013610839844 nb_pixel_total : 36217 time to create 1 rle with old method : 0.042589664459228516 length of segment : 143 time for calcul the mask position with numpy : 0.0013284683227539062 nb_pixel_total : 34065 time to create 1 rle with old method : 0.03751516342163086 length of segment : 274 time for calcul the mask position with numpy : 0.0019714832305908203 nb_pixel_total : 30123 time to create 1 rle with old method : 0.0340423583984375 length of segment : 260 time for calcul the mask position with numpy : 0.0015895366668701172 nb_pixel_total : 57593 time to create 1 rle with old method : 0.06518936157226562 length of segment : 319 time for calcul the mask position with numpy : 0.0007281303405761719 nb_pixel_total : 20851 time to create 1 rle with old method : 0.025181293487548828 length of segment : 226 time for calcul the mask position with numpy : 0.0011582374572753906 nb_pixel_total : 41009 time to create 1 rle with old method : 0.0464015007019043 length of segment : 173 time for calcul the mask position with numpy : 0.002371072769165039 nb_pixel_total : 38891 time to create 1 rle with old method : 0.0439457893371582 length of segment : 352 time for calcul the mask position with numpy : 0.00037169456481933594 nb_pixel_total : 11992 time to create 1 rle with old method : 0.013932228088378906 length of segment : 121 time for calcul the mask position with numpy : 0.00115203857421875 nb_pixel_total : 43111 time to create 1 rle with old method : 0.04849886894226074 length of segment : 242 time for calcul the mask position with numpy : 0.0016074180603027344 nb_pixel_total : 42571 time to create 1 rle with old method : 0.0475156307220459 length of segment : 363 time for calcul the mask position with numpy : 0.0009539127349853516 nb_pixel_total : 30903 time to create 1 rle with old method : 0.035902976989746094 length of segment : 233 time for calcul the mask position with numpy : 0.001897573471069336 nb_pixel_total : 67397 time to create 1 rle with old method : 0.07360124588012695 length of segment : 351 time for calcul the mask position with numpy : 0.0007307529449462891 nb_pixel_total : 17760 time to create 1 rle with old method : 0.020916461944580078 length of segment : 147 time for calcul the mask position with numpy : 0.0009305477142333984 nb_pixel_total : 23634 time to create 1 rle with old method : 0.026955127716064453 length of segment : 315 time for calcul the mask position with numpy : 0.001650094985961914 nb_pixel_total : 29474 time to create 1 rle with old method : 0.0333552360534668 length of segment : 324 time for calcul the mask position with numpy : 0.002035856246948242 nb_pixel_total : 67175 time to create 1 rle with old method : 0.0765690803527832 length of segment : 439 time for calcul the mask position with numpy : 0.002088785171508789 nb_pixel_total : 73827 time to create 1 rle with old method : 0.08258938789367676 length of segment : 361 time for calcul the mask position with numpy : 0.0009715557098388672 nb_pixel_total : 23149 time to create 1 rle with old method : 0.026832103729248047 length of segment : 199 time for calcul the mask position with numpy : 0.0017807483673095703 nb_pixel_total : 66539 time to create 1 rle with old method : 0.07665228843688965 length of segment : 337 time for calcul the mask position with numpy : 0.0008370876312255859 nb_pixel_total : 32082 time to create 1 rle with old method : 0.03899192810058594 length of segment : 220 time for calcul the mask position with numpy : 0.0005803108215332031 nb_pixel_total : 17496 time to create 1 rle with old method : 0.021924495697021484 length of segment : 141 time for calcul the mask position with numpy : 0.0024793148040771484 nb_pixel_total : 68421 time to create 1 rle with old method : 0.0767829418182373 length of segment : 627 time for calcul the mask position with numpy : 0.0058193206787109375 nb_pixel_total : 190004 time to create 1 rle with new method : 0.01227569580078125 length of segment : 511 time for calcul the mask position with numpy : 0.0009191036224365234 nb_pixel_total : 33067 time to create 1 rle with old method : 0.038233041763305664 length of segment : 243 time for calcul the mask position with numpy : 0.0008120536804199219 nb_pixel_total : 12819 time to create 1 rle with old method : 0.014592647552490234 length of segment : 175 time for calcul the mask position with numpy : 0.0016460418701171875 nb_pixel_total : 67626 time to create 1 rle with old method : 0.07533669471740723 length of segment : 352 time spent for convertir_results : 4.666779518127441 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 50 chid ids of type : 3594 Number RLEs to save : 13994 save missing photos in datou_result : time spend for datou_step_exec : 52.378602504730225 time spend to save output : 0.8249919414520264 total time spend for step 1 : 53.20359444618225 step2:crop_condition Sat Nov 15 13:11:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 50 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763208692_1310661 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845041_0.png', 0, 134, 169, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845044_0.png', 0, 609, 130, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845052_0.png', 0, 161, 119, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845047_0.png', 0, 128, 103, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845048_0.png', 0, 904, 593, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845050_0.png', 0, 214, 267, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845055_0.png', 0, 236, 229, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845059_0.png', 0, 272, 232, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845056_0.png', 0, 94, 167, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845062_0.png', 0, 324, 167, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845066_0.png', 0, 225, 363, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845068_0.png', 0, 306, 348, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845060_0.png', 0, 271, 298, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845073_0.png', 0, 292, 351, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845071_0.png', 0, 309, 247, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845075_0.png', 0, 411, 225, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845069_0.png', 0, 241, 142, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845070_0.png', 0, 120, 315, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845079_0.png', 0, 596, 511, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845080_0.png', 0, 191, 226, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208695), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845081_0.png', 0, 163, 175, 0, 1763208695,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.816711902618408 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763208700_1310661 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208701), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845065_0.png', 0, 272, 214, 0, 1763208701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208701), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845061_0.png', 0, 125, 221, 0, 1763208701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208701), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845067_0.png', 0, 195, 227, 0, 1763208701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208701), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845072_0.png', 0, 257, 356, 0, 1763208701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3363497257232666 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763208703_1310661 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208704), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845034_0.png', 0, 219, 202, 0, 1763208704,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208704), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845042_0.png', 0, 205, 139, 0, 1763208704,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208704), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845036_0.png', 0, 72, 109, 0, 1763208704,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208704), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845064_0.png', 0, 184, 94, 0, 1763208704,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208704), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991_rle_crop_4034845077_0.png', 0, 175, 130, 0, 1763208704,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2925236225128174 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763208711_1310661 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845043_0.png', 0, 275, 143, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845037_0.png', 0, 196, 178, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845035_0.png', 0, 347, 360, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845033_0.png', 0, 409, 460, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845038_0.png', 0, 405, 165, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845040_0.png', 0, 556, 445, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845045_0.png', 0, 288, 277, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845049_0.png', 0, 884, 598, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845058_0.png', 0, 185, 270, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845057_0.png', 0, 418, 119, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845054_0.png', 0, 550, 229, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845063_0.png', 0, 319, 363, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845074_0.png', 0, 193, 199, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991_rle_crop_4034845078_0.png', 0, 216, 617, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208714), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845082_0.png', 0, 263, 349, 0, 1763208714,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.844726800918579 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763208718_1310661 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208719), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845051_0.png', 0, 161, 133, 0, 1763208719,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208719), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845053_0.png', 0, 102, 97, 0, 1763208719,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208719), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991_rle_crop_4034845076_0.png', 0, 187, 213, 0, 1763208719,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0110740661621094 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763208722_1310661 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208723), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845039_0.png', 0, 681, 242, 0, 1763208723,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763208723), 0.0, 0.0, 14, '', 0, 0, '1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845046_0.png', 0, 555, 449, 0, 1763208723,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8145039081573486 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1394607125, 1394607120, 1394607118, 1394607116, 1394607114, 1394607109, 1394607104] Looping around the photos to save general results len do output : 50 /1394618832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394618936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394619109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607125', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607120', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607118', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607116', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607114', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607109', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607104', None, None, None, None, None, '4053628') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 157 time used for this insertion : 0.023641347885131836 save_final save missing photos in datou_result : time spend for datou_step_exec : 38.5082848072052 time spend to save output : 0.02515578269958496 total time spend for step 2 : 38.533440589904785 step3:rle_unique_nms_with_priority Sat Nov 15 13:12:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 50 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 21.129340171813965 time for calcul the mask position with numpy : 1.7339317798614502 nb_pixel_total : 7535065 time to create 1 rle with new method : 1.0223093032836914 time for calcul the mask position with numpy : 0.025266170501708984 nb_pixel_total : 1644 time to create 1 rle with old method : 0.002332448959350586 time for calcul the mask position with numpy : 0.024231433868408203 nb_pixel_total : 59347 time to create 1 rle with old method : 0.06968188285827637 time for calcul the mask position with numpy : 0.026103496551513672 nb_pixel_total : 22922 time to create 1 rle with old method : 0.02670001983642578 time for calcul the mask position with numpy : 0.026447772979736328 nb_pixel_total : 32274 time to create 1 rle with old method : 0.036231040954589844 time for calcul the mask position with numpy : 0.026015043258666992 nb_pixel_total : 23216 time to create 1 rle with old method : 0.029677152633666992 time for calcul the mask position with numpy : 0.0412442684173584 nb_pixel_total : 14853 time to create 1 rle with old method : 0.016672849655151367 time for calcul the mask position with numpy : 0.04386258125305176 nb_pixel_total : 174555 time to create 1 rle with new method : 1.4875593185424805 time for calcul the mask position with numpy : 0.04108619689941406 nb_pixel_total : 98712 time to create 1 rle with old method : 0.10928821563720703 time for calcul the mask position with numpy : 0.04139900207519531 nb_pixel_total : 39099 time to create 1 rle with old method : 0.06241106986999512 time for calcul the mask position with numpy : 0.0464937686920166 nb_pixel_total : 23009 time to create 1 rle with old method : 0.025661945343017578 time for calcul the mask position with numpy : 0.04048347473144531 nb_pixel_total : 5812 time to create 1 rle with old method : 0.006440877914428711 time for calcul the mask position with numpy : 0.04185652732849121 nb_pixel_total : 89989 time to create 1 rle with old method : 0.11821222305297852 time for calcul the mask position with numpy : 0.046965599060058594 nb_pixel_total : 31982 time to create 1 rle with old method : 0.0396578311920166 time for calcul the mask position with numpy : 0.05472111701965332 nb_pixel_total : 141921 time to create 1 rle with old method : 0.16472959518432617 create new chi : 5.549506187438965 time to delete rle : 0.01959824562072754 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 9603 TO DO : save crop sub photo not yet done ! save time : 0.5660073757171631 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 9.830694437026978 time for calcul the mask position with numpy : 1.125338077545166 nb_pixel_total : 7859392 time to create 1 rle with new method : 1.737205982208252 time for calcul the mask position with numpy : 0.03823423385620117 nb_pixel_total : 12006 time to create 1 rle with old method : 0.013402462005615234 time for calcul the mask position with numpy : 0.04054856300354004 nb_pixel_total : 17605 time to create 1 rle with old method : 0.019963979721069336 time for calcul the mask position with numpy : 0.03951835632324219 nb_pixel_total : 21334 time to create 1 rle with old method : 0.024000883102416992 time for calcul the mask position with numpy : 0.036884307861328125 nb_pixel_total : 12301 time to create 1 rle with old method : 0.016315937042236328 time for calcul the mask position with numpy : 0.028322696685791016 nb_pixel_total : 363860 time to create 1 rle with new method : 1.6512460708618164 time for calcul the mask position with numpy : 0.025056123733520508 nb_pixel_total : 7902 time to create 1 rle with old method : 0.009030818939208984 create new chi : 4.881807327270508 time to delete rle : 0.0012578964233398438 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5195 TO DO : save crop sub photo not yet done ! save time : 0.30774426460266113 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 11.294005155563354 time for calcul the mask position with numpy : 4.126916408538818 nb_pixel_total : 8035047 time to create 1 rle with new method : 1.5146081447601318 time for calcul the mask position with numpy : 0.034261226654052734 nb_pixel_total : 30123 time to create 1 rle with old method : 0.03340268135070801 time for calcul the mask position with numpy : 0.024095773696899414 nb_pixel_total : 34065 time to create 1 rle with old method : 0.037914276123046875 time for calcul the mask position with numpy : 0.02518296241760254 nb_pixel_total : 36217 time to create 1 rle with old method : 0.03990769386291504 time for calcul the mask position with numpy : 0.023263216018676758 nb_pixel_total : 11890 time to create 1 rle with old method : 0.012903451919555664 time for calcul the mask position with numpy : 0.02407670021057129 nb_pixel_total : 37617 time to create 1 rle with old method : 0.04097700119018555 time for calcul the mask position with numpy : 0.025594472885131836 nb_pixel_total : 102069 time to create 1 rle with old method : 0.1089174747467041 time for calcul the mask position with numpy : 0.0252377986907959 nb_pixel_total : 7372 time to create 1 rle with old method : 0.008150339126586914 create new chi : 6.150974273681641 time to delete rle : 0.0008022785186767578 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5032 TO DO : save crop sub photo not yet done ! save time : 0.31203269958496094 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 3.241257905960083 time for calcul the mask position with numpy : 0.45980334281921387 nb_pixel_total : 7940082 time to create 1 rle with new method : 0.7675583362579346 time for calcul the mask position with numpy : 0.023489952087402344 nb_pixel_total : 67397 time to create 1 rle with old method : 0.07417154312133789 time for calcul the mask position with numpy : 0.02381157875061035 nb_pixel_total : 30903 time to create 1 rle with old method : 0.03360629081726074 time for calcul the mask position with numpy : 0.024836063385009766 nb_pixel_total : 42571 time to create 1 rle with old method : 0.04597878456115723 time for calcul the mask position with numpy : 0.024356842041015625 nb_pixel_total : 43111 time to create 1 rle with old method : 0.04703378677368164 time for calcul the mask position with numpy : 0.023588180541992188 nb_pixel_total : 11992 time to create 1 rle with old method : 0.013329029083251953 time for calcul the mask position with numpy : 0.023441314697265625 nb_pixel_total : 38891 time to create 1 rle with old method : 0.0433349609375 time for calcul the mask position with numpy : 0.02466440200805664 nb_pixel_total : 41009 time to create 1 rle with old method : 0.04462003707885742 time for calcul the mask position with numpy : 0.024684667587280273 nb_pixel_total : 20851 time to create 1 rle with old method : 0.022676467895507812 time for calcul the mask position with numpy : 0.023727893829345703 nb_pixel_total : 57593 time to create 1 rle with old method : 0.0628197193145752 create new chi : 1.873286485671997 time to delete rle : 0.0008921623229980469 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6920 TO DO : save crop sub photo not yet done ! save time : 0.40718722343444824 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.4781758785247803 time for calcul the mask position with numpy : 0.543156623840332 nb_pixel_total : 7992842 time to create 1 rle with new method : 0.7538301944732666 time for calcul the mask position with numpy : 0.023930788040161133 nb_pixel_total : 66539 time to create 1 rle with old method : 0.07041120529174805 time for calcul the mask position with numpy : 0.024005651473999023 nb_pixel_total : 23149 time to create 1 rle with old method : 0.02515101432800293 time for calcul the mask position with numpy : 0.025351762771606445 nb_pixel_total : 73827 time to create 1 rle with old method : 0.07939982414245605 time for calcul the mask position with numpy : 0.023409605026245117 nb_pixel_total : 67175 time to create 1 rle with old method : 0.07318902015686035 time for calcul the mask position with numpy : 0.02422499656677246 nb_pixel_total : 29474 time to create 1 rle with old method : 0.03238320350646973 time for calcul the mask position with numpy : 0.025114059448242188 nb_pixel_total : 23634 time to create 1 rle with old method : 0.025867938995361328 time for calcul the mask position with numpy : 0.0247495174407959 nb_pixel_total : 17760 time to create 1 rle with old method : 0.019278764724731445 create new chi : 1.835829257965088 time to delete rle : 0.0008432865142822266 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 6404 TO DO : save crop sub photo not yet done ! save time : 0.38845181465148926 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 1.340944528579712 time for calcul the mask position with numpy : 0.6165759563446045 nb_pixel_total : 8176401 time to create 1 rle with new method : 0.6933426856994629 time for calcul the mask position with numpy : 0.0322265625 nb_pixel_total : 68421 time to create 1 rle with old method : 0.07317972183227539 time for calcul the mask position with numpy : 0.02248835563659668 nb_pixel_total : 17496 time to create 1 rle with old method : 0.018452167510986328 time for calcul the mask position with numpy : 0.02324700355529785 nb_pixel_total : 32082 time to create 1 rle with old method : 0.03453516960144043 create new chi : 1.5540802478790283 time to delete rle : 0.0005791187286376953 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4136 TO DO : save crop sub photo not yet done ! save time : 0.2769474983215332 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 1.360262155532837 time for calcul the mask position with numpy : 0.577101469039917 nb_pixel_total : 7990884 time to create 1 rle with new method : 0.7313125133514404 time for calcul the mask position with numpy : 0.023924589157104492 nb_pixel_total : 67626 time to create 1 rle with old method : 0.07386016845703125 time for calcul the mask position with numpy : 0.022855520248413086 nb_pixel_total : 12819 time to create 1 rle with old method : 0.014141082763671875 time for calcul the mask position with numpy : 0.024905681610107422 nb_pixel_total : 33067 time to create 1 rle with old method : 0.03650188446044922 time for calcul the mask position with numpy : 0.025777816772460938 nb_pixel_total : 190004 time to create 1 rle with new method : 0.6051123142242432 create new chi : 2.202164649963379 time to delete rle : 0.0007429122924804688 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4722 TO DO : save crop sub photo not yet done ! save time : 0.3047022819519043 map_output_result : {1394607125: (0.0, 'Should be the crop_list due to order', 0), 1394607120: (0.0, 'Should be the crop_list due to order', 0), 1394607118: (0.0, 'Should be the crop_list due to order', 0), 1394607116: (0.0, 'Should be the crop_list due to order', 0), 1394607114: (0.0, 'Should be the crop_list due to order', 0), 1394607109: (0.0, 'Should be the crop_list due to order', 0), 1394607104: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1394607125, 1394607120, 1394607118, 1394607116, 1394607114, 1394607109, 1394607104] Looping around the photos to save general results len do output : 7 /1394607125.Didn't retrieve data . /1394607120.Didn't retrieve data . /1394607118.Didn't retrieve data . /1394607116.Didn't retrieve data . /1394607114.Didn't retrieve data . /1394607109.Didn't retrieve data . /1394607104.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607125', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607120', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607118', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607116', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607114', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607109', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607104', None, None, None, None, None, '4053628') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.011761903762817383 save_final save missing photos in datou_result : time spend for datou_step_exec : 78.2470293045044 time spend to save output : 0.012150049209594727 total time spend for step 3 : 78.25917935371399 step4:ventilate_hashtags_in_portfolio Sat Nov 15 13:13:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28571214 get user id for portfolio 28571214 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28571214 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pet_fonce','carton','environnement','autre','papier','metal','mal_croppe','pehd','flou','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28571214 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pet_fonce','carton','environnement','autre','papier','metal','mal_croppe','pehd','flou','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28571214 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pet_fonce','carton','environnement','autre','papier','metal','mal_croppe','pehd','flou','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28571548,28571549,28571550,28571551,28571552,28571553,28571554,28571555,28571556,28571557,28571558?tags=pet_clair,pet_fonce,carton,environnement,autre,papier,metal,mal_croppe,pehd,flou,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1394607125, 1394607120, 1394607118, 1394607116, 1394607114, 1394607109, 1394607104] Looping around the photos to save general results len do output : 1 /28571214. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607125', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607120', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607118', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607116', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607114', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607109', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607104', None, None, None, None, None, '4053628') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014049530029296875 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6945526599884033 time spend to save output : 0.0144195556640625 total time spend for step 4 : 1.7089722156524658 step5:final Sat Nov 15 13:13:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1394607125: ('0.04359373277667548',), 1394607120: ('0.04359373277667548',), 1394607118: ('0.04359373277667548',), 1394607116: ('0.04359373277667548',), 1394607114: ('0.04359373277667548',), 1394607109: ('0.04359373277667548',), 1394607104: ('0.04359373277667548',)} new output for save of step final : {1394607125: ('0.04359373277667548',), 1394607120: ('0.04359373277667548',), 1394607118: ('0.04359373277667548',), 1394607116: ('0.04359373277667548',), 1394607114: ('0.04359373277667548',), 1394607109: ('0.04359373277667548',), 1394607104: ('0.04359373277667548',)} [1394607125, 1394607120, 1394607118, 1394607116, 1394607114, 1394607109, 1394607104] Looping around the photos to save general results len do output : 7 /1394607125.Didn't retrieve data . /1394607120.Didn't retrieve data . /1394607118.Didn't retrieve data . /1394607116.Didn't retrieve data . /1394607114.Didn't retrieve data . /1394607109.Didn't retrieve data . /1394607104.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607125', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607120', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607118', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607116', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607114', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607109', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607104', None, None, None, None, None, '4053628') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.011685371398925781 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12242436408996582 time spend to save output : 0.011988162994384766 total time spend for step 5 : 0.13441252708435059 step6:blur_detection Sat Nov 15 13:13:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937.jpg resize: (2160, 3840) 1394607125 -5.958873713812655 treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0.jpg resize: (2160, 3840) 1394607120 -6.96448384055315 treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5.jpg resize: (2160, 3840) 1394607118 -7.005965077378448 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01.jpg resize: (2160, 3840) 1394607116 -7.007709745166391 treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223.jpg resize: (2160, 3840) 1394607114 -7.15121961824639 treat image : temp/1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991.jpg resize: (2160, 3840) 1394607109 -6.928350153077331 treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841.jpg resize: (2160, 3840) 1394607104 -7.027370624444133 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845041_0.png resize: (169, 134) 1394618832 -4.265903549015714 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845044_0.png resize: (130, 609) 1394618834 -4.603534842712185 treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845052_0.png resize: (119, 161) 1394618835 -4.628641436716552 treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845047_0.png resize: (103, 128) 1394618836 -4.265304681896964 treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845048_0.png resize: (593, 904) 1394618837 -5.214755265401105 treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845050_0.png resize: (267, 214) 1394618839 -3.613548552953619 treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845055_0.png resize: (229, 236) 1394618840 -4.336329094580128 treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845059_0.png resize: (232, 272) 1394618841 -4.612644214611031 treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845056_0.png resize: (167, 94) 1394618843 -3.2720108595284207 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845062_0.png resize: (167, 324) 1394618844 -4.789638528300371 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845066_0.png resize: (363, 225) 1394618845 -3.2424420079619733 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845068_0.png resize: (348, 306) 1394618846 -4.913310648532388 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845060_0.png resize: (298, 271) 1394618848 -3.9442503902949246 treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845073_0.png resize: (351, 292) 1394618849 -5.81233214744579 treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845071_0.png resize: (247, 309) 1394618850 -4.841639703570363 treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845075_0.png resize: (225, 411) 1394618852 -4.987070848214159 treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845069_0.png resize: (142, 241) 1394618853 -4.206202062559589 treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845070_0.png resize: (315, 120) 1394618854 -4.048230770144643 treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845079_0.png resize: (511, 596) 1394618855 -4.340703515102294 treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845080_0.png resize: (226, 191) 1394618857 -3.545384318858633 treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845081_0.png resize: (175, 163) 1394618858 -4.115712334705434 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845065_0.png resize: (214, 272) 1394618901 -5.074939277340469 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845061_0.png resize: (221, 125) 1394618903 -3.5844934508178 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845067_0.png resize: (227, 195) 1394618904 -4.383586252784582 treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845072_0.png resize: (356, 257) 1394618905 -4.83819762648287 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845034_0.png resize: (202, 219) 1394618931 -5.07570290246693 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845042_0.png resize: (139, 205) 1394618933 -5.1149286750126155 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845036_0.png resize: (109, 72) 1394618934 -4.740306509437944 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845064_0.png resize: (94, 184) 1394618935 -5.251363923970858 treat image : temp/1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991_rle_crop_4034845077_0.png resize: (130, 175) 1394618936 -4.859568310937725 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845043_0.png resize: (143, 275) 1394619019 -4.816311003620651 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845037_0.png resize: (178, 196) 1394619020 -4.926225912823226 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845035_0.png resize: (360, 347) 1394619022 -4.196217564905814 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845033_0.png resize: (460, 409) 1394619023 -3.7555562899665884 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845038_0.png resize: (165, 405) 1394619024 -4.623288472320625 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845040_0.png resize: (445, 556) 1394619026 -6.152405306574006 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845045_0.png resize: (277, 288) 1394619027 -4.888241409074236 treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845049_0.png resize: (598, 884) 1394619028 -5.281158819382101 treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845058_0.png resize: (270, 185) 1394619029 -4.234361055540628 treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845057_0.png resize: (119, 418) 1394619031 -4.10409099066169 treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845054_0.png resize: (229, 550) 1394619032 -5.365507412799475 treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845063_0.png resize: (363, 319) 1394619033 -3.2941432306052865 treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845074_0.png resize: (199, 193) 1394619035 -3.8493491941218267 treat image : temp/1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991_rle_crop_4034845078_0.png resize: (617, 216) 1394619036 -4.804570750570336 treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845082_0.png resize: (349, 263) 1394619037 -4.5819458553519 treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845051_0.png resize: (133, 161) 1394619072 -1.9633125547294348 treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845053_0.png resize: (97, 102) 1394619073 -4.772430405351113 treat image : temp/1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991_rle_crop_4034845076_0.png resize: (213, 187) 1394619075 -3.990007122354868 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845039_0.png resize: (242, 681) 1394619107 -4.912823477357275 treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845046_0.png resize: (449, 555) 1394619109 -6.142632286375109 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 57 time used for this insertion : 0.016790151596069336 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 57 time used for this insertion : 0.01389455795288086 save missing photos in datou_result : time spend for datou_step_exec : 28.01277446746826 time spend to save output : 0.03528094291687012 total time spend for step 6 : 28.048055410385132 step7:brightness Sat Nov 15 13:13:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937.jpg treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0.jpg treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5.jpg treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01.jpg treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223.jpg treat image : temp/1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991.jpg treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841.jpg treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845041_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845044_0.png treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845052_0.png treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845047_0.png treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845048_0.png treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845050_0.png treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845055_0.png treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845059_0.png treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845056_0.png treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845062_0.png treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845066_0.png treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845068_0.png treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845060_0.png treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845073_0.png treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845071_0.png treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845075_0.png treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845069_0.png treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845070_0.png treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845079_0.png treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845080_0.png treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845081_0.png treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845065_0.png treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845061_0.png treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845067_0.png treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845072_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845034_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845042_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845036_0.png treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845064_0.png treat image : temp/1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991_rle_crop_4034845077_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845043_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845037_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845035_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845033_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845038_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845040_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845045_0.png treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845049_0.png treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845058_0.png treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845057_0.png treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845054_0.png treat image : temp/1763208630_1310661_1394607116_673e9961086e365d471315a41a44ca01_rle_crop_4034845063_0.png treat image : temp/1763208630_1310661_1394607114_9049cb22c6560b627ef447f23308b223_rle_crop_4034845074_0.png treat image : temp/1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991_rle_crop_4034845078_0.png treat image : temp/1763208630_1310661_1394607104_a1f1609b1e8d979e65e172beaec2d841_rle_crop_4034845082_0.png treat image : temp/1763208630_1310661_1394607120_688347f70938d59f1a4f6de6a94d99f0_rle_crop_4034845051_0.png treat image : temp/1763208630_1310661_1394607118_8de0952143240ba3f2ff0f104a512dc5_rle_crop_4034845053_0.png treat image : temp/1763208630_1310661_1394607109_cfe03b22829abf7d39cc14db63d64991_rle_crop_4034845076_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845039_0.png treat image : temp/1763208630_1310661_1394607125_413a2fe2a34215bbf9fbb46b2d58b937_rle_crop_4034845046_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 57 time used for this insertion : 0.022189855575561523 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 57 time used for this insertion : 0.019626855850219727 save missing photos in datou_result : time spend for datou_step_exec : 6.99094557762146 time spend to save output : 0.04708743095397949 total time spend for step 7 : 7.0380330085754395 step8:velours_tree Sat Nov 15 13:13:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13682341575622559 time spend to save output : 4.601478576660156e-05 total time spend for step 8 : 0.1368694305419922 step9:send_mail_cod Sat Nov 15 13:13:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28571214_15-11-2025_13_13_58.pdf 28571548 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette285715481763208838 28571549 change filename to text .change filename to text .imagette285715491763208840 28571550 change filename to text .change filename to text .change filename to text .change filename to text .imagette285715501763208840 28571552 change filename to text .change filename to text .change filename to text .imagette285715521763208840 28571553 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette285715531763208840 28571554 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette285715541763208842 28571555 imagette285715551763208843 28571556 imagette285715561763208843 28571557 imagette285715571763208843 28571558 imagette285715581763208843 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28571214 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28571548,28571549,28571550,28571551,28571552,28571553,28571554,28571555,28571556,28571557,28571558?tags=pet_clair,pet_fonce,carton,environnement,autre,papier,metal,mal_croppe,pehd,flou,background args[1394607125] : ((1394607125, -5.958873713812655, 492609224), (1394607125, -0.5382510105865577, 501862349), '0.04359373277667548') We are sending mail with results at report@fotonower.com args[1394607120] : ((1394607120, -6.96448384055315, 492609224), (1394607120, -0.06973053086965467, 2107752395), '0.04359373277667548') We are sending mail with results at report@fotonower.com args[1394607118] : ((1394607118, -7.005965077378448, 492609224), (1394607118, -0.13246456606069595, 496442774), '0.04359373277667548') We are sending mail with results at report@fotonower.com args[1394607116] : ((1394607116, -7.007709745166391, 492609224), (1394607116, -0.050622306540116985, 2107752395), '0.04359373277667548') We are sending mail with results at report@fotonower.com args[1394607114] : ((1394607114, -7.15121961824639, 492609224), (1394607114, -0.08997365750690718, 496442774), '0.04359373277667548') We are sending mail with results at report@fotonower.com args[1394607109] : ((1394607109, -6.928350153077331, 492609224), (1394607109, -0.15687059691233363, 496442774), '0.04359373277667548') We are sending mail with results at report@fotonower.com args[1394607104] : ((1394607104, -7.027370624444133, 492609224), (1394607104, 0.06700411726162245, 2107752395), '0.04359373277667548') We are sending mail with results at report@fotonower.com refus_total : 0.04359373277667548 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28571214 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28571214_15-11-2025_13_13_58.pdf results_Auto_P28571214_15-11-2025_13_13_58.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28571214_15-11-2025_13_13_58.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28571214','results_Auto_P28571214_15-11-2025_13_13_58.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28571214_15-11-2025_13_13_58.pdf','pdf','','0.66','0.04359373277667548') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28571214

https://www.fotonower.com/image?json=false&list_photos_id=1394607125
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394607120
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394607118
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394607116
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394607114
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394607109
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394607104
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.36%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/28571548?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28571549?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28571550?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28571552?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28571553?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28571554?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28571214_15-11-2025_13_13_58.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28571548,28571549,28571550,28571551,28571552,28571553,28571554,28571555,28571556,28571557,28571558?tags=pet_clair,pet_fonce,carton,environnement,autre,papier,metal,mal_croppe,pehd,flou,background.


L'équipe Fotonower 202 b'' Date: Sat, 15 Nov 2025 12:14:05 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: xaqiOJyoR_uGKhTpAYOybg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1394607125, 1394607120, 1394607118, 1394607116, 1394607114, 1394607109, 1394607104] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607125', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607120', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607118', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607116', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607114', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607109', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607104', None, None, None, None, None, '4053628') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.014906883239746094 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.36592173576355 time spend to save output : 0.015109539031982422 total time spend for step 9 : 7.381031274795532 step10:split_time_score Sat Nov 15 13:14:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 15112025 28571214 Nombre de photos uploadées : 7 / 23040 (0%) 15112025 28571214 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 15112025 28571214 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.00038886070251464844 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23479747772216797 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.019232944478637683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28561932_15-11-2025_07_18_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28561932 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28561932 AND mptpi.`type`=3726 To do Qualite : 0.0312709999298541 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28564860_15-11-2025_09_43_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28564860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28564860 AND mptpi.`type`=3594 To do Qualite : 0.04359373277667548 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28571214_15-11-2025_13_13_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28571214 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28571214 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'15112025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1394607125, 1394607120, 1394607118, 1394607116, 1394607114, 1394607109, 1394607104] Looping around the photos to save general results len do output : 1 /28571214Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607125', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607120', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607118', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607116', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607114', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607109', None, None, None, None, None, '4053628') ('3318', None, None, None, None, None, None, None, '4053628') ('3318', '28571214', '1394607104', None, None, None, None, None, '4053628') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01326894760131836 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6006786823272705 time spend to save output : 0.013476371765136719 total time spend for step 10 : 0.6141550540924072 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 79.89user 116.63system 3:41.27elapsed 88%CPU (0avgtext+0avgdata 3968540maxresident)k 578640inputs+87848outputs (1532major+8092991minor)pagefaults 0swaps