python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2805671 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3808322'] with mtr_portfolio_ids : ['27406524'] and first list_photo_ids : [] new path : /proc/2805671/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.7067270278930664 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Oct 1 15:10:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5291 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-01 15:10:31.950891: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-01 15:10:31.988492: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-10-01 15:10:31.990201: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff724000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-01 15:10:31.990237: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-01 15:10:31.994246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-01 15:10:32.136686: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3ffe3f10 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-01 15:10:32.136746: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-01 15:10:32.145945: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-01 15:10:32.146428: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-01 15:10:32.149761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-01 15:10:32.154958: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-01 15:10:32.155796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-01 15:10:32.159544: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-01 15:10:32.160953: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-01 15:10:32.169175: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-01 15:10:32.170334: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-01 15:10:32.170429: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-01 15:10:32.171055: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-01 15:10:32.171071: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-01 15:10:32.171080: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-01 15:10:32.172073: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4831 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-01 15:10:32.579085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-01 15:10:32.579205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-01 15:10:32.579224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-01 15:10:32.579241: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-01 15:10:32.579256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-01 15:10:32.579272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-01 15:10:32.579287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-01 15:10:32.579303: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-01 15:10:32.580185: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-01 15:10:32.581260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-01 15:10:32.581292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-01 15:10:32.581308: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-01 15:10:32.581322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-01 15:10:32.581336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-01 15:10:32.581350: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-01 15:10:32.581363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-01 15:10:32.581377: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-01 15:10:32.582297: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-01 15:10:32.582330: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-01 15:10:32.582338: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-01 15:10:32.582346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-01 15:10:32.583261: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4831 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-01 15:10:41.288405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-01 15:10:41.452866: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-01 15:10:43.412029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.413161: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.413923: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.414679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.415449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.416205: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.416983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.417023: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.417836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.417857: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.426028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.426078: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.426844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.426864: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.434738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.434796: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.435326: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.435344: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.471183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.471255: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.471781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.471797: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.481057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.481111: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.481661: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.481679: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-01 15:10:43.521925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.522573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.525242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.525952: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.572110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.572892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.575273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.575810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.617941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.618503: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.620397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.621027: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.630678: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.631345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.634245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.634815: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.642436: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.643115: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.645136: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.645797: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.678059: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.678738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.679381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.680020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.684624: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.685245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.702978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.703678: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.704357: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.705026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.719337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.720068: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.720833: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.721399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.727120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.727761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.733257: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.733891: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.747047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.747843: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.752136: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.752775: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.753366: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.754021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.754914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.755548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.767809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.768417: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.768967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.769543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.770172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.770768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.771428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.772094: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.783604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.784308: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.792456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.793415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.834579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.834631: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-10-01 15:10:43.835298: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.838874: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.851050: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.851841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.852775: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.853836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.865878: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.866486: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.905205: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.905873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.906433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.906997: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.911126: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.911667: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.917886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.918544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.920994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.930370: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.930965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.940564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.941178: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.941738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.942309: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.942984: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-01 15:10:43.943535: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 49 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 Detection mask done ! Trying to reset tf kernel 2806304 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2955 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4148 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005347728729248047 nb_pixel_total : 9374 time to create 1 rle with old method : 0.016324996948242188 length of segment : 81 time for calcul the mask position with numpy : 0.0035338401794433594 nb_pixel_total : 33916 time to create 1 rle with old method : 0.059764862060546875 length of segment : 330 time for calcul the mask position with numpy : 0.0016357898712158203 nb_pixel_total : 64798 time to create 1 rle with old method : 0.08586478233337402 length of segment : 314 time for calcul the mask position with numpy : 0.002884387969970703 nb_pixel_total : 50422 time to create 1 rle with old method : 0.06077218055725098 length of segment : 486 time for calcul the mask position with numpy : 0.0007908344268798828 nb_pixel_total : 31787 time to create 1 rle with old method : 0.046727657318115234 length of segment : 231 time for calcul the mask position with numpy : 0.0002758502960205078 nb_pixel_total : 5622 time to create 1 rle with old method : 0.006725311279296875 length of segment : 131 time for calcul the mask position with numpy : 0.0003650188446044922 nb_pixel_total : 5205 time to create 1 rle with old method : 0.006829023361206055 length of segment : 98 time for calcul the mask position with numpy : 0.0008518695831298828 nb_pixel_total : 24141 time to create 1 rle with old method : 0.02993464469909668 length of segment : 285 time for calcul the mask position with numpy : 0.0011434555053710938 nb_pixel_total : 42691 time to create 1 rle with old method : 0.05130958557128906 length of segment : 290 time for calcul the mask position with numpy : 0.0008823871612548828 nb_pixel_total : 34648 time to create 1 rle with old method : 0.03890633583068848 length of segment : 380 time for calcul the mask position with numpy : 0.0015654563903808594 nb_pixel_total : 59440 time to create 1 rle with old method : 0.07422327995300293 length of segment : 270 time for calcul the mask position with numpy : 0.0013272762298583984 nb_pixel_total : 24482 time to create 1 rle with old method : 0.034685373306274414 length of segment : 384 time for calcul the mask position with numpy : 0.0033330917358398438 nb_pixel_total : 65299 time to create 1 rle with old method : 0.0857858657836914 length of segment : 655 time for calcul the mask position with numpy : 0.0002887248992919922 nb_pixel_total : 7868 time to create 1 rle with old method : 0.009200334548950195 length of segment : 86 time for calcul the mask position with numpy : 0.00048470497131347656 nb_pixel_total : 9382 time to create 1 rle with old method : 0.01131582260131836 length of segment : 120 time for calcul the mask position with numpy : 0.0003533363342285156 nb_pixel_total : 14283 time to create 1 rle with old method : 0.016585350036621094 length of segment : 140 time for calcul the mask position with numpy : 0.001192331314086914 nb_pixel_total : 27573 time to create 1 rle with old method : 0.03079080581665039 length of segment : 300 time for calcul the mask position with numpy : 0.0014026165008544922 nb_pixel_total : 40656 time to create 1 rle with old method : 0.0478358268737793 length of segment : 303 time for calcul the mask position with numpy : 0.0010623931884765625 nb_pixel_total : 24791 time to create 1 rle with old method : 0.027803897857666016 length of segment : 180 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 5923 time to create 1 rle with old method : 0.0074062347412109375 length of segment : 71 time for calcul the mask position with numpy : 0.0008988380432128906 nb_pixel_total : 23693 time to create 1 rle with old method : 0.027172565460205078 length of segment : 301 time for calcul the mask position with numpy : 0.0002593994140625 nb_pixel_total : 9438 time to create 1 rle with old method : 0.010885953903198242 length of segment : 147 time for calcul the mask position with numpy : 0.0015909671783447266 nb_pixel_total : 53998 time to create 1 rle with old method : 0.06230473518371582 length of segment : 275 time for calcul the mask position with numpy : 0.0015251636505126953 nb_pixel_total : 33251 time to create 1 rle with old method : 0.038494110107421875 length of segment : 296 time for calcul the mask position with numpy : 0.006091594696044922 nb_pixel_total : 156300 time to create 1 rle with new method : 0.008329391479492188 length of segment : 579 time for calcul the mask position with numpy : 0.001276254653930664 nb_pixel_total : 31547 time to create 1 rle with old method : 0.035211801528930664 length of segment : 228 time for calcul the mask position with numpy : 0.0007798671722412109 nb_pixel_total : 17749 time to create 1 rle with old method : 0.020022869110107422 length of segment : 167 time for calcul the mask position with numpy : 0.00045299530029296875 nb_pixel_total : 13874 time to create 1 rle with old method : 0.015775680541992188 length of segment : 125 time for calcul the mask position with numpy : 0.0011184215545654297 nb_pixel_total : 21616 time to create 1 rle with old method : 0.02609109878540039 length of segment : 193 time for calcul the mask position with numpy : 0.004294872283935547 nb_pixel_total : 57687 time to create 1 rle with old method : 0.08521676063537598 length of segment : 551 time for calcul the mask position with numpy : 0.003240823745727539 nb_pixel_total : 66431 time to create 1 rle with old method : 0.10142302513122559 length of segment : 223 time for calcul the mask position with numpy : 0.0011582374572753906 nb_pixel_total : 15999 time to create 1 rle with old method : 0.018387317657470703 length of segment : 278 time for calcul the mask position with numpy : 0.0004906654357910156 nb_pixel_total : 7280 time to create 1 rle with old method : 0.008637428283691406 length of segment : 105 time for calcul the mask position with numpy : 0.0006003379821777344 nb_pixel_total : 8238 time to create 1 rle with old method : 0.009654521942138672 length of segment : 99 time for calcul the mask position with numpy : 0.0005919933319091797 nb_pixel_total : 11154 time to create 1 rle with old method : 0.017085790634155273 length of segment : 125 time for calcul the mask position with numpy : 0.0005664825439453125 nb_pixel_total : 13897 time to create 1 rle with old method : 0.01623392105102539 length of segment : 105 time for calcul the mask position with numpy : 0.001361846923828125 nb_pixel_total : 38641 time to create 1 rle with old method : 0.04674839973449707 length of segment : 400 time for calcul the mask position with numpy : 0.007877111434936523 nb_pixel_total : 239633 time to create 1 rle with new method : 0.012522220611572266 length of segment : 516 time for calcul the mask position with numpy : 0.0006616115570068359 nb_pixel_total : 15817 time to create 1 rle with old method : 0.017930269241333008 length of segment : 158 time for calcul the mask position with numpy : 0.0009582042694091797 nb_pixel_total : 25135 time to create 1 rle with old method : 0.027721643447875977 length of segment : 266 time for calcul the mask position with numpy : 0.0012307167053222656 nb_pixel_total : 41485 time to create 1 rle with old method : 0.046242713928222656 length of segment : 236 time for calcul the mask position with numpy : 0.0011286735534667969 nb_pixel_total : 45798 time to create 1 rle with old method : 0.052957773208618164 length of segment : 210 time for calcul the mask position with numpy : 0.0008571147918701172 nb_pixel_total : 23865 time to create 1 rle with old method : 0.026943683624267578 length of segment : 184 time for calcul the mask position with numpy : 0.0010683536529541016 nb_pixel_total : 34711 time to create 1 rle with old method : 0.0375370979309082 length of segment : 239 time for calcul the mask position with numpy : 0.0009047985076904297 nb_pixel_total : 25721 time to create 1 rle with old method : 0.02836441993713379 length of segment : 276 time for calcul the mask position with numpy : 0.0014443397521972656 nb_pixel_total : 53290 time to create 1 rle with old method : 0.059528350830078125 length of segment : 253 time for calcul the mask position with numpy : 0.0015323162078857422 nb_pixel_total : 41413 time to create 1 rle with old method : 0.046080589294433594 length of segment : 459 time for calcul the mask position with numpy : 0.0015981197357177734 nb_pixel_total : 37102 time to create 1 rle with old method : 0.04192042350769043 length of segment : 279 time for calcul the mask position with numpy : 0.0007812976837158203 nb_pixel_total : 16417 time to create 1 rle with old method : 0.020781278610229492 length of segment : 179 time for calcul the mask position with numpy : 0.00649714469909668 nb_pixel_total : 178857 time to create 1 rle with new method : 0.013917684555053711 length of segment : 501 time for calcul the mask position with numpy : 0.004952669143676758 nb_pixel_total : 145672 time to create 1 rle with old method : 0.16426372528076172 length of segment : 630 time for calcul the mask position with numpy : 0.001809835433959961 nb_pixel_total : 53363 time to create 1 rle with old method : 0.06328392028808594 length of segment : 237 time for calcul the mask position with numpy : 0.001440286636352539 nb_pixel_total : 37743 time to create 1 rle with old method : 0.05203366279602051 length of segment : 305 time for calcul the mask position with numpy : 0.0005631446838378906 nb_pixel_total : 12826 time to create 1 rle with old method : 0.016808271408081055 length of segment : 365 time for calcul the mask position with numpy : 0.0012469291687011719 nb_pixel_total : 36763 time to create 1 rle with old method : 0.042305946350097656 length of segment : 277 time for calcul the mask position with numpy : 0.001401662826538086 nb_pixel_total : 51287 time to create 1 rle with old method : 0.05771946907043457 length of segment : 290 time for calcul the mask position with numpy : 0.0005340576171875 nb_pixel_total : 12306 time to create 1 rle with old method : 0.013970136642456055 length of segment : 122 time for calcul the mask position with numpy : 0.0012521743774414062 nb_pixel_total : 39500 time to create 1 rle with old method : 0.045702219009399414 length of segment : 262 time for calcul the mask position with numpy : 0.0011458396911621094 nb_pixel_total : 27053 time to create 1 rle with old method : 0.0307619571685791 length of segment : 238 time for calcul the mask position with numpy : 0.0019931793212890625 nb_pixel_total : 75089 time to create 1 rle with old method : 0.08451342582702637 length of segment : 392 time for calcul the mask position with numpy : 0.0005099773406982422 nb_pixel_total : 16042 time to create 1 rle with old method : 0.01815056800842285 length of segment : 183 time for calcul the mask position with numpy : 0.001119852066040039 nb_pixel_total : 34433 time to create 1 rle with old method : 0.038841962814331055 length of segment : 182 time for calcul the mask position with numpy : 0.0011336803436279297 nb_pixel_total : 28422 time to create 1 rle with old method : 0.03243684768676758 length of segment : 290 time for calcul the mask position with numpy : 0.0010907649993896484 nb_pixel_total : 25984 time to create 1 rle with old method : 0.030329227447509766 length of segment : 252 time for calcul the mask position with numpy : 0.0013065338134765625 nb_pixel_total : 24847 time to create 1 rle with old method : 0.0287168025970459 length of segment : 475 time for calcul the mask position with numpy : 0.0019528865814208984 nb_pixel_total : 81122 time to create 1 rle with old method : 0.09126162528991699 length of segment : 215 time for calcul the mask position with numpy : 0.0023369789123535156 nb_pixel_total : 73121 time to create 1 rle with old method : 0.08472013473510742 length of segment : 367 time for calcul the mask position with numpy : 0.0010309219360351562 nb_pixel_total : 19397 time to create 1 rle with old method : 0.030031442642211914 length of segment : 169 time for calcul the mask position with numpy : 0.0012021064758300781 nb_pixel_total : 36986 time to create 1 rle with old method : 0.04290485382080078 length of segment : 220 time for calcul the mask position with numpy : 0.0005688667297363281 nb_pixel_total : 14345 time to create 1 rle with old method : 0.016598224639892578 length of segment : 144 time for calcul the mask position with numpy : 0.0021288394927978516 nb_pixel_total : 72359 time to create 1 rle with old method : 0.08347129821777344 length of segment : 435 time for calcul the mask position with numpy : 0.003984928131103516 nb_pixel_total : 93474 time to create 1 rle with old method : 0.10580801963806152 length of segment : 567 time for calcul the mask position with numpy : 0.0036923885345458984 nb_pixel_total : 132435 time to create 1 rle with old method : 0.16617417335510254 length of segment : 374 time for calcul the mask position with numpy : 0.002766132354736328 nb_pixel_total : 104468 time to create 1 rle with old method : 0.11675620079040527 length of segment : 494 time for calcul the mask position with numpy : 0.0009865760803222656 nb_pixel_total : 33922 time to create 1 rle with old method : 0.03690671920776367 length of segment : 278 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 7284 time to create 1 rle with old method : 0.008512258529663086 length of segment : 108 time for calcul the mask position with numpy : 0.0018622875213623047 nb_pixel_total : 83882 time to create 1 rle with old method : 0.09510540962219238 length of segment : 416 time for calcul the mask position with numpy : 0.0011661052703857422 nb_pixel_total : 30595 time to create 1 rle with old method : 0.0345156192779541 length of segment : 330 time for calcul the mask position with numpy : 0.0008432865142822266 nb_pixel_total : 24397 time to create 1 rle with old method : 0.02893543243408203 length of segment : 167 time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 7890 time to create 1 rle with old method : 0.009259700775146484 length of segment : 123 time for calcul the mask position with numpy : 0.0018265247344970703 nb_pixel_total : 70708 time to create 1 rle with old method : 0.08160901069641113 length of segment : 321 time for calcul the mask position with numpy : 0.005255222320556641 nb_pixel_total : 86596 time to create 1 rle with old method : 0.11642622947692871 length of segment : 282 time for calcul the mask position with numpy : 0.0016396045684814453 nb_pixel_total : 42629 time to create 1 rle with old method : 0.04854393005371094 length of segment : 448 time for calcul the mask position with numpy : 0.002547740936279297 nb_pixel_total : 78159 time to create 1 rle with old method : 0.08944058418273926 length of segment : 275 time for calcul the mask position with numpy : 0.002343416213989258 nb_pixel_total : 84495 time to create 1 rle with old method : 0.09772515296936035 length of segment : 471 time for calcul the mask position with numpy : 0.006506919860839844 nb_pixel_total : 215428 time to create 1 rle with new method : 0.014955282211303711 length of segment : 729 time for calcul the mask position with numpy : 0.0017392635345458984 nb_pixel_total : 46565 time to create 1 rle with old method : 0.06316828727722168 length of segment : 340 time for calcul the mask position with numpy : 0.0016565322875976562 nb_pixel_total : 68866 time to create 1 rle with old method : 0.07597231864929199 length of segment : 306 time for calcul the mask position with numpy : 0.0010368824005126953 nb_pixel_total : 24027 time to create 1 rle with old method : 0.02806878089904785 length of segment : 203 time for calcul the mask position with numpy : 0.00060272216796875 nb_pixel_total : 12608 time to create 1 rle with old method : 0.014538049697875977 length of segment : 162 time for calcul the mask position with numpy : 0.004024982452392578 nb_pixel_total : 129279 time to create 1 rle with old method : 0.14555883407592773 length of segment : 459 time for calcul the mask position with numpy : 0.0018525123596191406 nb_pixel_total : 52714 time to create 1 rle with old method : 0.059348106384277344 length of segment : 278 time for calcul the mask position with numpy : 0.0009865760803222656 nb_pixel_total : 24892 time to create 1 rle with old method : 0.028345823287963867 length of segment : 182 time spent for convertir_results : 9.031089067459106 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 93 chid ids of type : 3594 Number RLEs to save : 26451 save missing photos in datou_result : time spend for datou_step_exec : 55.25825905799866 time spend to save output : 2.8091495037078857 total time spend for step 1 : 58.06740856170654 step2:crop_condition Wed Oct 1 15:11:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 93 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 72 About to insert : list_path_to_insert length 72 new photo from crops ! About to upload 72 photos upload in portfolio : 3736932 init cache_photo without model_param we have 72 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759324304_2805671 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475314_0.png', 0, 122, 124, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475308_0.png', 0, 165, 193, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475281_0.png', 0, 307, 248, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475304_0.png', 0, 344, 569, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475310_0.png', 0, 477, 212, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475306_0.png', 0, 120, 167, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475298_0.png', 0, 190, 172, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475280_0.png', 0, 183, 74, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475285_0.png', 0, 160, 81, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475282_0.png', 0, 257, 314, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475293_0.png', 0, 116, 82, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475307_0.png', 0, 154, 125, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475291_0.png', 0, 271, 271, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475302_0.png', 0, 223, 273, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475311_0.png', 0, 110, 209, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475286_0.png', 0, 176, 80, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475290_0.png', 0, 300, 265, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475284_0.png', 0, 203, 230, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475295_0.png', 0, 142, 128, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475287_0.png', 0, 144, 238, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475305_0.png', 0, 183, 226, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475292_0.png', 0, 232, 517, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475288_0.png', 0, 247, 261, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475309_0.png', 0, 377, 405, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475283_0.png', 0, 185, 431, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475294_0.png', 0, 168, 113, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475312_0.png', 0, 116, 101, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475303_0.png', 0, 142, 296, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475297_0.png', 0, 217, 249, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475289_0.png', 0, 192, 289, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475296_0.png', 0, 132, 298, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475300_0.png', 0, 99, 275, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475316_0.png', 0, 231, 271, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475315_0.png', 0, 191, 105, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475317_0.png', 0, 704, 459, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475330_0.png', 0, 365, 630, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475329_0.png', 0, 538, 498, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475331_0.png', 0, 370, 212, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475323_0.png', 0, 234, 239, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475332_0.png', 0, 247, 267, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475325_0.png', 0, 388, 253, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475328_0.png', 0, 115, 179, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475324_0.png', 0, 169, 230, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475333_0.png', 0, 77, 264, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475326_0.png', 0, 175, 377, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475351_0.png', 0, 381, 563, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475337_0.png', 0, 208, 262, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475336_0.png', 0, 142, 118, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475344_0.png', 0, 238, 277, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475339_0.png', 0, 250, 393, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475347_0.png', 0, 155, 168, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475340_0.png', 0, 123, 183, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475343_0.png', 0, 241, 252, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475338_0.png', 0, 242, 198, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475350_0.png', 0, 230, 431, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475349_0.png', 0, 136, 144, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475348_0.png', 0, 313, 176, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475342_0.png', 0, 155, 290, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475354_0.png', 0, 161, 275, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475359_0.png', 0, 87, 123, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475358_0.png', 0, 286, 137, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475356_0.png', 0, 339, 366, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475355_0.png', 0, 82, 107, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475352_0.png', 0, 489, 361, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475353_0.png', 0, 315, 457, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475357_0.png', 0, 147, 321, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475372_0.png', 0, 245, 165, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475365_0.png', 0, 624, 591, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475369_0.png', 0, 102, 160, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475368_0.png', 0, 249, 203, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475362_0.png', 0, 202, 345, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324321), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475366_0.png', 0, 221, 335, 0, 1759324321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 72 photos in the portfolio 3736932 time of upload the photos Elapsed time : 26.00105094909668 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759324331_2805671 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324332), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475318_0.png', 0, 136, 158, 0, 1759324332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324332), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475327_0.png', 0, 212, 277, 0, 1759324332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324332), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475341_0.png', 0, 292, 181, 0, 1759324332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.218564510345459 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759324338_2805671 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475320_0.png', 0, 253, 235, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475321_0.png', 0, 262, 210, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475322_0.png', 0, 195, 181, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475319_0.png', 0, 136, 246, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475334_0.png', 0, 184, 277, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475335_0.png', 0, 341, 242, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475345_0.png', 0, 447, 215, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475346_0.png', 0, 252, 354, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475360_0.png', 0, 338, 315, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475370_0.png', 0, 453, 393, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475361_0.png', 0, 586, 274, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475367_0.png', 0, 409, 225, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475364_0.png', 0, 276, 463, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475363_0.png', 0, 401, 269, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324340), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475371_0.png', 0, 278, 275, 0, 1759324340,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.466925859451294 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759324344_2805671 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324345), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475299_0.png', 0, 216, 64, 0, 1759324345,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324345), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475301_0.png', 0, 120, 104, 0, 1759324345,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759324345), 0.0, 0.0, 14, '', 0, 0, '1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475313_0.png', 0, 126, 99, 0, 1759324345,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9352331161499023 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1387179576, 1387179567, 1387179542, 1387179524, 1387179512, 1387179506] Looping around the photos to save general results len do output : 93 /1387187973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387187994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387188111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179576', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179567', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179542', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179524', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179512', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179506', None, None, None, None, None, '3808322') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 285 time used for this insertion : 0.045197486877441406 save_final save missing photos in datou_result : time spend for datou_step_exec : 58.70188236236572 time spend to save output : 0.048583030700683594 total time spend for step 2 : 58.750465393066406 step3:rle_unique_nms_with_priority Wed Oct 1 15:12:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 93 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 35 nb_hashtags : 2 time to prepare the origin masks : 4.3382248878479 time for calcul the mask position with numpy : 0.7678565979003906 nb_pixel_total : 7204981 time to create 1 rle with new method : 0.7375283241271973 time for calcul the mask position with numpy : 0.03423738479614258 nb_pixel_total : 17749 time to create 1 rle with old method : 0.019800186157226562 time for calcul the mask position with numpy : 0.03433370590209961 nb_pixel_total : 24791 time to create 1 rle with old method : 0.027385711669921875 time for calcul the mask position with numpy : 0.034218549728393555 nb_pixel_total : 31547 time to create 1 rle with old method : 0.04575824737548828 time for calcul the mask position with numpy : 0.0387880802154541 nb_pixel_total : 21616 time to create 1 rle with old method : 0.027599811553955078 time for calcul the mask position with numpy : 0.03441429138183594 nb_pixel_total : 23693 time to create 1 rle with old method : 0.026644229888916016 time for calcul the mask position with numpy : 0.03567075729370117 nb_pixel_total : 156300 time to create 1 rle with new method : 0.8269860744476318 time for calcul the mask position with numpy : 0.0343165397644043 nb_pixel_total : 50422 time to create 1 rle with old method : 0.05630922317504883 time for calcul the mask position with numpy : 0.03450369834899902 nb_pixel_total : 40656 time to create 1 rle with old method : 0.04520416259765625 time for calcul the mask position with numpy : 0.03424668312072754 nb_pixel_total : 65299 time to create 1 rle with old method : 0.07212209701538086 time for calcul the mask position with numpy : 0.03415870666503906 nb_pixel_total : 11154 time to create 1 rle with old method : 0.012504339218139648 time for calcul the mask position with numpy : 0.0338897705078125 nb_pixel_total : 658 time to create 1 rle with old method : 0.0008614063262939453 time for calcul the mask position with numpy : 0.03362464904785156 nb_pixel_total : 27573 time to create 1 rle with old method : 0.029547691345214844 time for calcul the mask position with numpy : 0.033154964447021484 nb_pixel_total : 33251 time to create 1 rle with old method : 0.0352785587310791 time for calcul the mask position with numpy : 0.0328218936920166 nb_pixel_total : 53998 time to create 1 rle with old method : 0.05795764923095703 time for calcul the mask position with numpy : 0.03349113464355469 nb_pixel_total : 33916 time to create 1 rle with old method : 0.037720441818237305 time for calcul the mask position with numpy : 0.03473186492919922 nb_pixel_total : 66431 time to create 1 rle with old method : 0.07435750961303711 time for calcul the mask position with numpy : 0.03397679328918457 nb_pixel_total : 57687 time to create 1 rle with old method : 0.06349587440490723 time for calcul the mask position with numpy : 0.03393721580505371 nb_pixel_total : 24141 time to create 1 rle with old method : 0.026097536087036133 time for calcul the mask position with numpy : 0.03326678276062012 nb_pixel_total : 59440 time to create 1 rle with old method : 0.06482291221618652 time for calcul the mask position with numpy : 0.03354930877685547 nb_pixel_total : 42691 time to create 1 rle with old method : 0.0467379093170166 time for calcul the mask position with numpy : 0.034441232681274414 nb_pixel_total : 31787 time to create 1 rle with old method : 0.03620147705078125 time for calcul the mask position with numpy : 0.0354456901550293 nb_pixel_total : 15999 time to create 1 rle with old method : 0.018115520477294922 time for calcul the mask position with numpy : 0.034485816955566406 nb_pixel_total : 5205 time to create 1 rle with old method : 0.00596308708190918 time for calcul the mask position with numpy : 0.03482961654663086 nb_pixel_total : 9382 time to create 1 rle with old method : 0.014691591262817383 time for calcul the mask position with numpy : 0.03895139694213867 nb_pixel_total : 64798 time to create 1 rle with old method : 0.0723867416381836 time for calcul the mask position with numpy : 0.035150766372680664 nb_pixel_total : 13874 time to create 1 rle with old method : 0.01584172248840332 time for calcul the mask position with numpy : 0.03392195701599121 nb_pixel_total : 3918 time to create 1 rle with old method : 0.0045871734619140625 time for calcul the mask position with numpy : 0.034026145935058594 nb_pixel_total : 2046 time to create 1 rle with old method : 0.0024373531341552734 time for calcul the mask position with numpy : 0.03450131416320801 nb_pixel_total : 34648 time to create 1 rle with old method : 0.03874349594116211 time for calcul the mask position with numpy : 0.03457212448120117 nb_pixel_total : 9438 time to create 1 rle with old method : 0.010392189025878906 time for calcul the mask position with numpy : 0.034653425216674805 nb_pixel_total : 8238 time to create 1 rle with old method : 0.013443231582641602 time for calcul the mask position with numpy : 0.038626909255981445 nb_pixel_total : 24482 time to create 1 rle with old method : 0.03263068199157715 time for calcul the mask position with numpy : 0.03416705131530762 nb_pixel_total : 7868 time to create 1 rle with old method : 0.008798599243164062 time for calcul the mask position with numpy : 0.033859968185424805 nb_pixel_total : 5349 time to create 1 rle with old method : 0.006071567535400391 time for calcul the mask position with numpy : 0.03355216979980469 nb_pixel_total : 9374 time to create 1 rle with old method : 0.010396480560302734 create new chi : 4.676501750946045 time to delete rle : 0.10957717895507812 batch 1 Loaded 71 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19479 TO DO : save crop sub photo not yet done ! save time : 2.0502171516418457 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.684434652328491 time for calcul the mask position with numpy : 0.7482130527496338 nb_pixel_total : 7850129 time to create 1 rle with new method : 0.9350662231445312 time for calcul the mask position with numpy : 0.02486896514892578 nb_pixel_total : 23865 time to create 1 rle with old method : 0.026520967483520508 time for calcul the mask position with numpy : 0.025544166564941406 nb_pixel_total : 45798 time to create 1 rle with old method : 0.05071210861206055 time for calcul the mask position with numpy : 0.02500438690185547 nb_pixel_total : 41485 time to create 1 rle with old method : 0.04588937759399414 time for calcul the mask position with numpy : 0.024756431579589844 nb_pixel_total : 25135 time to create 1 rle with old method : 0.028222322463989258 time for calcul the mask position with numpy : 0.025829315185546875 nb_pixel_total : 15817 time to create 1 rle with old method : 0.01755833625793457 time for calcul the mask position with numpy : 0.02708268165588379 nb_pixel_total : 239633 time to create 1 rle with new method : 0.6894264221191406 time for calcul the mask position with numpy : 0.025490522384643555 nb_pixel_total : 38641 time to create 1 rle with old method : 0.04608488082885742 time for calcul the mask position with numpy : 0.02560567855834961 nb_pixel_total : 13897 time to create 1 rle with old method : 0.015512943267822266 create new chi : 2.873640775680542 time to delete rle : 0.001394510269165039 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 6310 TO DO : save crop sub photo not yet done ! save time : 0.8088390827178955 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.4019763469696045 time for calcul the mask position with numpy : 0.7308022975921631 nb_pixel_total : 7569260 time to create 1 rle with new method : 0.8931577205657959 time for calcul the mask position with numpy : 0.03343772888183594 nb_pixel_total : 51262 time to create 1 rle with old method : 0.056630611419677734 time for calcul the mask position with numpy : 0.024904489517211914 nb_pixel_total : 36763 time to create 1 rle with old method : 0.03949618339538574 time for calcul the mask position with numpy : 0.024252891540527344 nb_pixel_total : 12826 time to create 1 rle with old method : 0.01440572738647461 time for calcul the mask position with numpy : 0.024771690368652344 nb_pixel_total : 37743 time to create 1 rle with old method : 0.039838314056396484 time for calcul the mask position with numpy : 0.02454829216003418 nb_pixel_total : 53363 time to create 1 rle with old method : 0.057480573654174805 time for calcul the mask position with numpy : 0.025114059448242188 nb_pixel_total : 145672 time to create 1 rle with old method : 0.16179990768432617 time for calcul the mask position with numpy : 0.04117178916931152 nb_pixel_total : 178857 time to create 1 rle with new method : 0.7387301921844482 time for calcul the mask position with numpy : 0.03910374641418457 nb_pixel_total : 16417 time to create 1 rle with old method : 0.01770329475402832 time for calcul the mask position with numpy : 0.023866891860961914 nb_pixel_total : 37102 time to create 1 rle with old method : 0.0399630069732666 time for calcul the mask position with numpy : 0.023783206939697266 nb_pixel_total : 41413 time to create 1 rle with old method : 0.04499387741088867 time for calcul the mask position with numpy : 0.023235082626342773 nb_pixel_total : 53290 time to create 1 rle with old method : 0.057671546936035156 time for calcul the mask position with numpy : 0.024278640747070312 nb_pixel_total : 25721 time to create 1 rle with old method : 0.027728796005249023 time for calcul the mask position with numpy : 0.023781299591064453 nb_pixel_total : 34711 time to create 1 rle with old method : 0.03842902183532715 create new chi : 3.3847506046295166 time to delete rle : 0.0015859603881835938 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 10703 TO DO : save crop sub photo not yet done ! save time : 1.2466156482696533 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 7.048036575317383 time for calcul the mask position with numpy : 0.5150721073150635 nb_pixel_total : 7625989 time to create 1 rle with new method : 0.7106857299804688 time for calcul the mask position with numpy : 0.04249978065490723 nb_pixel_total : 93474 time to create 1 rle with old method : 0.10549378395080566 time for calcul the mask position with numpy : 0.03342032432556152 nb_pixel_total : 72359 time to create 1 rle with old method : 0.08193063735961914 time for calcul the mask position with numpy : 0.032643795013427734 nb_pixel_total : 14345 time to create 1 rle with old method : 0.016179561614990234 time for calcul the mask position with numpy : 0.030731916427612305 nb_pixel_total : 36986 time to create 1 rle with old method : 0.042017221450805664 time for calcul the mask position with numpy : 0.03119492530822754 nb_pixel_total : 13328 time to create 1 rle with old method : 0.015243053436279297 time for calcul the mask position with numpy : 0.027916669845581055 nb_pixel_total : 73121 time to create 1 rle with old method : 0.0831294059753418 time for calcul the mask position with numpy : 0.028440237045288086 nb_pixel_total : 81122 time to create 1 rle with old method : 0.09124994277954102 time for calcul the mask position with numpy : 0.02650761604309082 nb_pixel_total : 24847 time to create 1 rle with old method : 0.027688264846801758 time for calcul the mask position with numpy : 0.026012420654296875 nb_pixel_total : 25984 time to create 1 rle with old method : 0.029207706451416016 time for calcul the mask position with numpy : 0.0251772403717041 nb_pixel_total : 28422 time to create 1 rle with old method : 0.03495335578918457 time for calcul the mask position with numpy : 0.02771162986755371 nb_pixel_total : 34433 time to create 1 rle with old method : 0.05057573318481445 time for calcul the mask position with numpy : 0.026976585388183594 nb_pixel_total : 16042 time to create 1 rle with old method : 0.017547130584716797 time for calcul the mask position with numpy : 0.026314496994018555 nb_pixel_total : 75089 time to create 1 rle with old method : 0.08235764503479004 time for calcul the mask position with numpy : 0.025895357131958008 nb_pixel_total : 27053 time to create 1 rle with old method : 0.029865741729736328 time for calcul the mask position with numpy : 0.026307106018066406 nb_pixel_total : 39500 time to create 1 rle with old method : 0.06294679641723633 time for calcul the mask position with numpy : 0.02543330192565918 nb_pixel_total : 12306 time to create 1 rle with old method : 0.01383209228515625 create new chi : 2.522355318069458 time to delete rle : 0.0014140605926513672 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11120 TO DO : save crop sub photo not yet done ! save time : 1.276653528213501 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 4.2178473472595215 time for calcul the mask position with numpy : 0.4571347236633301 nb_pixel_total : 7798819 time to create 1 rle with new method : 0.6982889175415039 time for calcul the mask position with numpy : 0.024322032928466797 nb_pixel_total : 70708 time to create 1 rle with old method : 0.07727265357971191 time for calcul the mask position with numpy : 0.023723363876342773 nb_pixel_total : 7890 time to create 1 rle with old method : 0.008652925491333008 time for calcul the mask position with numpy : 0.024521589279174805 nb_pixel_total : 24397 time to create 1 rle with old method : 0.026821374893188477 time for calcul the mask position with numpy : 0.024662017822265625 nb_pixel_total : 30595 time to create 1 rle with old method : 0.03348350524902344 time for calcul the mask position with numpy : 0.02507615089416504 nb_pixel_total : 83882 time to create 1 rle with old method : 0.09354543685913086 time for calcul the mask position with numpy : 0.02790975570678711 nb_pixel_total : 7284 time to create 1 rle with old method : 0.008342742919921875 time for calcul the mask position with numpy : 0.026681900024414062 nb_pixel_total : 33922 time to create 1 rle with old method : 0.04142594337463379 time for calcul the mask position with numpy : 0.028479337692260742 nb_pixel_total : 104468 time to create 1 rle with old method : 0.11517930030822754 time for calcul the mask position with numpy : 0.024566173553466797 nb_pixel_total : 132435 time to create 1 rle with old method : 0.1433393955230713 create new chi : 1.979212999343872 time to delete rle : 0.0010089874267578125 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 7382 TO DO : save crop sub photo not yet done ! save time : 0.9024093151092529 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 4.985051155090332 time for calcul the mask position with numpy : 0.3061816692352295 nb_pixel_total : 7428142 time to create 1 rle with new method : 0.8311243057250977 time for calcul the mask position with numpy : 0.024043560028076172 nb_pixel_total : 24892 time to create 1 rle with old method : 0.027503490447998047 time for calcul the mask position with numpy : 0.023980140686035156 nb_pixel_total : 52714 time to create 1 rle with old method : 0.05805206298828125 time for calcul the mask position with numpy : 0.024473905563354492 nb_pixel_total : 129279 time to create 1 rle with old method : 0.14191579818725586 time for calcul the mask position with numpy : 0.024633407592773438 nb_pixel_total : 12608 time to create 1 rle with old method : 0.013837099075317383 time for calcul the mask position with numpy : 0.024340152740478516 nb_pixel_total : 24027 time to create 1 rle with old method : 0.026024818420410156 time for calcul the mask position with numpy : 0.024427175521850586 nb_pixel_total : 68866 time to create 1 rle with old method : 0.07451057434082031 time for calcul the mask position with numpy : 0.024588584899902344 nb_pixel_total : 46565 time to create 1 rle with old method : 0.05091047286987305 time for calcul the mask position with numpy : 0.02797842025756836 nb_pixel_total : 215428 time to create 1 rle with new method : 0.8412444591522217 time for calcul the mask position with numpy : 0.025238990783691406 nb_pixel_total : 84495 time to create 1 rle with old method : 0.09569168090820312 time for calcul the mask position with numpy : 0.025988340377807617 nb_pixel_total : 78159 time to create 1 rle with old method : 0.10760116577148438 time for calcul the mask position with numpy : 0.026589155197143555 nb_pixel_total : 42629 time to create 1 rle with old method : 0.04760026931762695 time for calcul the mask position with numpy : 0.024097204208374023 nb_pixel_total : 86596 time to create 1 rle with old method : 0.09395599365234375 create new chi : 3.0886151790618896 time to delete rle : 0.0014336109161376953 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10430 TO DO : save crop sub photo not yet done ! save time : 1.1990015506744385 map_output_result : {1387179576: (0.0, 'Should be the crop_list due to order', 0), 1387179567: (0.0, 'Should be the crop_list due to order', 0), 1387179542: (0.0, 'Should be the crop_list due to order', 0), 1387179524: (0.0, 'Should be the crop_list due to order', 0), 1387179512: (0.0, 'Should be the crop_list due to order', 0), 1387179506: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1387179576, 1387179567, 1387179542, 1387179524, 1387179512, 1387179506] Looping around the photos to save general results len do output : 6 /1387179576.Didn't retrieve data . /1387179567.Didn't retrieve data . /1387179542.Didn't retrieve data . /1387179524.Didn't retrieve data . /1387179512.Didn't retrieve data . /1387179506.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179576', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179567', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179542', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179524', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179512', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179506', None, None, None, None, None, '3808322') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.03703427314758301 save_final save missing photos in datou_result : time spend for datou_step_exec : 56.81397318840027 time spend to save output : 0.037413597106933594 total time spend for step 3 : 56.8513867855072 step4:ventilate_hashtags_in_portfolio Wed Oct 1 15:13:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27406524 get user id for portfolio 27406524 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27406524 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','metal','carton','pehd','autre','background','papier','pet_fonce','flou','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27406524 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','metal','carton','pehd','autre','background','papier','pet_fonce','flou','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27406524 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','metal','carton','pehd','autre','background','papier','pet_fonce','flou','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27406951,27406952,27406953,27406954,27406955,27406956,27406957,27406958,27406959,27406960,27406961?tags=environnement,metal,carton,pehd,autre,background,papier,pet_fonce,flou,mal_croppe,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1387179576, 1387179567, 1387179542, 1387179524, 1387179512, 1387179506] Looping around the photos to save general results len do output : 1 /27406524. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179576', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179567', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179542', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179524', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179512', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179506', None, None, None, None, None, '3808322') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.03675222396850586 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.562963008880615 time spend to save output : 0.0370481014251709 total time spend for step 4 : 5.600011110305786 step5:final Wed Oct 1 15:13:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1387179576: ('0.08618425282921811',), 1387179567: ('0.08618425282921811',), 1387179542: ('0.08618425282921811',), 1387179524: ('0.08618425282921811',), 1387179512: ('0.08618425282921811',), 1387179506: ('0.08618425282921811',)} new output for save of step final : {1387179576: ('0.08618425282921811',), 1387179567: ('0.08618425282921811',), 1387179542: ('0.08618425282921811',), 1387179524: ('0.08618425282921811',), 1387179512: ('0.08618425282921811',), 1387179506: ('0.08618425282921811',)} [1387179576, 1387179567, 1387179542, 1387179524, 1387179512, 1387179506] Looping around the photos to save general results len do output : 6 /1387179576.Didn't retrieve data . /1387179567.Didn't retrieve data . /1387179542.Didn't retrieve data . /1387179524.Didn't retrieve data . /1387179512.Didn't retrieve data . /1387179506.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179576', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179567', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179542', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179524', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179512', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179506', None, None, None, None, None, '3808322') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.0370936393737793 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3806493282318115 time spend to save output : 0.03773140907287598 total time spend for step 5 : 0.4183807373046875 step6:blur_detection Wed Oct 1 15:13:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5.jpg resize: (2160, 3840) 1387179576 -6.863866763670597 treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba.jpg resize: (2160, 3840) 1387179567 -6.916530754827416 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151.jpg resize: (2160, 3840) 1387179542 -6.825541548957533 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606.jpg resize: (2160, 3840) 1387179524 -6.815422700990476 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6.jpg resize: (2160, 3840) 1387179512 -6.702242429209109 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e.jpg resize: (2160, 3840) 1387179506 -6.262469561964787 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475314_0.png resize: (124, 122) 1387187973 -1.8918824703111763 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475308_0.png resize: (193, 165) 1387187974 -3.2448495252795095 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475281_0.png resize: (248, 307) 1387187975 -3.907491983489545 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475304_0.png resize: (569, 344) 1387187976 -3.856647003410771 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475310_0.png resize: (212, 477) 1387187977 -4.445068132405673 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475306_0.png resize: (167, 120) 1387187978 0.296619295590569 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475298_0.png resize: (172, 190) 1387187979 0.36471902131067463 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475280_0.png resize: (74, 183) 1387187980 -3.1956908667135164 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475285_0.png resize: (81, 160) 1387187981 -4.334440997506748 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475282_0.png resize: (314, 257) 1387187982 -5.073347113847915 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475293_0.png resize: (82, 116) 1387187983 -4.644587563527252 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475307_0.png resize: (125, 154) 1387187984 -3.3780108200586234 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475291_0.png resize: (271, 271) 1387187985 -2.9417948758449466 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475302_0.png resize: (273, 223) 1387187986 -0.8043840655315542 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475311_0.png resize: (209, 110) 1387187987 -3.622529830805361 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475286_0.png resize: (80, 176) 1387187988 -3.1915633979308575 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475290_0.png resize: (265, 300) 1387187989 -3.676144421149291 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475284_0.png resize: (230, 203) 1387187990 -4.0285441208727875 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475295_0.png resize: (128, 142) 1387187991 -3.585956982188057 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475287_0.png resize: (238, 144) 1387187992 -3.5795620256641 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475305_0.png resize: (226, 183) 1387187994 -3.338817066641359 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475292_0.png resize: (517, 232) 1387188000 -4.176022047418518 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475288_0.png resize: (261, 247) 1387188005 -4.611614096337822 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475309_0.png resize: (405, 377) 1387188006 -3.730399377542602 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475283_0.png resize: (431, 185) 1387188007 -3.1042764536169787 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475294_0.png resize: (113, 168) 1387188008 -4.220944822116934 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475312_0.png resize: (101, 116) 1387188009 -1.437785832322842 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475303_0.png resize: (296, 142) 1387188010 -3.9487728110110605 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475297_0.png resize: (249, 217) 1387188011 -2.8446505360629133 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475289_0.png resize: (289, 192) 1387188015 -4.1171988499419 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475296_0.png resize: (298, 132) 1387188016 -4.018074926737049 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475300_0.png resize: (275, 99) 1387188017 -3.088830113043129 treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475316_0.png resize: (271, 231) 1387188018 -4.29759284206022 treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475315_0.png resize: (105, 191) 1387188019 -1.1342296985658453 treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475317_0.png resize: (459, 704) 1387188020 1.1635992033789486 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475330_0.png resize: (630, 365) 1387188021 -4.602263365281899 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475329_0.png resize: (498, 538) 1387188022 -2.4392463678485035 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475331_0.png resize: (212, 370) 1387188023 -2.896173069678829 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475323_0.png resize: (239, 234) 1387188024 -1.110296241426276 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475332_0.png resize: (267, 247) 1387188025 -2.719470561371917 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475325_0.png resize: (253, 388) 1387188026 -2.4538415024070304 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475328_0.png resize: (179, 115) 1387188027 -2.1889559981120246 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475324_0.png resize: (230, 169) 1387188028 -4.501986928872295 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475333_0.png resize: (264, 77) 1387188029 -4.447086705419854 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475326_0.png resize: (377, 175) 1387188031 -4.142700572267804 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475351_0.png resize: (563, 381) 1387188035 -3.0963517961802753 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475337_0.png resize: (262, 208) 1387188036 -2.022149246247127 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475336_0.png resize: (118, 142) 1387188037 -2.573996269540177 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475344_0.png resize: (277, 238) 1387188038 -1.5332900897396602 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475339_0.png resize: (393, 250) 1387188039 -4.492643157454722 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475347_0.png resize: (168, 155) 1387188040 -3.1128458859986234 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475340_0.png resize: (183, 123) 1387188041 -4.42285716289898 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475343_0.png resize: (252, 241) 1387188042 0.5124028960439145 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475338_0.png resize: (198, 242) 1387188044 -3.2623136797164958 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475350_0.png resize: (431, 230) 1387188045 -4.956063564427039 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475349_0.png resize: (144, 136) 1387188048 -3.3515036508308174 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475348_0.png resize: (176, 313) 1387188049 -4.0245326656580085 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475342_0.png resize: (290, 155) 1387188050 -3.368384199225295 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475354_0.png resize: (275, 161) 1387188051 -1.6071685978788046 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475359_0.png resize: (123, 87) 1387188052 -3.571796351194638 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475358_0.png resize: (137, 286) 1387188053 -5.446157042031687 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475356_0.png resize: (366, 339) 1387188054 -1.4169730299731444 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475355_0.png resize: (107, 82) 1387188055 2.5951353038711344 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475352_0.png resize: (361, 489) 1387188056 -4.377291583141535 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475353_0.png resize: (457, 315) 1387188058 -3.2386052979417044 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475357_0.png resize: (321, 147) 1387188059 -3.1062262319812026 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475372_0.png resize: (165, 245) 1387188060 -2.7433610486140165 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475365_0.png resize: (591, 624) 1387188062 -4.582850254498275 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475369_0.png resize: (160, 102) 1387188063 -0.46748220921569617 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475368_0.png resize: (203, 249) 1387188064 -0.012956991173592078 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475362_0.png resize: (345, 202) 1387188065 -2.3009476335235206 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475366_0.png resize: (335, 221) 1387188066 -2.6570067344152455 treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475318_0.png resize: (158, 136) 1387188070 -2.7917357611740945 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475327_0.png resize: (277, 212) 1387188071 -3.6675018272913116 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475341_0.png resize: (181, 292) 1387188072 -0.7351351608128728 treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475320_0.png resize: (235, 253) 1387188089 -4.538234259603615 treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475321_0.png resize: (210, 262) 1387188090 -3.882690839782631 treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475322_0.png resize: (181, 195) 1387188091 -4.4821873059450965 treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475319_0.png resize: (246, 136) 1387188092 -3.0140044897075096 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475334_0.png resize: (277, 184) 1387188093 -4.580232338055937 treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475335_0.png resize: (242, 341) 1387188095 -4.672676473557845 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475345_0.png resize: (215, 447) 1387188096 -3.4531856240074887 treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475346_0.png resize: (354, 252) 1387188097 -3.7091020724252957 treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475360_0.png resize: (315, 338) 1387188098 -3.4524561248861296 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475370_0.png resize: (393, 453) 1387188099 -4.7834604529995 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475361_0.png resize: (274, 586) 1387188100 -2.905965998761289 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475367_0.png resize: (225, 409) 1387188101 -5.0514426754919715 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475364_0.png resize: (463, 276) 1387188102 -4.705760306878045 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475363_0.png resize: (269, 401) 1387188103 -3.4805341293164482 treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475371_0.png resize: (275, 278) 1387188107 -2.6562317513428986 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475299_0.png resize: (64, 216) 1387188109 -3.0148458111050527 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475301_0.png resize: (104, 120) 1387188110 -2.5403969357628378 treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475313_0.png resize: (99, 126) 1387188111 -3.330285871087442 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.03933858871459961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.038758039474487305 save missing photos in datou_result : time spend for datou_step_exec : 24.863051652908325 time spend to save output : 0.09623241424560547 total time spend for step 6 : 24.95928406715393 step7:brightness Wed Oct 1 15:13:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5.jpg treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba.jpg treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151.jpg treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606.jpg treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6.jpg treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e.jpg treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475314_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475308_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475281_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475304_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475310_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475306_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475298_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475280_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475285_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475282_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475293_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475307_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475291_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475302_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475311_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475286_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475290_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475284_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475295_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475287_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475305_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475292_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475288_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475309_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475283_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475294_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475312_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475303_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475297_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475289_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475296_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475300_0.png treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475316_0.png treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475315_0.png treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475317_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475330_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475329_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475331_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475323_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475332_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475325_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475328_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475324_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475333_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475326_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475351_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475337_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475336_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475344_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475339_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475347_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475340_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475343_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475338_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475350_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475349_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475348_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475342_0.png treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475354_0.png treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475359_0.png treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475358_0.png treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475356_0.png treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475355_0.png treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475352_0.png treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475353_0.png treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475357_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475372_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475365_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475369_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475368_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475362_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475366_0.png treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475318_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475327_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475341_0.png treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475320_0.png treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475321_0.png treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475322_0.png treat image : temp/1759324227_2805671_1387179567_d276b1398b380451179c48cbd0fb09ba_rle_crop_3982475319_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475334_0.png treat image : temp/1759324227_2805671_1387179542_66108a8dc041a930245cb04bf2717151_rle_crop_3982475335_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475345_0.png treat image : temp/1759324227_2805671_1387179524_f37a9acdbee83f8090b030a973022606_rle_crop_3982475346_0.png treat image : temp/1759324227_2805671_1387179512_399b59d172d44723394bdee7294422a6_rle_crop_3982475360_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475370_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475361_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475367_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475364_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475363_0.png treat image : temp/1759324227_2805671_1387179506_bbde2d50f867803628ee9ba79156b74e_rle_crop_3982475371_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475299_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475301_0.png treat image : temp/1759324227_2805671_1387179576_f0de22cb28d8712dd29fe36d1e5a41e5_rle_crop_3982475313_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.03870654106140137 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.03918766975402832 save missing photos in datou_result : time spend for datou_step_exec : 5.942649602890015 time spend to save output : 0.09602975845336914 total time spend for step 7 : 6.038679361343384 step8:velours_tree Wed Oct 1 15:13:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1658644676208496 time spend to save output : 4.792213439941406e-05 total time spend for step 8 : 0.16591238975524902 step9:send_mail_cod Wed Oct 1 15:13:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27406524_01-10-2025_15_13_59.pdf 27406952 imagette274069521759324439 27406953 change filename to text .change filename to text .change filename to text .imagette274069531759324439 27406954 imagette274069541759324440 27406955 change filename to text .change filename to text .change filename to text .imagette274069551759324440 27406956 imagette274069561759324440 27406957 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274069571759324440 27406958 imagette274069581759324442 27406959 imagette274069591759324442 27406960 imagette274069601759324442 27406961 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274069611759324442 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27406524 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27406951,27406952,27406953,27406954,27406955,27406956,27406957,27406958,27406959,27406960,27406961?tags=environnement,metal,carton,pehd,autre,background,papier,pet_fonce,flou,mal_croppe,pet_clair args[1387179576] : ((1387179576, -6.863866763670597, 492609224), (1387179576, 0.962092137317155, 2107752395), '0.08618425282921811') We are sending mail with results at report@fotonower.com args[1387179567] : ((1387179567, -6.916530754827416, 492609224), (1387179567, 0.9449449763288268, 2107752395), '0.08618425282921811') We are sending mail with results at report@fotonower.com args[1387179542] : ((1387179542, -6.825541548957533, 492609224), (1387179542, 0.9467408739832947, 2107752395), '0.08618425282921811') We are sending mail with results at report@fotonower.com args[1387179524] : ((1387179524, -6.815422700990476, 492609224), (1387179524, 0.9392477040739162, 2107752395), '0.08618425282921811') We are sending mail with results at report@fotonower.com args[1387179512] : ((1387179512, -6.702242429209109, 492609224), (1387179512, 0.9996491064880595, 2107752395), '0.08618425282921811') We are sending mail with results at report@fotonower.com args[1387179506] : ((1387179506, -6.262469561964787, 492609224), (1387179506, 0.7833248085536767, 2107752395), '0.08618425282921811') We are sending mail with results at report@fotonower.com refus_total : 0.08618425282921811 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27406524 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27406524_01-10-2025_15_13_59.pdf results_Auto_P27406524_01-10-2025_15_13_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27406524_01-10-2025_15_13_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27406524','results_Auto_P27406524_01-10-2025_15_13_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27406524_01-10-2025_15_13_59.pdf','pdf','','0.44','0.08618425282921811') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27406524

https://www.fotonower.com/image?json=false&list_photos_id=1387179576
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387179567
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387179542
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387179524
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387179512
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387179506
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.62%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/27406953?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27406955?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27406957?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27406961?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27406524_01-10-2025_15_13_59.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27406951,27406952,27406953,27406954,27406955,27406956,27406957,27406958,27406959,27406960,27406961?tags=environnement,metal,carton,pehd,autre,background,papier,pet_fonce,flou,mal_croppe,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 01 Oct 2025 13:14:06 GMT Content-Length: 0 Connection: close X-Message-Id: SaDX4r24Qla7LisHjTsDXg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1387179576, 1387179567, 1387179542, 1387179524, 1387179512, 1387179506] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179576', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179567', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179542', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179524', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179512', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179506', None, None, None, None, None, '3808322') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.04602360725402832 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.748751163482666 time spend to save output : 0.046209096908569336 total time spend for step 9 : 6.794960260391235 step10:split_time_score Wed Oct 1 15:14:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01102025 27406524 Nombre de photos uploadées : 6 / 23040 (0%) 01102025 27406524 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 01102025 27406524 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.0003807544708251953 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6544535160064697 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.052248550851368605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27387787_01-10-2025_07_37_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27387787 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27387787 AND mptpi.`type`=3726 To do Qualite : 0.04879990079874824 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27387808_01-10-2025_07_31_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27387808 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27387808 AND mptpi.`type`=3726 To do Qualite : 0.021150770851721335 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27387815_01-10-2025_07_22_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27387815 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27387815 AND mptpi.`type`=3726 To do Qualite : 0.03766507046302981 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27394663_01-10-2025_09_46_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27394663 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27394663 AND mptpi.`type`=3726 To do Qualite : 0.015083201898604156 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27403858_01-10-2025_13_47_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27403858 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27403858 AND mptpi.`type`=3726 To do Qualite : 0.10601279846107683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27403865_01-10-2025_13_46_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27403865 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27403865 AND mptpi.`type`=3594 To do Qualite : 0.08618425282921811 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27406524_01-10-2025_15_13_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27406524 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27406524 AND mptpi.`type`=3594 To do Qualite : 0.024958104355746625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27406561_01-10-2025_15_07_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27406561 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27406561 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01102025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1387179576, 1387179567, 1387179542, 1387179524, 1387179512, 1387179506] Looping around the photos to save general results len do output : 1 /27406524Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179576', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179567', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179542', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179524', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179512', None, None, None, None, None, '3808322') ('3318', None, None, None, None, None, None, None, '3808322') ('3318', '27406524', '1387179506', None, None, None, None, None, '3808322') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.037052154541015625 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.9444031715393066 time spend to save output : 0.03729867935180664 total time spend for step 10 : 2.9817018508911133 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 94.39user 74.84system 3:45.01elapsed 75%CPU (0avgtext+0avgdata 3700300maxresident)k 813952inputs+78384outputs (9925major+9077393minor)pagefaults 0swaps