python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1485104 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3972126'] with mtr_portfolio_ids : ['28010191'] and first list_photo_ids : [] new path : /proc/1485104/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 2.6956474781036377 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Oct 31 13:30:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-31 13:30:32.986660: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-31 13:30:33.014506: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-31 13:30:33.016557: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6ee8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-31 13:30:33.016587: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-31 13:30:33.020592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-31 13:30:33.315136: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x24a5bb60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-31 13:30:33.315195: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-31 13:30:33.316537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 13:30:33.317026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 13:30:33.320377: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 13:30:33.323500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 13:30:33.324051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 13:30:33.327628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 13:30:33.329434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 13:30:33.334733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 13:30:33.336260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 13:30:33.336345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 13:30:33.337109: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 13:30:33.337125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 13:30:33.337134: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 13:30:33.338491: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-31 13:30:33.609535: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 13:30:33.609623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 13:30:33.609643: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 13:30:33.609661: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 13:30:33.609678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 13:30:33.609696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 13:30:33.609713: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 13:30:33.609730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 13:30:33.611361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 13:30:33.612794: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 13:30:33.612842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 13:30:33.612860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 13:30:33.612877: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 13:30:33.612894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 13:30:33.612911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 13:30:33.612927: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 13:30:33.612944: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 13:30:33.614565: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 13:30:33.614601: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 13:30:33.614613: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 13:30:33.614622: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 13:30:33.616091: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-31 13:30:41.884874: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 13:30:42.070877: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 Detection mask done ! Trying to reset tf kernel 1485707 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7218 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005950927734375 nb_pixel_total : 18535 time to create 1 rle with old method : 0.0203397274017334 length of segment : 97 time for calcul the mask position with numpy : 0.0003845691680908203 nb_pixel_total : 18231 time to create 1 rle with old method : 0.019245147705078125 length of segment : 168 time for calcul the mask position with numpy : 0.0036263465881347656 nb_pixel_total : 149435 time to create 1 rle with old method : 0.15456080436706543 length of segment : 383 time for calcul the mask position with numpy : 0.0001671314239501953 nb_pixel_total : 5618 time to create 1 rle with old method : 0.006166934967041016 length of segment : 86 time for calcul the mask position with numpy : 0.0017015933990478516 nb_pixel_total : 112834 time to create 1 rle with old method : 0.11934375762939453 length of segment : 329 time for calcul the mask position with numpy : 0.0004279613494873047 nb_pixel_total : 22044 time to create 1 rle with old method : 0.023741960525512695 length of segment : 207 time for calcul the mask position with numpy : 0.0014133453369140625 nb_pixel_total : 87870 time to create 1 rle with old method : 0.09255766868591309 length of segment : 340 time for calcul the mask position with numpy : 0.00028634071350097656 nb_pixel_total : 16444 time to create 1 rle with old method : 0.01791095733642578 length of segment : 90 time for calcul the mask position with numpy : 0.00021886825561523438 nb_pixel_total : 10842 time to create 1 rle with old method : 0.011940240859985352 length of segment : 88 time for calcul the mask position with numpy : 0.000339508056640625 nb_pixel_total : 13931 time to create 1 rle with old method : 0.015308856964111328 length of segment : 138 time for calcul the mask position with numpy : 0.0003695487976074219 nb_pixel_total : 21398 time to create 1 rle with old method : 0.023531436920166016 length of segment : 119 time for calcul the mask position with numpy : 0.00028252601623535156 nb_pixel_total : 11679 time to create 1 rle with old method : 0.012476444244384766 length of segment : 236 time for calcul the mask position with numpy : 0.0023260116577148438 nb_pixel_total : 129536 time to create 1 rle with old method : 0.1349501609802246 length of segment : 468 time for calcul the mask position with numpy : 0.0015132427215576172 nb_pixel_total : 84590 time to create 1 rle with old method : 0.08816266059875488 length of segment : 373 time for calcul the mask position with numpy : 0.0008938312530517578 nb_pixel_total : 39010 time to create 1 rle with old method : 0.042471885681152344 length of segment : 269 time for calcul the mask position with numpy : 0.0003154277801513672 nb_pixel_total : 12837 time to create 1 rle with old method : 0.013995170593261719 length of segment : 145 time for calcul the mask position with numpy : 0.00048732757568359375 nb_pixel_total : 25799 time to create 1 rle with old method : 0.030658245086669922 length of segment : 241 time for calcul the mask position with numpy : 0.0001399517059326172 nb_pixel_total : 5646 time to create 1 rle with old method : 0.006072521209716797 length of segment : 86 time for calcul the mask position with numpy : 0.0011067390441894531 nb_pixel_total : 66355 time to create 1 rle with old method : 0.07005095481872559 length of segment : 306 time for calcul the mask position with numpy : 0.0003540515899658203 nb_pixel_total : 22290 time to create 1 rle with old method : 0.02353382110595703 length of segment : 211 time for calcul the mask position with numpy : 0.0007767677307128906 nb_pixel_total : 48600 time to create 1 rle with old method : 0.05112123489379883 length of segment : 221 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 34698 time to create 1 rle with old method : 0.03697061538696289 length of segment : 254 time for calcul the mask position with numpy : 0.0002942085266113281 nb_pixel_total : 12004 time to create 1 rle with old method : 0.013282060623168945 length of segment : 129 time for calcul the mask position with numpy : 0.0010993480682373047 nb_pixel_total : 65575 time to create 1 rle with old method : 0.07152771949768066 length of segment : 232 time for calcul the mask position with numpy : 0.00031256675720214844 nb_pixel_total : 16963 time to create 1 rle with old method : 0.01835465431213379 length of segment : 166 time for calcul the mask position with numpy : 0.0017604827880859375 nb_pixel_total : 95822 time to create 1 rle with old method : 0.10170745849609375 length of segment : 485 time for calcul the mask position with numpy : 0.0005180835723876953 nb_pixel_total : 23623 time to create 1 rle with old method : 0.02582836151123047 length of segment : 197 time for calcul the mask position with numpy : 0.0005669593811035156 nb_pixel_total : 31982 time to create 1 rle with old method : 0.034063100814819336 length of segment : 219 time for calcul the mask position with numpy : 0.0014843940734863281 nb_pixel_total : 99183 time to create 1 rle with old method : 0.1052405834197998 length of segment : 327 time for calcul the mask position with numpy : 0.0003638267517089844 nb_pixel_total : 19481 time to create 1 rle with old method : 0.02081894874572754 length of segment : 179 time for calcul the mask position with numpy : 0.000698089599609375 nb_pixel_total : 34676 time to create 1 rle with old method : 0.03716754913330078 length of segment : 281 time for calcul the mask position with numpy : 0.0007572174072265625 nb_pixel_total : 37875 time to create 1 rle with old method : 0.040242910385131836 length of segment : 328 time for calcul the mask position with numpy : 0.0008358955383300781 nb_pixel_total : 59342 time to create 1 rle with old method : 0.06337952613830566 length of segment : 284 time for calcul the mask position with numpy : 0.004571199417114258 nb_pixel_total : 193666 time to create 1 rle with new method : 0.012117147445678711 length of segment : 488 time for calcul the mask position with numpy : 0.0003771781921386719 nb_pixel_total : 20290 time to create 1 rle with old method : 0.02240157127380371 length of segment : 128 time for calcul the mask position with numpy : 0.0004138946533203125 nb_pixel_total : 18937 time to create 1 rle with old method : 0.021178483963012695 length of segment : 138 time for calcul the mask position with numpy : 0.0009500980377197266 nb_pixel_total : 39675 time to create 1 rle with old method : 0.04464292526245117 length of segment : 430 time for calcul the mask position with numpy : 0.0006630420684814453 nb_pixel_total : 48688 time to create 1 rle with old method : 0.053034067153930664 length of segment : 188 time for calcul the mask position with numpy : 0.00013136863708496094 nb_pixel_total : 4482 time to create 1 rle with old method : 0.004933357238769531 length of segment : 100 time for calcul the mask position with numpy : 0.0009555816650390625 nb_pixel_total : 67037 time to create 1 rle with old method : 0.07202005386352539 length of segment : 346 time for calcul the mask position with numpy : 0.00016427040100097656 nb_pixel_total : 6600 time to create 1 rle with old method : 0.007193565368652344 length of segment : 189 time for calcul the mask position with numpy : 0.0014657974243164062 nb_pixel_total : 98270 time to create 1 rle with old method : 0.10393595695495605 length of segment : 443 time for calcul the mask position with numpy : 0.00037598609924316406 nb_pixel_total : 21730 time to create 1 rle with old method : 0.02294611930847168 length of segment : 177 time for calcul the mask position with numpy : 0.00038886070251464844 nb_pixel_total : 21113 time to create 1 rle with old method : 0.022922992706298828 length of segment : 245 time for calcul the mask position with numpy : 0.00032019615173339844 nb_pixel_total : 19236 time to create 1 rle with old method : 0.02044820785522461 length of segment : 149 time for calcul the mask position with numpy : 0.0015103816986083984 nb_pixel_total : 106708 time to create 1 rle with old method : 0.11611390113830566 length of segment : 343 time for calcul the mask position with numpy : 0.0005590915679931641 nb_pixel_total : 30214 time to create 1 rle with old method : 0.032457590103149414 length of segment : 196 time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 37252 time to create 1 rle with old method : 0.040131330490112305 length of segment : 347 time for calcul the mask position with numpy : 0.0010721683502197266 nb_pixel_total : 51435 time to create 1 rle with old method : 0.05550885200500488 length of segment : 306 time for calcul the mask position with numpy : 0.0007016658782958984 nb_pixel_total : 41447 time to create 1 rle with old method : 0.04324221611022949 length of segment : 262 time for calcul the mask position with numpy : 0.0010476112365722656 nb_pixel_total : 73890 time to create 1 rle with old method : 0.08086204528808594 length of segment : 228 time for calcul the mask position with numpy : 0.0024938583374023438 nb_pixel_total : 81311 time to create 1 rle with old method : 0.08734917640686035 length of segment : 306 time for calcul the mask position with numpy : 0.0024836063385009766 nb_pixel_total : 73330 time to create 1 rle with old method : 0.07874059677124023 length of segment : 312 time for calcul the mask position with numpy : 0.0022661685943603516 nb_pixel_total : 65070 time to create 1 rle with old method : 0.06789088249206543 length of segment : 317 time for calcul the mask position with numpy : 0.0010006427764892578 nb_pixel_total : 28454 time to create 1 rle with old method : 0.029743194580078125 length of segment : 227 time for calcul the mask position with numpy : 0.0015773773193359375 nb_pixel_total : 64792 time to create 1 rle with old method : 0.06964635848999023 length of segment : 226 time for calcul the mask position with numpy : 0.00136566162109375 nb_pixel_total : 34831 time to create 1 rle with old method : 0.037181854248046875 length of segment : 286 time for calcul the mask position with numpy : 0.0007500648498535156 nb_pixel_total : 17362 time to create 1 rle with old method : 0.018714427947998047 length of segment : 127 time for calcul the mask position with numpy : 0.004024982452392578 nb_pixel_total : 145925 time to create 1 rle with old method : 0.15517711639404297 length of segment : 463 time for calcul the mask position with numpy : 0.006766080856323242 nb_pixel_total : 217302 time to create 1 rle with new method : 0.015009403228759766 length of segment : 584 time for calcul the mask position with numpy : 0.010545492172241211 nb_pixel_total : 343915 time to create 1 rle with new method : 0.01851344108581543 length of segment : 762 time for calcul the mask position with numpy : 0.001832723617553711 nb_pixel_total : 52075 time to create 1 rle with old method : 0.054492950439453125 length of segment : 310 time for calcul the mask position with numpy : 0.0010540485382080078 nb_pixel_total : 30601 time to create 1 rle with old method : 0.03301405906677246 length of segment : 258 time for calcul the mask position with numpy : 0.0006346702575683594 nb_pixel_total : 12972 time to create 1 rle with old method : 0.013877630233764648 length of segment : 156 time for calcul the mask position with numpy : 0.006287097930908203 nb_pixel_total : 246179 time to create 1 rle with new method : 0.01564192771911621 length of segment : 752 time for calcul the mask position with numpy : 0.0036132335662841797 nb_pixel_total : 136500 time to create 1 rle with old method : 0.14032649993896484 length of segment : 423 time for calcul the mask position with numpy : 0.0013020038604736328 nb_pixel_total : 37549 time to create 1 rle with old method : 0.043691158294677734 length of segment : 183 time for calcul the mask position with numpy : 0.0002989768981933594 nb_pixel_total : 12033 time to create 1 rle with old method : 0.0129241943359375 length of segment : 153 time for calcul the mask position with numpy : 0.0006189346313476562 nb_pixel_total : 23631 time to create 1 rle with old method : 0.02509617805480957 length of segment : 186 time for calcul the mask position with numpy : 0.0017287731170654297 nb_pixel_total : 38857 time to create 1 rle with old method : 0.04030632972717285 length of segment : 351 time for calcul the mask position with numpy : 0.0013089179992675781 nb_pixel_total : 48522 time to create 1 rle with old method : 0.050781965255737305 length of segment : 286 time for calcul the mask position with numpy : 0.0015723705291748047 nb_pixel_total : 58101 time to create 1 rle with old method : 0.06320500373840332 length of segment : 268 time for calcul the mask position with numpy : 0.0024518966674804688 nb_pixel_total : 86662 time to create 1 rle with old method : 0.09125661849975586 length of segment : 416 time for calcul the mask position with numpy : 0.0005612373352050781 nb_pixel_total : 22043 time to create 1 rle with old method : 0.02382516860961914 length of segment : 234 time for calcul the mask position with numpy : 0.0023734569549560547 nb_pixel_total : 89525 time to create 1 rle with old method : 0.09322285652160645 length of segment : 400 time for calcul the mask position with numpy : 0.0008723735809326172 nb_pixel_total : 23358 time to create 1 rle with old method : 0.024541378021240234 length of segment : 192 time for calcul the mask position with numpy : 0.0005087852478027344 nb_pixel_total : 12960 time to create 1 rle with old method : 0.013894081115722656 length of segment : 168 time spent for convertir_results : 6.658178329467773 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 77 chid ids of type : 3594 Number RLEs to save : 20731 save missing photos in datou_result : time spend for datou_step_exec : 49.028207540512085 time spend to save output : 1.105137586593628 total time spend for step 1 : 50.13334512710571 step2:crop_condition Fri Oct 31 13:31:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 77 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761913890_1485104 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855572_0.png', 0, 285, 97, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855574_0.png', 0, 571, 354, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855576_0.png', 0, 488, 329, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855583_0.png', 0, 74, 236, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855588_0.png', 0, 185, 206, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855590_0.png', 0, 412, 229, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855591_0.png', 0, 130, 210, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855593_0.png', 0, 190, 254, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855596_0.png', 0, 171, 143, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855603_0.png', 0, 229, 296, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855605_0.png', 0, 557, 484, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855607_0.png', 0, 239, 121, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855608_0.png', 0, 296, 249, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855611_0.png', 0, 296, 345, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855616_0.png', 0, 161, 148, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855620_0.png', 0, 377, 306, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855631_0.png', 0, 609, 534, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855632_0.png', 0, 779, 584, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855633_0.png', 0, 278, 310, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855636_0.png', 0, 510, 752, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855638_0.png', 0, 396, 149, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855639_0.png', 0, 112, 153, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855640_0.png', 0, 236, 179, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855644_0.png', 0, 334, 416, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855646_0.png', 0, 330, 399, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913896), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855647_0.png', 0, 205, 192, 0, 1761913896,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.7501959800720215 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761913900_1485104 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855577_0.png', 0, 128, 207, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855578_0.png', 0, 368, 328, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855581_0.png', 0, 138, 138, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855585_0.png', 0, 432, 303, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855587_0.png', 0, 121, 144, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855594_0.png', 0, 137, 129, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855615_0.png', 0, 150, 245, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855618_0.png', 0, 215, 194, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855619_0.png', 0, 247, 268, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855621_0.png', 0, 209, 256, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855628_0.png', 0, 175, 284, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855629_0.png', 0, 196, 127, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913903), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855635_0.png', 0, 111, 156, 0, 1761913903,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.6186864376068115 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761913906_1485104 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855573_0.png', 0, 188, 131, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855575_0.png', 0, 81, 86, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855579_0.png', 0, 213, 90, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855580_0.png', 0, 155, 88, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855582_0.png', 0, 227, 114, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855598_0.png', 0, 212, 180, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855601_0.png', 0, 150, 176, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855614_0.png', 0, 155, 176, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855626_0.png', 0, 168, 227, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855627_0.png', 0, 324, 224, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913908), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855645_0.png', 0, 215, 173, 0, 1761913908,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.9723939895629883 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761913916_1485104 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855584_0.png', 0, 398, 460, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855586_0.png', 0, 328, 269, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855592_0.png', 0, 290, 219, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855595_0.png', 0, 441, 213, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855597_0.png', 0, 295, 475, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855600_0.png', 0, 398, 325, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855602_0.png', 0, 191, 281, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855604_0.png', 0, 262, 284, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855606_0.png', 0, 199, 128, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855613_0.png', 0, 339, 443, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855617_0.png', 0, 411, 338, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855622_0.png', 0, 436, 211, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855623_0.png', 0, 329, 306, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855624_0.png', 0, 432, 260, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855625_0.png', 0, 287, 317, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855630_0.png', 0, 413, 455, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855634_0.png', 0, 155, 253, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855641_0.png', 0, 188, 369, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855642_0.png', 0, 219, 281, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855643_0.png', 0, 323, 261, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913921), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855648_0.png', 0, 107, 167, 0, 1761913921,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.821956157684326 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761913924_1485104 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913925), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855589_0.png', 0, 79, 86, 0, 1761913925,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913925), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855599_0.png', 0, 192, 218, 0, 1761913925,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913925), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855609_0.png', 0, 334, 183, 0, 1761913925,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913925), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855610_0.png', 0, 71, 88, 0, 1761913925,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913925), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855612_0.png', 0, 107, 101, 0, 1761913925,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.662057876586914 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761913927_1485104 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761913927), 0.0, 0.0, 14, '', 0, 0, '1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855637_0.png', 0, 513, 423, 0, 1761913927,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8209679126739502 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1390381990, 1390381986, 1390381947, 1390381945, 1390381943, 1390381941, 1390381940, 1390381939, 1390381898, 1390381894] Looping around the photos to save general results len do output : 77 /1391190259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391190510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381990', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381986', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381947', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381945', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381943', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381941', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381940', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381939', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381898', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381894', None, None, None, None, None, '3972126') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 241 time used for this insertion : 0.024620532989501953 save_final save missing photos in datou_result : time spend for datou_step_exec : 47.443199157714844 time spend to save output : 0.026693344116210938 total time spend for step 2 : 47.469892501831055 step3:rle_unique_nms_with_priority Fri Oct 31 13:32:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 77 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 6.200786590576172 time for calcul the mask position with numpy : 0.9311435222625732 nb_pixel_total : 7838616 time to create 1 rle with new method : 0.8342344760894775 time for calcul the mask position with numpy : 0.026552438735961914 nb_pixel_total : 13931 time to create 1 rle with old method : 0.015794038772583008 time for calcul the mask position with numpy : 0.025254487991333008 nb_pixel_total : 10842 time to create 1 rle with old method : 0.01435995101928711 time for calcul the mask position with numpy : 0.044626474380493164 nb_pixel_total : 16444 time to create 1 rle with old method : 0.019034624099731445 time for calcul the mask position with numpy : 0.04416799545288086 nb_pixel_total : 87870 time to create 1 rle with old method : 0.10017871856689453 time for calcul the mask position with numpy : 0.03489971160888672 nb_pixel_total : 22044 time to create 1 rle with old method : 0.025207996368408203 time for calcul the mask position with numpy : 0.02680802345275879 nb_pixel_total : 112834 time to create 1 rle with old method : 0.12787795066833496 time for calcul the mask position with numpy : 0.026233673095703125 nb_pixel_total : 5618 time to create 1 rle with old method : 0.006483316421508789 time for calcul the mask position with numpy : 0.027569293975830078 nb_pixel_total : 149435 time to create 1 rle with old method : 0.17001843452453613 time for calcul the mask position with numpy : 0.027629852294921875 nb_pixel_total : 18231 time to create 1 rle with old method : 0.020761489868164062 time for calcul the mask position with numpy : 0.028430461883544922 nb_pixel_total : 18535 time to create 1 rle with old method : 0.02103400230407715 create new chi : 2.6363813877105713 time to delete rle : 0.01755976676940918 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 6012 TO DO : save crop sub photo not yet done ! save time : 0.36103320121765137 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.404707431793213 time for calcul the mask position with numpy : 0.6163933277130127 nb_pixel_total : 7969551 time to create 1 rle with new method : 1.4019882678985596 time for calcul the mask position with numpy : 0.026142120361328125 nb_pixel_total : 25799 time to create 1 rle with old method : 0.029360055923461914 time for calcul the mask position with numpy : 0.02621006965637207 nb_pixel_total : 12837 time to create 1 rle with old method : 0.01465606689453125 time for calcul the mask position with numpy : 0.025703907012939453 nb_pixel_total : 39010 time to create 1 rle with old method : 0.04415774345397949 time for calcul the mask position with numpy : 0.028880596160888672 nb_pixel_total : 84590 time to create 1 rle with old method : 0.11207938194274902 time for calcul the mask position with numpy : 0.02921128273010254 nb_pixel_total : 129536 time to create 1 rle with old method : 0.14703154563903809 time for calcul the mask position with numpy : 0.03155350685119629 nb_pixel_total : 11679 time to create 1 rle with old method : 0.013843059539794922 time for calcul the mask position with numpy : 0.026560544967651367 nb_pixel_total : 21398 time to create 1 rle with old method : 0.027487993240356445 create new chi : 2.6465678215026855 time to delete rle : 0.0010325908660888672 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 5862 TO DO : save crop sub photo not yet done ! save time : 0.33464860916137695 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 3.34053111076355 time for calcul the mask position with numpy : 0.7307338714599609 nb_pixel_total : 8116811 time to create 1 rle with new method : 0.6440114974975586 time for calcul the mask position with numpy : 0.0256500244140625 nb_pixel_total : 34698 time to create 1 rle with old method : 0.04171562194824219 time for calcul the mask position with numpy : 0.025037765502929688 nb_pixel_total : 48600 time to create 1 rle with old method : 0.055231332778930664 time for calcul the mask position with numpy : 0.03856658935546875 nb_pixel_total : 22290 time to create 1 rle with old method : 0.024737119674682617 time for calcul the mask position with numpy : 0.02617621421813965 nb_pixel_total : 66355 time to create 1 rle with old method : 0.09835529327392578 time for calcul the mask position with numpy : 0.031152009963989258 nb_pixel_total : 5646 time to create 1 rle with old method : 0.006487369537353516 create new chi : 1.7931585311889648 time to delete rle : 0.0008156299591064453 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 4316 TO DO : save crop sub photo not yet done ! save time : 0.25911378860473633 nb_obj : 9 nb_hashtags : 5 time to prepare the origin masks : 3.2977049350738525 time for calcul the mask position with numpy : 0.5523629188537598 nb_pixel_total : 7895091 time to create 1 rle with new method : 0.7480788230895996 time for calcul the mask position with numpy : 0.023682832717895508 nb_pixel_total : 34676 time to create 1 rle with old method : 0.03647875785827637 time for calcul the mask position with numpy : 0.022939682006835938 nb_pixel_total : 19481 time to create 1 rle with old method : 0.021017789840698242 time for calcul the mask position with numpy : 0.026228666305541992 nb_pixel_total : 99183 time to create 1 rle with old method : 0.10705327987670898 time for calcul the mask position with numpy : 0.025990962982177734 nb_pixel_total : 31982 time to create 1 rle with old method : 0.035839080810546875 time for calcul the mask position with numpy : 0.026766061782836914 nb_pixel_total : 23623 time to create 1 rle with old method : 0.02613377571105957 time for calcul the mask position with numpy : 0.026896953582763672 nb_pixel_total : 95822 time to create 1 rle with old method : 0.13904094696044922 time for calcul the mask position with numpy : 0.028783321380615234 nb_pixel_total : 16963 time to create 1 rle with old method : 0.024580955505371094 time for calcul the mask position with numpy : 0.027321338653564453 nb_pixel_total : 65575 time to create 1 rle with old method : 0.07509922981262207 time for calcul the mask position with numpy : 0.0253598690032959 nb_pixel_total : 12004 time to create 1 rle with old method : 0.013566970825195312 create new chi : 2.054980754852295 time to delete rle : 0.0011036396026611328 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 6590 TO DO : save crop sub photo not yet done ! save time : 0.35398316383361816 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 1.553309440612793 time for calcul the mask position with numpy : 0.48525357246398926 nb_pixel_total : 7924615 time to create 1 rle with new method : 0.8916034698486328 time for calcul the mask position with numpy : 0.024972200393676758 nb_pixel_total : 39675 time to create 1 rle with old method : 0.04396796226501465 time for calcul the mask position with numpy : 0.023648977279663086 nb_pixel_total : 18937 time to create 1 rle with old method : 0.020834922790527344 time for calcul the mask position with numpy : 0.03450727462768555 nb_pixel_total : 20290 time to create 1 rle with old method : 0.03328204154968262 time for calcul the mask position with numpy : 0.02937173843383789 nb_pixel_total : 193666 time to create 1 rle with new method : 0.7709438800811768 time for calcul the mask position with numpy : 0.024682044982910156 nb_pixel_total : 59342 time to create 1 rle with old method : 0.06331944465637207 time for calcul the mask position with numpy : 0.024356603622436523 nb_pixel_total : 37875 time to create 1 rle with old method : 0.04092717170715332 create new chi : 2.5807418823242188 time to delete rle : 0.0007696151733398438 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5752 TO DO : save crop sub photo not yet done ! save time : 0.3097681999206543 nb_obj : 7 nb_hashtags : 5 time to prepare the origin masks : 2.5135762691497803 time for calcul the mask position with numpy : 0.5039122104644775 nb_pixel_total : 8026480 time to create 1 rle with new method : 1.108048677444458 time for calcul the mask position with numpy : 0.024079322814941406 nb_pixel_total : 21113 time to create 1 rle with old method : 0.02287745475769043 time for calcul the mask position with numpy : 0.023291826248168945 nb_pixel_total : 21730 time to create 1 rle with old method : 0.023332595825195312 time for calcul the mask position with numpy : 0.024723052978515625 nb_pixel_total : 98270 time to create 1 rle with old method : 0.10634303092956543 time for calcul the mask position with numpy : 0.024684667587280273 nb_pixel_total : 6600 time to create 1 rle with old method : 0.007478952407836914 time for calcul the mask position with numpy : 0.02491903305053711 nb_pixel_total : 67037 time to create 1 rle with old method : 0.07348918914794922 time for calcul the mask position with numpy : 0.02421092987060547 nb_pixel_total : 4482 time to create 1 rle with old method : 0.004862546920776367 time for calcul the mask position with numpy : 0.028949737548828125 nb_pixel_total : 48688 time to create 1 rle with old method : 0.05296444892883301 create new chi : 2.121338129043579 time to delete rle : 0.0008656978607177734 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 5536 TO DO : save crop sub photo not yet done ! save time : 0.29836559295654297 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 1.960801362991333 time for calcul the mask position with numpy : 0.749779462814331 nb_pixel_total : 7934218 time to create 1 rle with new method : 0.8203492164611816 time for calcul the mask position with numpy : 0.023986101150512695 nb_pixel_total : 73890 time to create 1 rle with old method : 0.07677054405212402 time for calcul the mask position with numpy : 0.022734880447387695 nb_pixel_total : 41447 time to create 1 rle with old method : 0.04364776611328125 time for calcul the mask position with numpy : 0.02945423126220703 nb_pixel_total : 51435 time to create 1 rle with old method : 0.055983781814575195 time for calcul the mask position with numpy : 0.02466559410095215 nb_pixel_total : 37252 time to create 1 rle with old method : 0.040433406829833984 time for calcul the mask position with numpy : 0.023744583129882812 nb_pixel_total : 30214 time to create 1 rle with old method : 0.03191018104553223 time for calcul the mask position with numpy : 0.02527308464050293 nb_pixel_total : 106708 time to create 1 rle with old method : 0.11538314819335938 time for calcul the mask position with numpy : 0.024931669235229492 nb_pixel_total : 19236 time to create 1 rle with old method : 0.02092885971069336 create new chi : 2.1699111461639404 time to delete rle : 0.0008194446563720703 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5822 TO DO : save crop sub photo not yet done ! save time : 0.32802343368530273 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 1.3494937419891357 time for calcul the mask position with numpy : 0.51212477684021 nb_pixel_total : 7946612 time to create 1 rle with new method : 0.8087174892425537 time for calcul the mask position with numpy : 0.023161649703979492 nb_pixel_total : 34831 time to create 1 rle with old method : 0.03654289245605469 time for calcul the mask position with numpy : 0.022969484329223633 nb_pixel_total : 64792 time to create 1 rle with old method : 0.06588339805603027 time for calcul the mask position with numpy : 0.024156808853149414 nb_pixel_total : 28454 time to create 1 rle with old method : 0.03084254264831543 time for calcul the mask position with numpy : 0.02411198616027832 nb_pixel_total : 65070 time to create 1 rle with old method : 0.06783151626586914 time for calcul the mask position with numpy : 0.024285316467285156 nb_pixel_total : 73330 time to create 1 rle with old method : 0.08036279678344727 time for calcul the mask position with numpy : 0.025466442108154297 nb_pixel_total : 81311 time to create 1 rle with old method : 0.0887298583984375 create new chi : 1.878340721130371 time to delete rle : 0.0007336139678955078 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5508 TO DO : save crop sub photo not yet done ! save time : 0.30844593048095703 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 3.4844810962677 time for calcul the mask position with numpy : 0.25128817558288574 nb_pixel_total : 7018356 time to create 1 rle with new method : 0.38715386390686035 time for calcul the mask position with numpy : 0.02650165557861328 nb_pixel_total : 23631 time to create 1 rle with old method : 0.02621746063232422 time for calcul the mask position with numpy : 0.024797916412353516 nb_pixel_total : 12033 time to create 1 rle with old method : 0.013523101806640625 time for calcul the mask position with numpy : 0.026691198348999023 nb_pixel_total : 37549 time to create 1 rle with old method : 0.04162883758544922 time for calcul the mask position with numpy : 0.026828527450561523 nb_pixel_total : 136500 time to create 1 rle with old method : 0.15882587432861328 time for calcul the mask position with numpy : 0.025774717330932617 nb_pixel_total : 246179 time to create 1 rle with new method : 0.9329817295074463 time for calcul the mask position with numpy : 0.023621797561645508 nb_pixel_total : 12972 time to create 1 rle with old method : 0.013474225997924805 time for calcul the mask position with numpy : 0.02401566505432129 nb_pixel_total : 30601 time to create 1 rle with old method : 0.03307199478149414 time for calcul the mask position with numpy : 0.026163101196289062 nb_pixel_total : 52075 time to create 1 rle with old method : 0.056981563568115234 time for calcul the mask position with numpy : 0.026971817016601562 nb_pixel_total : 343915 time to create 1 rle with new method : 0.5918433666229248 time for calcul the mask position with numpy : 0.025510311126708984 nb_pixel_total : 217302 time to create 1 rle with new method : 0.5554933547973633 time for calcul the mask position with numpy : 0.029337644577026367 nb_pixel_total : 145925 time to create 1 rle with old method : 0.20139265060424805 time for calcul the mask position with numpy : 0.02713632583618164 nb_pixel_total : 17362 time to create 1 rle with old method : 0.019308805465698242 create new chi : 3.729167938232422 time to delete rle : 0.002277374267578125 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 10874 TO DO : save crop sub photo not yet done ! save time : 0.5719687938690186 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 2.588944911956787 time for calcul the mask position with numpy : 0.5885813236236572 nb_pixel_total : 7914372 time to create 1 rle with new method : 0.7875368595123291 time for calcul the mask position with numpy : 0.024893999099731445 nb_pixel_total : 12960 time to create 1 rle with old method : 0.014754533767700195 time for calcul the mask position with numpy : 0.024260997772216797 nb_pixel_total : 23358 time to create 1 rle with old method : 0.026126861572265625 time for calcul the mask position with numpy : 0.025255918502807617 nb_pixel_total : 89525 time to create 1 rle with old method : 0.09937715530395508 time for calcul the mask position with numpy : 0.026831865310668945 nb_pixel_total : 22043 time to create 1 rle with old method : 0.02841639518737793 time for calcul the mask position with numpy : 0.027968168258666992 nb_pixel_total : 86662 time to create 1 rle with old method : 0.1046755313873291 time for calcul the mask position with numpy : 0.024690866470336914 nb_pixel_total : 58101 time to create 1 rle with old method : 0.06496667861938477 time for calcul the mask position with numpy : 0.02805471420288086 nb_pixel_total : 48522 time to create 1 rle with old method : 0.07270336151123047 time for calcul the mask position with numpy : 0.030330657958984375 nb_pixel_total : 38857 time to create 1 rle with old method : 0.04239797592163086 create new chi : 2.0866143703460693 time to delete rle : 0.0011539459228515625 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 6790 TO DO : save crop sub photo not yet done ! save time : 0.36780738830566406 map_output_result : {1390381990: (0.0, 'Should be the crop_list due to order', 0), 1390381986: (0.0, 'Should be the crop_list due to order', 0), 1390381947: (0.0, 'Should be the crop_list due to order', 0), 1390381945: (0.0, 'Should be the crop_list due to order', 0), 1390381943: (0.0, 'Should be the crop_list due to order', 0), 1390381941: (0.0, 'Should be the crop_list due to order', 0), 1390381940: (0.0, 'Should be the crop_list due to order', 0), 1390381939: (0.0, 'Should be the crop_list due to order', 0), 1390381898: (0.0, 'Should be the crop_list due to order', 0), 1390381894: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1390381990, 1390381986, 1390381947, 1390381945, 1390381943, 1390381941, 1390381940, 1390381939, 1390381898, 1390381894] Looping around the photos to save general results len do output : 10 /1390381990.Didn't retrieve data . /1390381986.Didn't retrieve data . /1390381947.Didn't retrieve data . /1390381945.Didn't retrieve data . /1390381943.Didn't retrieve data . /1390381941.Didn't retrieve data . /1390381940.Didn't retrieve data . /1390381939.Didn't retrieve data . /1390381898.Didn't retrieve data . /1390381894.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381990', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381986', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381947', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381945', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381943', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381941', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381940', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381939', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381898', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381894', None, None, None, None, None, '3972126') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.011097192764282227 save_final save missing photos in datou_result : time spend for datou_step_exec : 58.27835273742676 time spend to save output : 0.011517047882080078 total time spend for step 3 : 58.28986978530884 step4:ventilate_hashtags_in_portfolio Fri Oct 31 13:33:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28010191 get user id for portfolio 28010191 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010191 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','pet_fonce','metal','mal_croppe','autre','pehd','flou','carton','pet_clair','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010191 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','pet_fonce','metal','mal_croppe','autre','pehd','flou','carton','pet_clair','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010191 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','pet_fonce','metal','mal_croppe','autre','pehd','flou','carton','pet_clair','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28024187,28024188,28024189,28024190,28024191,28024192,28024193,28024194,28024195,28024196,28024197?tags=background,environnement,pet_fonce,metal,mal_croppe,autre,pehd,flou,carton,pet_clair,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1390381990, 1390381986, 1390381947, 1390381945, 1390381943, 1390381941, 1390381940, 1390381939, 1390381898, 1390381894] Looping around the photos to save general results len do output : 1 /28010191. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381990', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381986', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381947', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381945', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381943', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381941', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381940', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381939', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381898', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381894', None, None, None, None, None, '3972126') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.011571407318115234 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6339426040649414 time spend to save output : 0.011808633804321289 total time spend for step 4 : 1.6457512378692627 step5:final Fri Oct 31 13:33:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1390381990: ('0.0525568817515432',), 1390381986: ('0.0525568817515432',), 1390381947: ('0.0525568817515432',), 1390381945: ('0.0525568817515432',), 1390381943: ('0.0525568817515432',), 1390381941: ('0.0525568817515432',), 1390381940: ('0.0525568817515432',), 1390381939: ('0.0525568817515432',), 1390381898: ('0.0525568817515432',), 1390381894: ('0.0525568817515432',)} new output for save of step final : {1390381990: ('0.0525568817515432',), 1390381986: ('0.0525568817515432',), 1390381947: ('0.0525568817515432',), 1390381945: ('0.0525568817515432',), 1390381943: ('0.0525568817515432',), 1390381941: ('0.0525568817515432',), 1390381940: ('0.0525568817515432',), 1390381939: ('0.0525568817515432',), 1390381898: ('0.0525568817515432',), 1390381894: ('0.0525568817515432',)} [1390381990, 1390381986, 1390381947, 1390381945, 1390381943, 1390381941, 1390381940, 1390381939, 1390381898, 1390381894] Looping around the photos to save general results len do output : 10 /1390381990.Didn't retrieve data . /1390381986.Didn't retrieve data . /1390381947.Didn't retrieve data . /1390381945.Didn't retrieve data . /1390381943.Didn't retrieve data . /1390381941.Didn't retrieve data . /1390381940.Didn't retrieve data . /1390381939.Didn't retrieve data . /1390381898.Didn't retrieve data . /1390381894.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381990', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381986', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381947', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381945', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381943', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381941', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381940', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381939', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381898', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381894', None, None, None, None, None, '3972126') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.010943889617919922 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11105799674987793 time spend to save output : 0.011422872543334961 total time spend for step 5 : 0.12248086929321289 step6:blur_detection Fri Oct 31 13:33:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089.jpg resize: (2160, 3840) 1390381990 -6.211940144354362 treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268.jpg resize: (2160, 3840) 1390381986 -6.914145064669465 treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074.jpg resize: (2160, 3840) 1390381947 -7.0118804731919795 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544.jpg resize: (2160, 3840) 1390381945 -6.928461502893054 treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323.jpg resize: (2160, 3840) 1390381943 -6.936620187657582 treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487.jpg resize: (2160, 3840) 1390381941 -7.009717809235708 treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071.jpg resize: (2160, 3840) 1390381940 -7.005949073578128 treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668.jpg resize: (2160, 3840) 1390381939 -7.004304377124267 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332.jpg resize: (2160, 3840) 1390381898 -7.071768749853843 treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775.jpg resize: (2160, 3840) 1390381894 -6.68705569434281 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855572_0.png resize: (97, 285) 1391190259 -4.3495015302075535 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855574_0.png resize: (354, 571) 1391190260 -3.7735106532708045 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855576_0.png resize: (329, 488) 1391190261 -5.011606827908868 treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855583_0.png resize: (236, 74) 1391190262 -3.4023490016982305 treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855588_0.png resize: (206, 185) 1391190263 -4.236164900953323 treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855590_0.png resize: (229, 412) 1391190264 -3.4982680969499853 treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855591_0.png resize: (210, 130) 1391190265 -4.195844572475987 treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855593_0.png resize: (254, 190) 1391190266 -4.966293753394511 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855596_0.png resize: (143, 171) 1391190267 -4.226062069653721 treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855603_0.png resize: (296, 229) 1391190268 -3.9652124225731082 treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855605_0.png resize: (484, 557) 1391190269 -2.9463820538450327 treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855607_0.png resize: (121, 239) 1391190270 -3.5694255707467564 treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855608_0.png resize: (249, 296) 1391190271 -4.054981516294836 treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855611_0.png resize: (345, 296) 1391190272 -4.750138521257485 treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855616_0.png resize: (148, 161) 1391190273 -2.2748968503385396 treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855620_0.png resize: (306, 377) 1391190274 -3.6439468092515663 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855631_0.png resize: (534, 609) 1391190275 -5.696374544369257 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855632_0.png resize: (584, 779) 1391190276 -5.064949115567068 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855633_0.png resize: (310, 278) 1391190277 -4.754084215814156 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855636_0.png resize: (752, 510) 1391190278 -5.075570344721014 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855638_0.png resize: (149, 396) 1391190279 -5.123558578483559 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855639_0.png resize: (153, 112) 1391190280 -3.1680710548058055 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855640_0.png resize: (179, 236) 1391190281 -4.119454328549552 treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855644_0.png resize: (416, 334) 1391190282 -4.22604275596158 treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855646_0.png resize: (399, 330) 1391190283 -5.415331182755582 treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855647_0.png resize: (192, 205) 1391190284 -4.295047162736669 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855577_0.png resize: (207, 128) 1391190328 -3.379230478673543 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855578_0.png resize: (328, 368) 1391190329 -4.944726234509392 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855581_0.png resize: (138, 138) 1391190330 -3.971104608216319 treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855585_0.png resize: (303, 432) 1391190332 -2.634285236458897 treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855587_0.png resize: (144, 121) 1391190333 -2.7377747299568553 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855594_0.png resize: (129, 137) 1391190334 -2.538880436665714 treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855615_0.png resize: (245, 150) 1391190335 -3.054032678950508 treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855618_0.png resize: (194, 215) 1391190336 -4.097035043957088 treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855619_0.png resize: (268, 247) 1391190338 -4.273938509195052 treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855621_0.png resize: (256, 209) 1391190339 -5.044897383682044 treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855628_0.png resize: (284, 175) 1391190340 -3.189558847689729 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855629_0.png resize: (127, 196) 1391190341 -1.5899866576988602 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855635_0.png resize: (156, 111) 1391190343 -3.2798411019873814 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855573_0.png resize: (131, 188) 1391190388 -5.110807479602153 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855575_0.png resize: (86, 81) 1391190389 -5.126833117328914 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855579_0.png resize: (90, 213) 1391190390 -5.6843463661964755 treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855580_0.png resize: (88, 155) 1391190391 -4.733222561809073 treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855582_0.png resize: (114, 227) 1391190393 -4.049724192581604 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855598_0.png resize: (180, 212) 1391190394 -4.539125266977782 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855601_0.png resize: (176, 150) 1391190395 -4.577376883042402 treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855614_0.png resize: (176, 155) 1391190396 -5.719462150529943 treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855626_0.png resize: (227, 168) 1391190397 -4.482404259525379 treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855627_0.png resize: (224, 324) 1391190399 -6.1956248586967515 treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855645_0.png resize: (173, 215) 1391190400 -4.479067587479482 treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855584_0.png resize: (460, 398) 1391190472 -6.128078697188876 treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855586_0.png resize: (269, 328) 1391190473 -4.188272642675473 treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855592_0.png resize: (219, 290) 1391190474 -4.562209021625729 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855595_0.png resize: (213, 441) 1391190475 -5.1811305500876434 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855597_0.png resize: (475, 295) 1391190476 -4.749591230697817 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855600_0.png resize: (325, 398) 1391190477 -2.9664254675951787 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855602_0.png resize: (281, 191) 1391190478 -4.21238164066124 treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855604_0.png resize: (284, 262) 1391190479 -5.422407389184809 treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855606_0.png resize: (128, 199) 1391190480 -3.8096056249585284 treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855613_0.png resize: (443, 339) 1391190481 -5.271775635370399 treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855617_0.png resize: (338, 411) 1391190482 -4.333036899778527 treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855622_0.png resize: (211, 436) 1391190483 -4.21766907486348 treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855623_0.png resize: (306, 329) 1391190484 -5.104679400708183 treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855624_0.png resize: (260, 432) 1391190485 -5.369161700054547 treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855625_0.png resize: (317, 287) 1391190486 -5.514495508446787 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855630_0.png resize: (455, 413) 1391190487 -5.026282016576333 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855634_0.png resize: (253, 155) 1391190488 -4.425500051554358 treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855641_0.png resize: (369, 188) 1391190489 -4.606335148042087 treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855642_0.png resize: (281, 219) 1391190490 -4.7860411972793155 treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855643_0.png resize: (261, 323) 1391190491 -4.424547573954747 treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855648_0.png resize: (167, 107) 1391190492 -3.3966766951334604 treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855589_0.png resize: (86, 79) 1391190494 -3.4801253355074304 treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855599_0.png resize: (218, 192) 1391190495 -3.238900598415894 treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855609_0.png resize: (183, 334) 1391190496 -2.3784251396653473 treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855610_0.png resize: (88, 71) 1391190497 -4.03520790670526 treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855612_0.png resize: (101, 107) 1391190498 -4.5881197668189735 treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855637_0.png resize: (423, 513) 1391190510 -4.12742468000623 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 87 time used for this insertion : 0.012186527252197266 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 87 time used for this insertion : 0.013951778411865234 save missing photos in datou_result : time spend for datou_step_exec : 34.4344367980957 time spend to save output : 0.030779361724853516 total time spend for step 6 : 34.46521615982056 step7:brightness Fri Oct 31 13:33:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089.jpg treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268.jpg treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074.jpg treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544.jpg treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323.jpg treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487.jpg treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071.jpg treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668.jpg treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332.jpg treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775.jpg treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855572_0.png treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855574_0.png treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855576_0.png treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855583_0.png treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855588_0.png treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855590_0.png treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855591_0.png treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855593_0.png treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855596_0.png treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855603_0.png treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855605_0.png treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855607_0.png treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855608_0.png treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855611_0.png treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855616_0.png treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855620_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855631_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855632_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855633_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855636_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855638_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855639_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855640_0.png treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855644_0.png treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855646_0.png treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855647_0.png treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855577_0.png treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855578_0.png treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855581_0.png treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855585_0.png treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855587_0.png treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855594_0.png treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855615_0.png treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855618_0.png treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855619_0.png treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855621_0.png treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855628_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855629_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855635_0.png treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855573_0.png treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855575_0.png treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855579_0.png treat image : temp/1761913827_1485104_1390381990_3e079996c47a899d20029ef250462ccc_89549089_rle_crop_4009855580_0.png treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855582_0.png treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855598_0.png treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855601_0.png treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855614_0.png treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855626_0.png treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855627_0.png treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855645_0.png treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855584_0.png treat image : temp/1761913827_1485104_1390381986_712a81bb1492ff06ad827b76db249245_32263268_rle_crop_4009855586_0.png treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855592_0.png treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855595_0.png treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855597_0.png treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855600_0.png treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855602_0.png treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855604_0.png treat image : temp/1761913827_1485104_1390381943_df3401f56f642c36d3719fac2816a1c3_50820323_rle_crop_4009855606_0.png treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855613_0.png treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855617_0.png treat image : temp/1761913827_1485104_1390381940_265fcf30f25267a19a28a926ff07d23e_95063071_rle_crop_4009855622_0.png treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855623_0.png treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855624_0.png treat image : temp/1761913827_1485104_1390381939_cf5fdab69f4ee86af1056fcbe3c8832e_30402668_rle_crop_4009855625_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855630_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855634_0.png treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855641_0.png treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855642_0.png treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855643_0.png treat image : temp/1761913827_1485104_1390381894_c12fe40610bbdc2f0418e24e9762f1b6_83542775_rle_crop_4009855648_0.png treat image : temp/1761913827_1485104_1390381947_fbd1bab7407572684f8cf0dfa9631426_72469074_rle_crop_4009855589_0.png treat image : temp/1761913827_1485104_1390381945_36f2fe407969d8ef2290cee64b4e8c9e_8657544_rle_crop_4009855599_0.png treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855609_0.png treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855610_0.png treat image : temp/1761913827_1485104_1390381941_3766ee2469453543538e1eb623a7a498_51581487_rle_crop_4009855612_0.png treat image : temp/1761913827_1485104_1390381898_dfefac35b26dbe1d89812e62ffbc06d8_58723332_rle_crop_4009855637_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 87 time used for this insertion : 0.01132822036743164 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 87 time used for this insertion : 0.013216733932495117 save missing photos in datou_result : time spend for datou_step_exec : 10.034837245941162 time spend to save output : 0.029675960540771484 total time spend for step 7 : 10.064513206481934 step8:velours_tree Fri Oct 31 13:33:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09030556678771973 time spend to save output : 4.076957702636719e-05 total time spend for step 8 : 0.0903463363647461 step9:send_mail_cod Fri Oct 31 13:33:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28010191_31-10-2025_13_33_52.pdf 28024187 imagette280241871761914032 28024189 change filename to text .imagette280241891761914032 28024190 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280241901761914032 28024191 imagette280241911761914033 28024192 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280241921761914033 28024193 imagette280241931761914033 28024194 imagette280241941761914033 28024195 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280241951761914033 28024196 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280241961761914035 28024197 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280241971761914037 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28010191 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28024187,28024188,28024189,28024190,28024191,28024192,28024193,28024194,28024195,28024196,28024197?tags=background,environnement,pet_fonce,metal,mal_croppe,autre,pehd,flou,carton,pet_clair,papier args[1390381990] : ((1390381990, -6.211940144354362, 492609224), (1390381990, -0.5270055224149961, 501862349), '0.0525568817515432') We are sending mail with results at report@fotonower.com args[1390381986] : ((1390381986, -6.914145064669465, 492609224), (1390381986, -0.13449323315493858, 496442774), '0.0525568817515432') We are sending mail with results at report@fotonower.com args[1390381947] : ((1390381947, -7.0118804731919795, 492609224), (1390381947, -0.15883601291800747, 496442774), '0.0525568817515432') We are sending mail with results at report@fotonower.com args[1390381945] : ((1390381945, -6.928461502893054, 492609224), (1390381945, -0.06920603138606582, 2107752395), '0.0525568817515432') We are sending mail with results at report@fotonower.com args[1390381943] : ((1390381943, -6.936620187657582, 492609224), (1390381943, 0.055326268889879085, 2107752395), '0.0525568817515432') We are sending mail with results at report@fotonower.com args[1390381941] : ((1390381941, -7.009717809235708, 492609224), (1390381941, -0.12204674138899932, 496442774), '0.0525568817515432') We are sending mail with results at report@fotonower.com args[1390381940] : ((1390381940, -7.005949073578128, 492609224), (1390381940, -0.07302483367176546, 496442774), '0.0525568817515432') We are sending mail with results at report@fotonower.com args[1390381939] : ((1390381939, -7.004304377124267, 492609224), (1390381939, -0.07163790802709127, 496442774), '0.0525568817515432') We are sending mail with results at report@fotonower.com args[1390381898] : ((1390381898, -7.071768749853843, 492609224), (1390381898, 0.1371124916231355, 2107752395), '0.0525568817515432') We are sending mail with results at report@fotonower.com args[1390381894] : ((1390381894, -6.68705569434281, 492609224), (1390381894, -0.1463430762064258, 496442774), '0.0525568817515432') We are sending mail with results at report@fotonower.com refus_total : 0.0525568817515432 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28010191 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010191_31-10-2025_13_33_52.pdf results_Auto_P28010191_31-10-2025_13_33_52.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010191_31-10-2025_13_33_52.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28010191','results_Auto_P28010191_31-10-2025_13_33_52.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010191_31-10-2025_13_33_52.pdf','pdf','','0.85','0.0525568817515432') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28010191

https://www.fotonower.com/image?json=false&list_photos_id=1390381990
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390381986
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390381947
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390381945
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390381943
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390381941
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390381940
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390381939
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390381898
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390381894
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.26%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28024189?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28024190?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28024192?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28024195?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28024196?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28024197?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010191_31-10-2025_13_33_52.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28024187,28024188,28024189,28024190,28024191,28024192,28024193,28024194,28024195,28024196,28024197?tags=background,environnement,pet_fonce,metal,mal_croppe,autre,pehd,flou,carton,pet_clair,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 31 Oct 2025 12:34:01 GMT Content-Length: 0 Connection: close X-Message-Id: QFlvwrOXQJ24QXWa1TKJvg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1390381990, 1390381986, 1390381947, 1390381945, 1390381943, 1390381941, 1390381940, 1390381939, 1390381898, 1390381894] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381990', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381986', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381947', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381945', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381943', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381941', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381940', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381939', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381898', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381894', None, None, None, None, None, '3972126') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.010765790939331055 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.38228464126587 time spend to save output : 0.011060714721679688 total time spend for step 9 : 9.393345355987549 step10:split_time_score Fri Oct 31 13:34:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21102025 28010191 Nombre de photos uploadées : 10 / 23040 (0%) 21102025 28010191 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 21102025 28010191 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.00043392181396484375 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2091827392578125 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010059 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010077 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010135 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010190 order by id desc limit 1 Qualite : 0.0525568817515432 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010191_31-10-2025_13_33_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010191 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010216 order by id desc limit 1 Qualite : 0.01929798002462724 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010259_31-10-2025_13_28_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010259 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010259 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010376 order by id desc limit 1 Qualite : 0.06800716949588477 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010444_31-10-2025_09_53_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010444 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010444 AND mptpi.`type`=3594 To do Qualite : 0.036396530171818105 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010460_31-10-2025_13_18_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010460 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010460 AND mptpi.`type`=3726 To do Qualite : 0.06121059456602161 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010591_31-10-2025_12_57_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010591 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010591 AND mptpi.`type`=3726 To do Qualite : 0.04617979929503365 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010594_31-10-2025_13_24_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010594 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010594 AND mptpi.`type`=3594 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010617_31-10-2025_12_52_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010617 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010617 AND mptpi.`type`=3726 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010619_31-10-2025_09_47_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010619 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010619 AND mptpi.`type`=3726 To do Qualite : 0.15954648259874507 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010637_31-10-2025_09_42_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010637 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010637 AND mptpi.`type`=3726 To do Qualite : 0.18081841802240806 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010690_31-10-2025_09_44_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010690 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010690 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21102025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1390381990, 1390381986, 1390381947, 1390381945, 1390381943, 1390381941, 1390381940, 1390381939, 1390381898, 1390381894] Looping around the photos to save general results len do output : 1 /28010191Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381990', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381986', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381947', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381945', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381943', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381941', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381940', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381939', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381898', None, None, None, None, None, '3972126') ('3318', None, None, None, None, None, None, None, '3972126') ('3318', '28010191', '1390381894', None, None, None, None, None, '3972126') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.012551069259643555 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.539559602737427 time spend to save output : 0.012769937515258789 total time spend for step 10 : 8.552329540252686 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 111.00user 75.50system 3:45.40elapsed 82%CPU (0avgtext+0avgdata 4660124maxresident)k 336664inputs+116712outputs (54major+9278279minor)pagefaults 0swaps