python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2030373 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4337851'] with mtr_portfolio_ids : ['30263395'] and first list_photo_ids : [] new path : /proc/2030373/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 15 ; length of list_pids : 15 ; length of list_args : 15 time to download the photos : 2.496703863143921 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jan 30 14:40:32 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2685 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-30 14:40:35.477467: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-30 14:40:35.502442: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-30 14:40:35.504676: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa010000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-30 14:40:35.504737: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-30 14:40:35.508659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-30 14:40:35.647113: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4091dcb0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-30 14:40:35.647161: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-30 14:40:35.648162: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-30 14:40:35.648575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-30 14:40:35.651909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-30 14:40:35.654448: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-30 14:40:35.654871: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-30 14:40:35.657751: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-30 14:40:35.659143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-30 14:40:35.664528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-30 14:40:35.665491: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-30 14:40:35.665561: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-30 14:40:35.666074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-30 14:40:35.666089: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-30 14:40:35.666097: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-30 14:40:35.666997: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2233 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-30 14:40:35.931416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-30 14:40:35.931500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-30 14:40:35.931517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-30 14:40:35.931532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-30 14:40:35.931547: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-30 14:40:35.931561: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-30 14:40:35.931575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-30 14:40:35.931589: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-30 14:40:35.932393: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-30 14:40:35.933186: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-30 14:40:35.933216: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-30 14:40:35.933231: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-30 14:40:35.933245: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-30 14:40:35.933258: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-30 14:40:35.933271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-30 14:40:35.933285: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-30 14:40:35.933299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-30 14:40:35.934090: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-30 14:40:35.934118: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-30 14:40:35.934126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-30 14:40:35.934134: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-30 14:40:35.934982: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2233 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-30 14:40:45.917430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-30 14:40:46.082770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-30 14:40:47.568886: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.568946: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.575350: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.575374: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.626308: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.626382: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.667915: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.667941: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.710866: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.710902: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-30 14:40:47.712850: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.18G (1269628928 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.712882: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2026-01-30 14:40:47.727119: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.727663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.752350: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.752891: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.754378: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.754953: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.760250: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.760783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.762403: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.762978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.768470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.769004: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.770511: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.771092: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.797142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.797722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.798300: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.798870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.802291: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.802824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.818016: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.818570: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.819099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.819625: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.831896: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.832442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.832968: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.833492: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.837719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.838251: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.842762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.843337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.855211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.855785: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.859868: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.860419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.861101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.861636: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.872227: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.872799: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.873365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.873893: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.874437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.875023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.913098: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.913141: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2026-01-30 14:40:47.913688: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.914225: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.922087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.922718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.930997: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.931584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.950647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.951411: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.952045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.952632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.956753: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.957331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.957897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.958471: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.959433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.969556: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.970127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.979191: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.979792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.980421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.980983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.981555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-30 14:40:47.982124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.68G (1806499840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 2030618 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 299 tf kernel not reseted sub process len(results) : 15 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 15 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1492 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [816, 2190, 1014, 2328] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010676383972167969 nb_pixel_total : 20370 time to create 1 rle with old method : 0.02507328987121582 length of segment : 205 DEBUG bbox = [1386, 2580, 1602, 2796] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006399154663085938 nb_pixel_total : 26889 time to create 1 rle with old method : 0.030177593231201172 length of segment : 207 DEBUG bbox = [756, 2322, 996, 2514] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004668235778808594 nb_pixel_total : 22643 time to create 1 rle with old method : 0.02510547637939453 length of segment : 197 DEBUG bbox = [900, 1206, 1146, 1506] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008420944213867188 nb_pixel_total : 19406 time to create 1 rle with old method : 0.02237987518310547 length of segment : 217 DEBUG bbox = [1704, 2652, 1890, 2940] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005974769592285156 nb_pixel_total : 35790 time to create 1 rle with old method : 0.03973031044006348 length of segment : 178 DEBUG bbox = [18, 2424, 102, 2580] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00018167495727539062 nb_pixel_total : 9102 time to create 1 rle with old method : 0.013352632522583008 length of segment : 85 DEBUG bbox = [1968, 1608, 2082, 1764] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 11551 time to create 1 rle with old method : 0.018965482711791992 length of segment : 102 DEBUG bbox = [1902, 1278, 2028, 1404] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024771690368652344 nb_pixel_total : 8748 time to create 1 rle with old method : 0.014528036117553711 length of segment : 104 DEBUG bbox = [1464, 2700, 1686, 3060] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008902549743652344 nb_pixel_total : 49518 time to create 1 rle with old method : 0.05436849594116211 length of segment : 217 DEBUG bbox = [1014, 1512, 1182, 1662] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003063678741455078 nb_pixel_total : 16290 time to create 1 rle with old method : 0.01836538314819336 length of segment : 163 DEBUG bbox = [1470, 2736, 1680, 3030] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006403923034667969 nb_pixel_total : 44776 time to create 1 rle with old method : 0.05030655860900879 length of segment : 209 DEBUG bbox = [1992, 1992, 2142, 2118] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00020837783813476562 nb_pixel_total : 13200 time to create 1 rle with old method : 0.01505899429321289 length of segment : 134 DEBUG bbox = [1440, 1908, 1782, 2232] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008707046508789062 nb_pixel_total : 59280 time to create 1 rle with old method : 0.06452512741088867 length of segment : 302 DEBUG bbox = [1908, 1902, 2022, 2052] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001983642578125 nb_pixel_total : 8731 time to create 1 rle with old method : 0.01043081283569336 length of segment : 106 DEBUG bbox = [636, 2418, 918, 2760] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007545948028564453 nb_pixel_total : 48012 time to create 1 rle with old method : 0.05392718315124512 length of segment : 250 DEBUG bbox = [120, 0, 2160, 1140] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.04959535598754883 nb_pixel_total : 978144 time to create 1 rle with new method : 0.4816462993621826 length of segment : 3938 DEBUG bbox = [186, 2916, 462, 3264] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010776519775390625 nb_pixel_total : 30294 time to create 1 rle with old method : 0.03362631797790527 length of segment : 324 DEBUG bbox = [1860, 2280, 2088, 2370] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005719661712646484 nb_pixel_total : 13990 time to create 1 rle with old method : 0.015999317169189453 length of segment : 217 DEBUG bbox = [1620, 1776, 1758, 1872] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003032684326171875 nb_pixel_total : 8636 time to create 1 rle with old method : 0.009818792343139648 length of segment : 122 DEBUG bbox = [702, 2718, 1062, 3078] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014307498931884766 nb_pixel_total : 60751 time to create 1 rle with old method : 0.0671396255493164 length of segment : 352 DEBUG bbox = [222, 1626, 1002, 2472] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.01064443588256836 nb_pixel_total : 418199 time to create 1 rle with new method : 0.01523447036743164 length of segment : 770 DEBUG bbox = [1008, 2010, 1374, 2538] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004045248031616211 nb_pixel_total : 135202 time to create 1 rle with old method : 0.14693760871887207 length of segment : 348 DEBUG bbox = [930, 2076, 1146, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006659030914306641 nb_pixel_total : 26050 time to create 1 rle with old method : 0.028343677520751953 length of segment : 205 DEBUG bbox = [1434, 2058, 1554, 2448] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 22258 time to create 1 rle with old method : 0.02637314796447754 length of segment : 113 DEBUG bbox = [798, 2232, 1068, 2514] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009908676147460938 nb_pixel_total : 37727 time to create 1 rle with old method : 0.041594743728637695 length of segment : 234 DEBUG bbox = [1812, 1548, 2058, 1848] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011820793151855469 nb_pixel_total : 51631 time to create 1 rle with old method : 0.059615135192871094 length of segment : 264 DEBUG bbox = [234, 2418, 606, 2874] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020074844360351562 nb_pixel_total : 45061 time to create 1 rle with old method : 0.05272555351257324 length of segment : 323 DEBUG bbox = [420, 2406, 774, 2892] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002062559127807617 nb_pixel_total : 41815 time to create 1 rle with old method : 0.048825979232788086 length of segment : 314 DEBUG bbox = [1842, 2052, 2106, 2382] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001308441162109375 nb_pixel_total : 57544 time to create 1 rle with old method : 0.06430649757385254 length of segment : 257 DEBUG bbox = [1080, 2052, 1272, 2256] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007135868072509766 nb_pixel_total : 24579 time to create 1 rle with old method : 0.0286099910736084 length of segment : 188 DEBUG bbox = [804, 1620, 1542, 2508] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.008652687072753906 nb_pixel_total : 351227 time to create 1 rle with new method : 0.0175323486328125 length of segment : 779 DEBUG bbox = [798, 1818, 1050, 2040] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005638599395751953 nb_pixel_total : 22802 time to create 1 rle with old method : 0.025743484497070312 length of segment : 245 DEBUG bbox = [1536, 2046, 1686, 2424] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007309913635253906 nb_pixel_total : 25024 time to create 1 rle with old method : 0.028575420379638672 length of segment : 124 DEBUG bbox = [954, 2142, 1254, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009648799896240234 nb_pixel_total : 40571 time to create 1 rle with old method : 0.04656720161437988 length of segment : 247 DEBUG bbox = [252, 2616, 492, 2754] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005764961242675781 nb_pixel_total : 23786 time to create 1 rle with old method : 0.026755094528198242 length of segment : 213 DEBUG bbox = [1344, 2286, 1596, 2574] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010728836059570312 nb_pixel_total : 36580 time to create 1 rle with old method : 0.04164409637451172 length of segment : 232 DEBUG bbox = [1380, 1728, 1560, 1866] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 16559 time to create 1 rle with old method : 0.01869797706604004 length of segment : 163 DEBUG bbox = [708, 2286, 1122, 2784] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002909421920776367 nb_pixel_total : 142450 time to create 1 rle with old method : 0.1578831672668457 length of segment : 405 DEBUG bbox = [1428, 2394, 1566, 2592] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005147457122802734 nb_pixel_total : 12865 time to create 1 rle with old method : 0.015199661254882812 length of segment : 125 DEBUG bbox = [2016, 1908, 2130, 2004] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024700164794921875 nb_pixel_total : 6764 time to create 1 rle with old method : 0.007962942123413086 length of segment : 106 DEBUG bbox = [168, 2214, 708, 2844] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004794120788574219 nb_pixel_total : 214612 time to create 1 rle with new method : 0.006453275680541992 length of segment : 492 DEBUG bbox = [66, 1122, 420, 1344] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012896060943603516 nb_pixel_total : 31698 time to create 1 rle with old method : 0.03704643249511719 length of segment : 350 DEBUG bbox = [1926, 1584, 2028, 1650] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00022649765014648438 nb_pixel_total : 3508 time to create 1 rle with old method : 0.0042307376861572266 length of segment : 97 DEBUG bbox = [1218, 2676, 1428, 2988] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008203983306884766 nb_pixel_total : 27568 time to create 1 rle with old method : 0.03191709518432617 length of segment : 177 DEBUG bbox = [348, 924, 636, 1050] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009281635284423828 nb_pixel_total : 26571 time to create 1 rle with old method : 0.03188824653625488 length of segment : 298 DEBUG bbox = [0, 2352, 144, 2640] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005970001220703125 nb_pixel_total : 28482 time to create 1 rle with old method : 0.0327146053314209 length of segment : 137 DEBUG bbox = [1392, 1722, 1578, 1974] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007729530334472656 nb_pixel_total : 25179 time to create 1 rle with old method : 0.028745412826538086 length of segment : 159 DEBUG bbox = [30, 888, 456, 1344] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0032567977905273438 nb_pixel_total : 93426 time to create 1 rle with old method : 0.10284209251403809 length of segment : 572 DEBUG bbox = [252, 1608, 552, 1938] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013246536254882812 nb_pixel_total : 56764 time to create 1 rle with old method : 0.06310129165649414 length of segment : 292 DEBUG bbox = [654, 972, 1236, 1380] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036067962646484375 nb_pixel_total : 151433 time to create 1 rle with new method : 0.007811069488525391 length of segment : 527 DEBUG bbox = [12, 816, 126, 948] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003337860107421875 nb_pixel_total : 9332 time to create 1 rle with old method : 0.010651588439941406 length of segment : 104 DEBUG bbox = [804, 2646, 1050, 2778] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005939006805419922 nb_pixel_total : 17029 time to create 1 rle with old method : 0.01941514015197754 length of segment : 218 DEBUG bbox = [282, 1266, 396, 1380] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031256675720214844 nb_pixel_total : 7735 time to create 1 rle with old method : 0.009094476699829102 length of segment : 96 DEBUG bbox = [816, 2040, 1086, 2178] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008859634399414062 nb_pixel_total : 22377 time to create 1 rle with old method : 0.02568793296813965 length of segment : 267 DEBUG bbox = [1098, 2574, 1350, 2724] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006034374237060547 nb_pixel_total : 18878 time to create 1 rle with old method : 0.02084660530090332 length of segment : 303 DEBUG bbox = [72, 2262, 282, 2352] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004467964172363281 nb_pixel_total : 12797 time to create 1 rle with old method : 0.015038728713989258 length of segment : 184 DEBUG bbox = [240, 1926, 558, 2028] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009806156158447266 nb_pixel_total : 26943 time to create 1 rle with old method : 0.03012681007385254 length of segment : 302 DEBUG bbox = [678, 2262, 1110, 2676] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021855831146240234 nb_pixel_total : 97222 time to create 1 rle with old method : 0.13106751441955566 length of segment : 358 DEBUG bbox = [1848, 1734, 1968, 1866] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003275871276855469 nb_pixel_total : 8198 time to create 1 rle with old method : 0.009576559066772461 length of segment : 106 DEBUG bbox = [168, 2718, 504, 2916] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010747909545898438 nb_pixel_total : 40552 time to create 1 rle with old method : 0.04616427421569824 length of segment : 334 DEBUG bbox = [774, 996, 1074, 1332] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013000965118408203 nb_pixel_total : 51004 time to create 1 rle with old method : 0.056500911712646484 length of segment : 246 DEBUG bbox = [24, 1536, 354, 2370] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003328561782836914 nb_pixel_total : 173074 time to create 1 rle with new method : 0.005818367004394531 length of segment : 448 DEBUG bbox = [744, 2658, 1080, 3054] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017285346984863281 nb_pixel_total : 65221 time to create 1 rle with old method : 0.07299232482910156 length of segment : 306 DEBUG bbox = [1056, 2736, 1254, 2868] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00052642822265625 nb_pixel_total : 17071 time to create 1 rle with old method : 0.01948094367980957 length of segment : 215 DEBUG bbox = [870, 1566, 1074, 1650] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004425048828125 nb_pixel_total : 12811 time to create 1 rle with old method : 0.01463174819946289 length of segment : 178 DEBUG bbox = [108, 2544, 462, 3216] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0027348995208740234 nb_pixel_total : 134137 time to create 1 rle with old method : 0.1530165672302246 length of segment : 315 DEBUG bbox = [114, 2484, 486, 3228] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002092599868774414 nb_pixel_total : 138254 time to create 1 rle with old method : 0.1533677577972412 length of segment : 316 DEBUG bbox = [492, 1356, 684, 1578] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006916522979736328 nb_pixel_total : 27771 time to create 1 rle with old method : 0.03170967102050781 length of segment : 177 DEBUG bbox = [816, 1680, 1152, 2004] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013051033020019531 nb_pixel_total : 66500 time to create 1 rle with old method : 0.0748896598815918 length of segment : 331 DEBUG bbox = [2058, 2676, 2142, 2988] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036406517028808594 nb_pixel_total : 10799 time to create 1 rle with old method : 0.012884140014648438 length of segment : 63 DEBUG bbox = [438, 1698, 798, 2022] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001554250717163086 nb_pixel_total : 60668 time to create 1 rle with old method : 0.06754636764526367 length of segment : 327 DEBUG bbox = [492, 2634, 756, 2832] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008807182312011719 nb_pixel_total : 23800 time to create 1 rle with old method : 0.027392148971557617 length of segment : 245 DEBUG bbox = [1056, 2694, 1254, 2892] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006289482116699219 nb_pixel_total : 19142 time to create 1 rle with old method : 0.021961450576782227 length of segment : 178 DEBUG bbox = [1344, 1620, 1734, 1962] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018689632415771484 nb_pixel_total : 82969 time to create 1 rle with old method : 0.09579706192016602 length of segment : 352 DEBUG bbox = [228, 2082, 426, 2370] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007789134979248047 nb_pixel_total : 22125 time to create 1 rle with old method : 0.025325775146484375 length of segment : 158 DEBUG bbox = [1518, 2862, 1800, 3174] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013058185577392578 nb_pixel_total : 57645 time to create 1 rle with old method : 0.06237363815307617 length of segment : 279 DEBUG bbox = [480, 948, 702, 1134] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000637054443359375 nb_pixel_total : 21409 time to create 1 rle with old method : 0.024053096771240234 length of segment : 201 DEBUG bbox = [1116, 1710, 1188, 1812] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00017905235290527344 nb_pixel_total : 4703 time to create 1 rle with old method : 0.005232095718383789 length of segment : 57 time spent for convertir_results : 7.8474626541137695 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 78 chid ids of type : 3594 Number RLEs to save : 23049 save missing photos in datou_result : time spend for datou_step_exec : 58.934412717819214 time spend to save output : 1.580249309539795 total time spend for step 1 : 60.51466202735901 step2:crop_condition Fri Jan 30 14:41:33 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 15 ! batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 3736932 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769780506_2030373 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376457_0.png', 0, 138, 176, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376458_0.png', 0, 199, 207, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376460_0.png', 0, 251, 217, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376468_0.png', 0, 116, 134, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376469_0.png', 0, 320, 301, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376470_0.png', 0, 143, 99, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376471_0.png', 0, 337, 237, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376474_0.png', 0, 85, 215, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376475_0.png', 0, 86, 122, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376478_0.png', 0, 503, 345, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376479_0.png', 0, 166, 205, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376480_0.png', 0, 383, 111, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376481_0.png', 0, 281, 234, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376482_0.png', 0, 298, 240, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376483_0.png', 0, 418, 323, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376484_0.png', 0, 444, 304, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376486_0.png', 0, 174, 188, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376487_0.png', 0, 821, 620, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376488_0.png', 0, 191, 245, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376490_0.png', 0, 343, 243, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376491_0.png', 0, 133, 210, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128207_4d011c71fb5e3d6bc792155365ecb5da_rle_crop_4116376492_0.png', 0, 271, 232, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128207_4d011c71fb5e3d6bc792155365ecb5da_rle_crop_4116376493_0.png', 0, 133, 162, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376494_0.png', 0, 446, 394, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376495_0.png', 0, 183, 125, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376496_0.png', 0, 86, 106, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376498_0.png', 0, 200, 350, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376499_0.png', 0, 56, 92, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11_rle_crop_4116376500_0.png', 0, 259, 177, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11_rle_crop_4116376501_0.png', 0, 120, 267, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376503_0.png', 0, 225, 157, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376504_0.png', 0, 418, 413, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376508_0.png', 0, 115, 218, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6_rle_crop_4116376510_0.png', 0, 136, 266, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6_rle_crop_4116376511_0.png', 0, 141, 223, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6_rle_crop_4116376512_0.png', 0, 85, 184, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376513_0.png', 0, 100, 301, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376514_0.png', 0, 399, 338, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376515_0.png', 0, 113, 106, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376516_0.png', 0, 192, 334, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a_rle_crop_4116376517_0.png', 0, 319, 245, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a_rle_crop_4116376519_0.png', 0, 392, 270, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376520_0.png', 0, 115, 193, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376521_0.png', 0, 84, 175, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376522_0.png', 0, 616, 299, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376525_0.png', 0, 272, 329, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376526_0.png', 0, 269, 62, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376527_0.png', 0, 301, 327, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376528_0.png', 0, 150, 245, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376529_0.png', 0, 161, 178, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780516), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376532_0.png', 0, 290, 279, 0, 1769780516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 51 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.087374448776245 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769780522_2030373 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780523), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376473_0.png', 0, 255, 235, 0, 1769780523,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780523), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376476_0.png', 0, 298, 327, 0, 1769780523,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780523), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376505_0.png', 0, 315, 292, 0, 1769780523,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780523), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376524_0.png', 0, 214, 177, 0, 1769780523,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780523), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376531_0.png', 0, 248, 151, 0, 1769780523,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7688984870910645 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769780526_2030373 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780527), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376462_0.png', 0, 154, 80, 0, 1769780527,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780527), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376463_0.png', 0, 138, 102, 0, 1769780527,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780527), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376464_0.png', 0, 107, 103, 0, 1769780527,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780527), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376466_0.png', 0, 124, 163, 0, 1769780527,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780527), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376467_0.png', 0, 292, 209, 0, 1769780527,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780527), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376509_0.png', 0, 102, 96, 0, 1769780527,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.8350398540496826 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769780539_2030373 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376461_0.png', 0, 271, 168, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376465_0.png', 0, 329, 217, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376472_0.png', 0, 1088, 1833, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376477_0.png', 0, 839, 770, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376485_0.png', 0, 297, 254, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376497_0.png', 0, 600, 492, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11_rle_crop_4116376502_0.png', 0, 267, 133, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376506_0.png', 0, 388, 527, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376507_0.png', 0, 110, 104, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a_rle_crop_4116376518_0.png', 0, 802, 304, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780542), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376523_0.png', 0, 640, 298, 0, 1769780542,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.5565383434295654 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769780544_2030373 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780545), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376530_0.png', 0, 309, 341, 0, 1769780545,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780545), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406125562_f79054b4e6b53f5f4268c9d6b83a6568_rle_crop_4116376534_0.png', 0, 100, 54, 0, 1769780545,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8175745010375977 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769780547_2030373 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780548), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376459_0.png', 0, 173, 197, 0, 1769780548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780548), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376489_0.png', 0, 375, 124, 0, 1769780548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769780548), 0.0, 0.0, 14, '', 0, 0, '1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376533_0.png', 0, 151, 193, 0, 1769780548,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0800890922546387 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1406129081, 1406128587, 1406128513, 1406128407, 1406128325, 1406128207, 1406128062, 1406127592, 1406127486, 1406127384, 1406127275, 1406127169, 1406127094, 1406125705, 1406125562] Looping around the photos to save general results len do output : 78 /1406133858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406133998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406134000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406134001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406134003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406134004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406134027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406134029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406134056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406134057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1406134058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406129081', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128587', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128513', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128407', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128325', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128207', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128062', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127592', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127486', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127384', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127275', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127169', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127094', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125705', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125562', None, None, None, None, None, '4337851') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 249 time used for this insertion : 0.04423260688781738 save_final save missing photos in datou_result : time spend for datou_step_exec : 55.323487520217896 time spend to save output : 0.04734158515930176 total time spend for step 2 : 55.3708291053772 step3:rle_unique_nms_with_priority Fri Jan 30 14:42:28 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 4.475340366363525 time for calcul the mask position with numpy : 0.5939376354217529 nb_pixel_total : 8073726 time to create 1 rle with new method : 0.8725078105926514 time for calcul the mask position with numpy : 0.023977041244506836 nb_pixel_total : 367 time to create 1 rle with old method : 0.0006241798400878906 time for calcul the mask position with numpy : 0.023878097534179688 nb_pixel_total : 16290 time to create 1 rle with old method : 0.017676115036010742 time for calcul the mask position with numpy : 0.024812936782836914 nb_pixel_total : 49518 time to create 1 rle with old method : 0.05853891372680664 time for calcul the mask position with numpy : 0.02618694305419922 nb_pixel_total : 8748 time to create 1 rle with old method : 0.009751319885253906 time for calcul the mask position with numpy : 0.02556586265563965 nb_pixel_total : 11551 time to create 1 rle with old method : 0.012770891189575195 time for calcul the mask position with numpy : 0.02483391761779785 nb_pixel_total : 9102 time to create 1 rle with old method : 0.009754657745361328 time for calcul the mask position with numpy : 0.02561330795288086 nb_pixel_total : 35790 time to create 1 rle with old method : 0.03879809379577637 time for calcul the mask position with numpy : 0.024984121322631836 nb_pixel_total : 19406 time to create 1 rle with old method : 0.020961523056030273 time for calcul the mask position with numpy : 0.02437734603881836 nb_pixel_total : 22643 time to create 1 rle with old method : 0.02449488639831543 time for calcul the mask position with numpy : 0.02508711814880371 nb_pixel_total : 26889 time to create 1 rle with old method : 0.029523849487304688 time for calcul the mask position with numpy : 0.024106740951538086 nb_pixel_total : 20370 time to create 1 rle with old method : 0.02224445343017578 create new chi : 2.025562047958374 time to delete rle : 0.02220463752746582 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 5631 TO DO : save crop sub photo not yet done ! save time : 0.4046187400817871 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.0028574466705322 time for calcul the mask position with numpy : 0.6136822700500488 nb_pixel_total : 7156739 time to create 1 rle with new method : 0.77972412109375 time for calcul the mask position with numpy : 0.02333235740661621 nb_pixel_total : 30294 time to create 1 rle with old method : 0.031192302703857422 time for calcul the mask position with numpy : 0.03413653373718262 nb_pixel_total : 978144 time to create 1 rle with new method : 0.7385444641113281 time for calcul the mask position with numpy : 0.02376699447631836 nb_pixel_total : 48012 time to create 1 rle with old method : 0.04977560043334961 time for calcul the mask position with numpy : 0.02356100082397461 nb_pixel_total : 8731 time to create 1 rle with old method : 0.009144067764282227 time for calcul the mask position with numpy : 0.023691415786743164 nb_pixel_total : 59280 time to create 1 rle with old method : 0.06189990043640137 time for calcul the mask position with numpy : 0.025609731674194336 nb_pixel_total : 13200 time to create 1 rle with old method : 0.013851404190063477 create new chi : 2.518064022064209 time to delete rle : 0.001486063003540039 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 12268 TO DO : save crop sub photo not yet done ! save time : 0.8140194416046143 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.5695536136627197 time for calcul the mask position with numpy : 0.5634543895721436 nb_pixel_total : 7657622 time to create 1 rle with new method : 0.7420535087585449 time for calcul the mask position with numpy : 0.024116039276123047 nb_pixel_total : 135202 time to create 1 rle with old method : 0.1429760456085205 time for calcul the mask position with numpy : 0.028254032135009766 nb_pixel_total : 418199 time to create 1 rle with new method : 0.6962757110595703 time for calcul the mask position with numpy : 0.023697376251220703 nb_pixel_total : 60751 time to create 1 rle with old method : 0.06468415260314941 time for calcul the mask position with numpy : 0.0255584716796875 nb_pixel_total : 8636 time to create 1 rle with old method : 0.009425163269042969 time for calcul the mask position with numpy : 0.025661706924438477 nb_pixel_total : 13990 time to create 1 rle with old method : 0.014858007431030273 create new chi : 2.4262022972106934 time to delete rle : 0.0008513927459716797 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5778 TO DO : save crop sub photo not yet done ! save time : 0.4219088554382324 nb_obj : 5 nb_hashtags : 1 time to prepare the origin masks : 1.8360798358917236 time for calcul the mask position with numpy : 1.4505386352539062 nb_pixel_total : 8111673 time to create 1 rle with new method : 0.7460441589355469 time for calcul the mask position with numpy : 0.022749900817871094 nb_pixel_total : 45061 time to create 1 rle with old method : 0.04686164855957031 time for calcul the mask position with numpy : 0.036885976791381836 nb_pixel_total : 51631 time to create 1 rle with old method : 0.05275392532348633 time for calcul the mask position with numpy : 0.02276301383972168 nb_pixel_total : 37727 time to create 1 rle with old method : 0.03880429267883301 time for calcul the mask position with numpy : 0.0231781005859375 nb_pixel_total : 22258 time to create 1 rle with old method : 0.02322697639465332 time for calcul the mask position with numpy : 0.02309131622314453 nb_pixel_total : 26050 time to create 1 rle with old method : 0.026766538619995117 create new chi : 2.555401086807251 time to delete rle : 0.0006539821624755859 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4438 TO DO : save crop sub photo not yet done ! save time : 0.3266768455505371 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.183967351913452 time for calcul the mask position with numpy : 0.5235342979431152 nb_pixel_total : 7766295 time to create 1 rle with new method : 0.7664258480072021 time for calcul the mask position with numpy : 0.022437334060668945 nb_pixel_total : 23786 time to create 1 rle with old method : 0.024901151657104492 time for calcul the mask position with numpy : 0.022055864334106445 nb_pixel_total : 2320 time to create 1 rle with old method : 0.002582550048828125 time for calcul the mask position with numpy : 0.02271270751953125 nb_pixel_total : 25024 time to create 1 rle with old method : 0.025731563568115234 time for calcul the mask position with numpy : 0.02408909797668457 nb_pixel_total : 22802 time to create 1 rle with old method : 0.023192882537841797 time for calcul the mask position with numpy : 0.02636122703552246 nb_pixel_total : 330235 time to create 1 rle with new method : 0.7496328353881836 time for calcul the mask position with numpy : 0.023613691329956055 nb_pixel_total : 24579 time to create 1 rle with old method : 0.024667024612426758 time for calcul the mask position with numpy : 0.02375173568725586 nb_pixel_total : 57544 time to create 1 rle with old method : 0.06241655349731445 time for calcul the mask position with numpy : 0.02343297004699707 nb_pixel_total : 41815 time to create 1 rle with old method : 0.04375886917114258 create new chi : 2.498211622238159 time to delete rle : 0.0008919239044189453 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 6377 TO DO : save crop sub photo not yet done ! save time : 0.4629998207092285 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 1.0638437271118164 time for calcul the mask position with numpy : 0.5760602951049805 nb_pixel_total : 8241261 time to create 1 rle with new method : 0.7465715408325195 time for calcul the mask position with numpy : 0.02338552474975586 nb_pixel_total : 16559 time to create 1 rle with old method : 0.017269372940063477 time for calcul the mask position with numpy : 0.02265000343322754 nb_pixel_total : 36580 time to create 1 rle with old method : 0.03827238082885742 create new chi : 1.4665191173553467 time to delete rle : 0.0004260540008544922 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2950 TO DO : save crop sub photo not yet done ! save time : 0.23876500129699707 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 2.3594558238983154 time for calcul the mask position with numpy : 0.49592161178588867 nb_pixel_total : 7882503 time to create 1 rle with new method : 0.8116304874420166 time for calcul the mask position with numpy : 0.023369789123535156 nb_pixel_total : 3508 time to create 1 rle with old method : 0.003938436508178711 time for calcul the mask position with numpy : 0.024641752243041992 nb_pixel_total : 31698 time to create 1 rle with old method : 0.03360271453857422 time for calcul the mask position with numpy : 0.02558135986328125 nb_pixel_total : 214612 time to create 1 rle with new method : 0.7184813022613525 time for calcul the mask position with numpy : 0.024439096450805664 nb_pixel_total : 6764 time to create 1 rle with old method : 0.007140398025512695 time for calcul the mask position with numpy : 0.02465963363647461 nb_pixel_total : 12865 time to create 1 rle with old method : 0.01381826400756836 time for calcul the mask position with numpy : 0.024209976196289062 nb_pixel_total : 142450 time to create 1 rle with old method : 0.1476001739501953 create new chi : 2.446822166442871 time to delete rle : 0.0007643699645996094 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5310 TO DO : save crop sub photo not yet done ! save time : 0.3999969959259033 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 1.4306650161743164 time for calcul the mask position with numpy : 0.6142449378967285 nb_pixel_total : 8211779 time to create 1 rle with new method : 0.7221100330352783 time for calcul the mask position with numpy : 0.023142099380493164 nb_pixel_total : 28482 time to create 1 rle with old method : 0.029805898666381836 time for calcul the mask position with numpy : 0.02267289161682129 nb_pixel_total : 26571 time to create 1 rle with old method : 0.02826976776123047 time for calcul the mask position with numpy : 0.023244619369506836 nb_pixel_total : 27568 time to create 1 rle with old method : 0.02943134307861328 create new chi : 1.5335910320281982 time to delete rle : 0.0005464553833007812 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3384 TO DO : save crop sub photo not yet done ! save time : 0.2734639644622803 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.1497976779937744 time for calcul the mask position with numpy : 0.6446824073791504 nb_pixel_total : 7933502 time to create 1 rle with new method : 0.7887346744537354 time for calcul the mask position with numpy : 0.023006200790405273 nb_pixel_total : 7735 time to create 1 rle with old method : 0.008331775665283203 time for calcul the mask position with numpy : 0.024135828018188477 nb_pixel_total : 17029 time to create 1 rle with old method : 0.01846480369567871 time for calcul the mask position with numpy : 0.023736000061035156 nb_pixel_total : 9332 time to create 1 rle with old method : 0.009851932525634766 time for calcul the mask position with numpy : 0.024992942810058594 nb_pixel_total : 151433 time to create 1 rle with new method : 0.7654259204864502 time for calcul the mask position with numpy : 0.024266719818115234 nb_pixel_total : 56764 time to create 1 rle with old method : 0.06159210205078125 time for calcul the mask position with numpy : 0.02564072608947754 nb_pixel_total : 93426 time to create 1 rle with old method : 0.09794783592224121 time for calcul the mask position with numpy : 0.02447223663330078 nb_pixel_total : 25179 time to create 1 rle with old method : 0.026647567749023438 create new chi : 2.6571948528289795 time to delete rle : 0.0009026527404785156 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 6096 TO DO : save crop sub photo not yet done ! save time : 0.4647045135498047 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 1.343264102935791 time for calcul the mask position with numpy : 0.4507274627685547 nb_pixel_total : 8240348 time to create 1 rle with new method : 0.7314577102661133 time for calcul the mask position with numpy : 0.022878646850585938 nb_pixel_total : 12797 time to create 1 rle with old method : 0.013476371765136719 time for calcul the mask position with numpy : 0.02341008186340332 nb_pixel_total : 18878 time to create 1 rle with old method : 0.019723176956176758 time for calcul the mask position with numpy : 0.0234682559967041 nb_pixel_total : 22377 time to create 1 rle with old method : 0.023760080337524414 create new chi : 1.3514838218688965 time to delete rle : 0.0005290508270263672 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3668 TO DO : save crop sub photo not yet done ! save time : 0.2950320243835449 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 1.4958381652832031 time for calcul the mask position with numpy : 0.606287956237793 nb_pixel_total : 8121485 time to create 1 rle with new method : 0.809551477432251 time for calcul the mask position with numpy : 0.023962974548339844 nb_pixel_total : 40552 time to create 1 rle with old method : 0.04471468925476074 time for calcul the mask position with numpy : 0.026178598403930664 nb_pixel_total : 8198 time to create 1 rle with old method : 0.008735895156860352 time for calcul the mask position with numpy : 0.024038314819335938 nb_pixel_total : 97222 time to create 1 rle with old method : 0.13043618202209473 time for calcul the mask position with numpy : 0.0240170955657959 nb_pixel_total : 26943 time to create 1 rle with old method : 0.028105974197387695 create new chi : 1.7695019245147705 time to delete rle : 0.000621795654296875 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4360 TO DO : save crop sub photo not yet done ! save time : 0.3327364921569824 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 1.7013208866119385 time for calcul the mask position with numpy : 0.5397548675537109 nb_pixel_total : 8005101 time to create 1 rle with new method : 0.7849640846252441 time for calcul the mask position with numpy : 0.024712085723876953 nb_pixel_total : 65221 time to create 1 rle with old method : 0.07032299041748047 time for calcul the mask position with numpy : 0.024561405181884766 nb_pixel_total : 173074 time to create 1 rle with new method : 1.4984867572784424 time for calcul the mask position with numpy : 0.02511906623840332 nb_pixel_total : 51004 time to create 1 rle with old method : 0.054906606674194336 create new chi : 3.0952279567718506 time to delete rle : 0.000705718994140625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4160 TO DO : save crop sub photo not yet done ! save time : 0.3448934555053711 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.880403518676758 time for calcul the mask position with numpy : 0.6579163074493408 nb_pixel_total : 8020089 time to create 1 rle with new method : 0.7445333003997803 time for calcul the mask position with numpy : 0.022640705108642578 nb_pixel_total : 10799 time to create 1 rle with old method : 0.011067628860473633 time for calcul the mask position with numpy : 0.02324676513671875 nb_pixel_total : 66500 time to create 1 rle with old method : 0.0685431957244873 time for calcul the mask position with numpy : 0.02392268180847168 nb_pixel_total : 27771 time to create 1 rle with old method : 0.03070545196533203 time for calcul the mask position with numpy : 0.023798227310180664 nb_pixel_total : 5222 time to create 1 rle with old method : 0.006298065185546875 time for calcul the mask position with numpy : 0.024558305740356445 nb_pixel_total : 134137 time to create 1 rle with old method : 0.13782572746276855 time for calcul the mask position with numpy : 0.024816274642944336 nb_pixel_total : 12811 time to create 1 rle with old method : 0.013458013534545898 time for calcul the mask position with numpy : 0.023967981338500977 nb_pixel_total : 17071 time to create 1 rle with old method : 0.017960786819458008 create new chi : 1.8975715637207031 time to delete rle : 0.0008330345153808594 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5239 TO DO : save crop sub photo not yet done ! save time : 0.400986909866333 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.5808963775634766 time for calcul the mask position with numpy : 0.6796715259552002 nb_pixel_total : 8006642 time to create 1 rle with new method : 0.8524582386016846 time for calcul the mask position with numpy : 0.025619983673095703 nb_pixel_total : 21409 time to create 1 rle with old method : 0.023812532424926758 time for calcul the mask position with numpy : 0.0253903865814209 nb_pixel_total : 57645 time to create 1 rle with old method : 0.06237602233886719 time for calcul the mask position with numpy : 0.02679586410522461 nb_pixel_total : 22125 time to create 1 rle with old method : 0.0241544246673584 time for calcul the mask position with numpy : 0.02563333511352539 nb_pixel_total : 82969 time to create 1 rle with old method : 0.08893203735351562 time for calcul the mask position with numpy : 0.02548670768737793 nb_pixel_total : 19142 time to create 1 rle with old method : 0.020709753036499023 time for calcul the mask position with numpy : 0.025969982147216797 nb_pixel_total : 23800 time to create 1 rle with old method : 0.025609731674194336 time for calcul the mask position with numpy : 0.025399208068847656 nb_pixel_total : 60668 time to create 1 rle with old method : 0.06574678421020508 create new chi : 2.0680150985717773 time to delete rle : 0.0008542537689208984 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5640 TO DO : save crop sub photo not yet done ! save time : 0.39847493171691895 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.871025800704956 time for calcul the mask position with numpy : 0.5798835754394531 nb_pixel_total : 8289697 time to create 1 rle with new method : 0.748661994934082 time for calcul the mask position with numpy : 0.022774219512939453 nb_pixel_total : 4703 time to create 1 rle with old method : 0.005004167556762695 create new chi : 1.4018566608428955 time to delete rle : 0.00036907196044921875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2274 TO DO : save crop sub photo not yet done ! save time : 0.20354127883911133 map_output_result : {1406129081: (0.0, 'Should be the crop_list due to order', 0), 1406128587: (0.0, 'Should be the crop_list due to order', 0), 1406128513: (0.0, 'Should be the crop_list due to order', 0), 1406128407: (0.0, 'Should be the crop_list due to order', 0), 1406128325: (0.0, 'Should be the crop_list due to order', 0), 1406128207: (0.0, 'Should be the crop_list due to order', 0), 1406128062: (0.0, 'Should be the crop_list due to order', 0), 1406127592: (0.0, 'Should be the crop_list due to order', 0), 1406127486: (0.0, 'Should be the crop_list due to order', 0), 1406127384: (0.0, 'Should be the crop_list due to order', 0), 1406127275: (0.0, 'Should be the crop_list due to order', 0), 1406127169: (0.0, 'Should be the crop_list due to order', 0), 1406127094: (0.0, 'Should be the crop_list due to order', 0), 1406125705: (0.0, 'Should be the crop_list due to order', 0), 1406125562: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1406129081, 1406128587, 1406128513, 1406128407, 1406128325, 1406128207, 1406128062, 1406127592, 1406127486, 1406127384, 1406127275, 1406127169, 1406127094, 1406125705, 1406125562] Looping around the photos to save general results len do output : 15 /1406129081.Didn't retrieve data . /1406128587.Didn't retrieve data . /1406128513.Didn't retrieve data . /1406128407.Didn't retrieve data . /1406128325.Didn't retrieve data . /1406128207.Didn't retrieve data . /1406128062.Didn't retrieve data . /1406127592.Didn't retrieve data . /1406127486.Didn't retrieve data . /1406127384.Didn't retrieve data . /1406127275.Didn't retrieve data . /1406127169.Didn't retrieve data . /1406127094.Didn't retrieve data . /1406125705.Didn't retrieve data . /1406125562.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406129081', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128587', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128513', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128407', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128325', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128207', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128062', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127592', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127486', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127384', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127275', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127169', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127094', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125705', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125562', None, None, None, None, None, '4337851') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.016919851303100586 save_final save missing photos in datou_result : time spend for datou_step_exec : 74.30370211601257 time spend to save output : 0.01748347282409668 total time spend for step 3 : 74.32118558883667 step4:ventilate_hashtags_in_portfolio Fri Jan 30 14:43:43 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30263395 get user id for portfolio 30263395 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30263395 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','autre','mal_croppe','environnement','flou','carton','metal','papier','background','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30263395 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','autre','mal_croppe','environnement','flou','carton','metal','papier','background','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30263395 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','autre','mal_croppe','environnement','flou','carton','metal','papier','background','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30263776,30263777,30263778,30263779,30263780,30263781,30263782,30263783,30263784,30263785,30263786?tags=pet_fonce,autre,mal_croppe,environnement,flou,carton,metal,papier,background,pehd,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1406129081, 1406128587, 1406128513, 1406128407, 1406128325, 1406128207, 1406128062, 1406127592, 1406127486, 1406127384, 1406127275, 1406127169, 1406127094, 1406125705, 1406125562] Looping around the photos to save general results len do output : 1 /30263395. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406129081', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128587', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128513', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128407', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128325', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128207', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128062', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127592', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127486', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127384', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127275', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127169', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127094', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125705', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125562', None, None, None, None, None, '4337851') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.021705150604248047 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.260671377182007 time spend to save output : 0.021973371505737305 total time spend for step 4 : 2.282644748687744 step5:final Fri Jan 30 14:43:45 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1406129081: ('0.037756703317901236',), 1406128587: ('0.037756703317901236',), 1406128513: ('0.037756703317901236',), 1406128407: ('0.037756703317901236',), 1406128325: ('0.037756703317901236',), 1406128207: ('0.037756703317901236',), 1406128062: ('0.037756703317901236',), 1406127592: ('0.037756703317901236',), 1406127486: ('0.037756703317901236',), 1406127384: ('0.037756703317901236',), 1406127275: ('0.037756703317901236',), 1406127169: ('0.037756703317901236',), 1406127094: ('0.037756703317901236',), 1406125705: ('0.037756703317901236',), 1406125562: ('0.037756703317901236',)} new output for save of step final : {1406129081: ('0.037756703317901236',), 1406128587: ('0.037756703317901236',), 1406128513: ('0.037756703317901236',), 1406128407: ('0.037756703317901236',), 1406128325: ('0.037756703317901236',), 1406128207: ('0.037756703317901236',), 1406128062: ('0.037756703317901236',), 1406127592: ('0.037756703317901236',), 1406127486: ('0.037756703317901236',), 1406127384: ('0.037756703317901236',), 1406127275: ('0.037756703317901236',), 1406127169: ('0.037756703317901236',), 1406127094: ('0.037756703317901236',), 1406125705: ('0.037756703317901236',), 1406125562: ('0.037756703317901236',)} [1406129081, 1406128587, 1406128513, 1406128407, 1406128325, 1406128207, 1406128062, 1406127592, 1406127486, 1406127384, 1406127275, 1406127169, 1406127094, 1406125705, 1406125562] Looping around the photos to save general results len do output : 15 /1406129081.Didn't retrieve data . /1406128587.Didn't retrieve data . /1406128513.Didn't retrieve data . /1406128407.Didn't retrieve data . /1406128325.Didn't retrieve data . /1406128207.Didn't retrieve data . /1406128062.Didn't retrieve data . /1406127592.Didn't retrieve data . /1406127486.Didn't retrieve data . /1406127384.Didn't retrieve data . /1406127275.Didn't retrieve data . /1406127169.Didn't retrieve data . /1406127094.Didn't retrieve data . /1406125705.Didn't retrieve data . /1406125562.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406129081', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128587', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128513', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128407', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128325', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128207', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128062', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127592', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127486', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127384', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127275', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127169', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127094', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125705', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125562', None, None, None, None, None, '4337851') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.020837783813476562 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15321969985961914 time spend to save output : 0.05330657958984375 total time spend for step 5 : 0.2065262794494629 step6:blur_detection Fri Jan 30 14:43:45 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0.jpg resize: (2160, 3840) 1406129081 -6.327516028212925 treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a.jpg resize: (2160, 3840) 1406128587 -6.975040489648446 treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9.jpg resize: (2160, 3840) 1406128513 -6.871004160786864 treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70.jpg resize: (2160, 3840) 1406128407 -7.406542744909776 treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca.jpg resize: (2160, 3840) 1406128325 -7.6448702170316984 treat image : temp/1769780430_2030373_1406128207_4d011c71fb5e3d6bc792155365ecb5da.jpg resize: (2160, 3840) 1406128207 -7.105354121419946 treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb.jpg resize: (2160, 3840) 1406128062 -6.67353965089664 treat image : temp/1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11.jpg resize: (2160, 3840) 1406127592 -6.741573967202689 treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5.jpg resize: (2160, 3840) 1406127486 -6.772250261094177 treat image : temp/1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6.jpg resize: (2160, 3840) 1406127384 -6.779644377797894 treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9.jpg resize: (2160, 3840) 1406127275 -6.860629477293634 treat image : temp/1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a.jpg resize: (2160, 3840) 1406127169 -6.831730481551529 treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353.jpg resize: (2160, 3840) 1406127094 -6.687721115783683 treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb.jpg resize: (2160, 3840) 1406125705 -6.861653770822133 treat image : temp/1769780430_2030373_1406125562_f79054b4e6b53f5f4268c9d6b83a6568.jpg resize: (2160, 3840) 1406125562 -4.646501819597975 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376457_0.png resize: (176, 138) 1406133858 -3.247683478979536 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376458_0.png resize: (207, 199) 1406133859 -5.239570139937139 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376460_0.png resize: (217, 251) 1406133860 -4.829743962242712 treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376468_0.png resize: (134, 116) 1406133861 -4.638655750293331 treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376469_0.png resize: (301, 320) 1406133862 -5.33476013683856 treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376470_0.png resize: (99, 143) 1406133863 -4.431220011472795 treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376471_0.png resize: (237, 337) 1406133864 -5.398769301652015 treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376474_0.png resize: (215, 85) 1406133865 -4.270021982763729 treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376475_0.png resize: (122, 86) 1406133866 -4.840305697571698 treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376478_0.png resize: (345, 503) 1406133867 -4.062192390896453 treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376479_0.png resize: (205, 166) 1406133868 -5.850533673050333 treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376480_0.png resize: (111, 383) 1406133869 -4.519076209762149 treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376481_0.png resize: (234, 281) 1406133870 -5.339963399763421 treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376482_0.png resize: (240, 298) 1406133871 -5.620574958581921 treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376483_0.png resize: (323, 418) 1406133872 -3.9671534837791014 treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376484_0.png resize: (304, 444) 1406133873 -4.039781265845338 treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376486_0.png resize: (188, 174) 1406133874 -5.872581279287941 treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376487_0.png resize: (620, 821) 1406133875 -7.0810798627186715 treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376488_0.png resize: (245, 191) 1406133876 -4.256907713707771 treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376490_0.png resize: (243, 343) 1406133877 -5.473242711093509 treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376491_0.png resize: (210, 133) 1406133878 -5.294025650665732 treat image : temp/1769780430_2030373_1406128207_4d011c71fb5e3d6bc792155365ecb5da_rle_crop_4116376492_0.png resize: (232, 271) 1406133879 -3.885773410740511 treat image : temp/1769780430_2030373_1406128207_4d011c71fb5e3d6bc792155365ecb5da_rle_crop_4116376493_0.png resize: (162, 133) 1406133880 -4.867115582612483 treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376494_0.png resize: (394, 446) 1406133881 -4.634984283044271 treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376495_0.png resize: (125, 183) 1406133882 -4.725939734390953 treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376496_0.png resize: (106, 86) 1406133883 -4.9874156573743695 treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376498_0.png resize: (350, 200) 1406133884 -3.673684380852142 treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376499_0.png resize: (92, 56) 1406133885 -3.6719149514557854 treat image : temp/1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11_rle_crop_4116376500_0.png resize: (177, 259) 1406133886 -4.016373874247767 treat image : temp/1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11_rle_crop_4116376501_0.png resize: (267, 120) 1406133887 -3.865258154180671 treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376503_0.png resize: (157, 225) 1406133888 -5.0507012717990545 treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376504_0.png resize: (413, 418) 1406133889 -5.014123788858369 treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376508_0.png resize: (218, 115) 1406133890 -4.777839408833788 treat image : temp/1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6_rle_crop_4116376510_0.png resize: (266, 136) 1406133891 -4.4605717282896835 treat image : temp/1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6_rle_crop_4116376511_0.png resize: (223, 141) 1406133892 -4.9052890693996964 treat image : temp/1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6_rle_crop_4116376512_0.png resize: (184, 85) 1406133893 -3.3645921632473064 treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376513_0.png resize: (301, 100) 1406133894 -4.070343487791984 treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376514_0.png resize: (338, 399) 1406133895 -6.406049991789524 treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376515_0.png resize: (106, 113) 1406133896 -3.4706039447798016 treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376516_0.png resize: (334, 192) 1406133897 -4.51578260939148 treat image : temp/1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a_rle_crop_4116376517_0.png resize: (245, 319) 1406133898 -4.783375237858773 treat image : temp/1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a_rle_crop_4116376519_0.png resize: (270, 392) 1406133899 -3.843999067773406 treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376520_0.png resize: (193, 115) 1406133900 -4.2268928642791135 treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376521_0.png resize: (175, 84) 1406133901 -4.130770494695565 treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376522_0.png resize: (299, 616) 1406133902 -4.818026787704618 treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376525_0.png resize: (329, 272) 1406133903 -4.5788697351672845 treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376526_0.png resize: (62, 269) 1406133904 -3.974322071723152 treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376527_0.png resize: (327, 301) 1406133905 -4.388379002222868 treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376528_0.png resize: (245, 150) 1406133906 -4.01025780796966 treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376529_0.png resize: (178, 161) 1406133907 -3.5141567808001946 treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376532_0.png resize: (279, 290) 1406133908 -4.2879027074630995 treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376473_0.png resize: (235, 255) 1406133920 -4.329734973244889 treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376476_0.png resize: (327, 298) 1406133921 -5.377835760889164 treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376505_0.png resize: (292, 315) 1406133922 -3.5486434772907214 treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376524_0.png resize: (177, 214) 1406133923 -4.215138334604053 treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376531_0.png resize: (151, 248) 1406133924 -2.462157360451335 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376462_0.png resize: (80, 154) 1406133931 -4.97453582253527 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376463_0.png resize: (102, 138) 1406133932 -4.786800142077804 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376464_0.png resize: (103, 107) 1406133933 -5.371535747956875 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376466_0.png resize: (163, 124) 1406133934 -5.657334826988022 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376467_0.png resize: (209, 292) 1406133935 -4.61458525358669 treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376509_0.png resize: (96, 102) 1406133936 -4.664532647431195 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376461_0.png resize: (168, 271) 1406133990 -5.4604116041324655 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376465_0.png resize: (217, 329) 1406133992 -4.69712047370511 treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376472_0.png resize: (1833, 1088) 1406133993 -2.9200585305813225 treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376477_0.png resize: (770, 839) 1406133994 -4.993647607221671 treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376485_0.png resize: (254, 297) 1406133996 -5.9941221689837505 treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376497_0.png resize: (492, 600) 1406133997 -5.137939428504295 treat image : temp/1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11_rle_crop_4116376502_0.png resize: (133, 267) 1406133998 -5.509386836775307 treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376506_0.png resize: (527, 388) 1406134000 -5.018062204294969 treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376507_0.png resize: (104, 110) 1406134001 -4.802498598474381 treat image : temp/1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a_rle_crop_4116376518_0.png resize: (304, 802) 1406134003 -3.3131298888237644 treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376523_0.png resize: (298, 640) 1406134004 -4.884402717831433 treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376530_0.png resize: (341, 309) 1406134027 -4.722342299544613 treat image : temp/1769780430_2030373_1406125562_f79054b4e6b53f5f4268c9d6b83a6568_rle_crop_4116376534_0.png resize: (54, 100) 1406134029 -3.8331003462277153 treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376459_0.png resize: (197, 173) 1406134056 -6.683049661598639 treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376489_0.png resize: (124, 375) 1406134057 -5.1094969683589895 treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376533_0.png resize: (193, 151) 1406134058 -4.91020861422285 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 93 time used for this insertion : 0.018586397171020508 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 93 time used for this insertion : 0.017673492431640625 save missing photos in datou_result : time spend for datou_step_exec : 59.22814083099365 time spend to save output : 0.04224514961242676 total time spend for step 6 : 59.27038598060608 step7:brightness Fri Jan 30 14:44:44 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0.jpg treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a.jpg treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9.jpg treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70.jpg treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca.jpg treat image : temp/1769780430_2030373_1406128207_4d011c71fb5e3d6bc792155365ecb5da.jpg treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb.jpg treat image : temp/1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11.jpg treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5.jpg treat image : temp/1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6.jpg treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9.jpg treat image : temp/1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a.jpg treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353.jpg treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb.jpg treat image : temp/1769780430_2030373_1406125562_f79054b4e6b53f5f4268c9d6b83a6568.jpg treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376457_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376458_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376460_0.png treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376468_0.png treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376469_0.png treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376470_0.png treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376471_0.png treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376474_0.png treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376475_0.png treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376478_0.png treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376479_0.png treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376480_0.png treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376481_0.png treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376482_0.png treat image : temp/1769780430_2030373_1406128407_6fa1e356497d83c553fda474418b8f70_rle_crop_4116376483_0.png treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376484_0.png treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376486_0.png treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376487_0.png treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376488_0.png treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376490_0.png treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376491_0.png treat image : temp/1769780430_2030373_1406128207_4d011c71fb5e3d6bc792155365ecb5da_rle_crop_4116376492_0.png treat image : temp/1769780430_2030373_1406128207_4d011c71fb5e3d6bc792155365ecb5da_rle_crop_4116376493_0.png treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376494_0.png treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376495_0.png treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376496_0.png treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376498_0.png treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376499_0.png treat image : temp/1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11_rle_crop_4116376500_0.png treat image : temp/1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11_rle_crop_4116376501_0.png treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376503_0.png treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376504_0.png treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376508_0.png treat image : temp/1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6_rle_crop_4116376510_0.png treat image : temp/1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6_rle_crop_4116376511_0.png treat image : temp/1769780430_2030373_1406127384_ee0fcb444639ce8e5e48d3917ec8fba6_rle_crop_4116376512_0.png treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376513_0.png treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376514_0.png treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376515_0.png treat image : temp/1769780430_2030373_1406127275_30dbdace32c5b2b4a8e0c9f9e614f1a9_rle_crop_4116376516_0.png treat image : temp/1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a_rle_crop_4116376517_0.png treat image : temp/1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a_rle_crop_4116376519_0.png treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376520_0.png treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376521_0.png treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376522_0.png treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376525_0.png treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376526_0.png treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376527_0.png treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376528_0.png treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376529_0.png treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376532_0.png treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376473_0.png treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376476_0.png treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376505_0.png treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376524_0.png treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376531_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376462_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376463_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376464_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376466_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376467_0.png treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376509_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376461_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376465_0.png treat image : temp/1769780430_2030373_1406128587_b0030884bedc57caf7a735f8a7c1657a_rle_crop_4116376472_0.png treat image : temp/1769780430_2030373_1406128513_a12bef2f55f674f071b77787c8ee5ed9_rle_crop_4116376477_0.png treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376485_0.png treat image : temp/1769780430_2030373_1406128062_e81bf6468b5cdd6bffa55e786e6c39cb_rle_crop_4116376497_0.png treat image : temp/1769780430_2030373_1406127592_d74977e080ed9038ba6c886c7dc34e11_rle_crop_4116376502_0.png treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376506_0.png treat image : temp/1769780430_2030373_1406127486_8183b2989e33f9992dc862cae646cdd5_rle_crop_4116376507_0.png treat image : temp/1769780430_2030373_1406127169_c1fa5f324770215ffcb658fd7a319f6a_rle_crop_4116376518_0.png treat image : temp/1769780430_2030373_1406127094_c7e78163b9c19b81142872d99b3a1353_rle_crop_4116376523_0.png treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376530_0.png treat image : temp/1769780430_2030373_1406125562_f79054b4e6b53f5f4268c9d6b83a6568_rle_crop_4116376534_0.png treat image : temp/1769780430_2030373_1406129081_79b0d257b45eac214e5bdedcb3ddeed0_rle_crop_4116376459_0.png treat image : temp/1769780430_2030373_1406128325_dab7b1e1c32e331f342a01370dc232ca_rle_crop_4116376489_0.png treat image : temp/1769780430_2030373_1406125705_62d09baeb1d12965ba8ffa2a83e3aaeb_rle_crop_4116376533_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 93 time used for this insertion : 0.021985292434692383 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 93 time used for this insertion : 0.02095484733581543 save missing photos in datou_result : time spend for datou_step_exec : 13.653756856918335 time spend to save output : 0.04854726791381836 total time spend for step 7 : 13.702304124832153 step8:velours_tree Fri Jan 30 14:44:58 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.19960951805114746 time spend to save output : 5.14984130859375e-05 total time spend for step 8 : 0.1996610164642334 step9:send_mail_cod Fri Jan 30 14:44:58 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30263395_30-01-2026_14_44_58.pdf 30263776 change filename to text .change filename to text .change filename to text .imagette302637761769780698 30263777 change filename to text .change filename to text .imagette302637771769780698 30263778 imagette302637781769780699 30263780 imagette302637801769780699 30263781 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette302637811769780699 30263782 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette302637821769780699 30263783 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette302637831769780700 30263784 imagette302637841769780701 30263785 imagette302637851769780701 30263786 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette302637861769780701 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30263395 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30263776,30263777,30263778,30263779,30263780,30263781,30263782,30263783,30263784,30263785,30263786?tags=pet_fonce,autre,mal_croppe,environnement,flou,carton,metal,papier,background,pehd,pet_clair your option no_mail is active, we will not send the real mail to your client args[1406129081] : ((1406129081, -6.327516028212925, 492609224), (1406129081, -1.2600050107965044, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406128587] : ((1406128587, -6.975040489648446, 492609224), (1406128587, -0.6913907873236588, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406128513] : ((1406128513, -6.871004160786864, 492609224), (1406128513, -0.5151166958787313, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406128407] : ((1406128407, -7.406542744909776, 492609224), (1406128407, -0.5631532854246023, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406128325] : ((1406128325, -7.6448702170316984, 492609224), (1406128325, -0.4930631539490178, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406128207] : ((1406128207, -7.105354121419946, 492609224), (1406128207, -0.7340974688740429, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406128062] : ((1406128062, -6.67353965089664, 492609224), (1406128062, -0.6532974349365278, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406127592] : ((1406127592, -6.741573967202689, 492609224), (1406127592, -0.8798708220230239, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406127486] : ((1406127486, -6.772250261094177, 492609224), (1406127486, -0.7085005934163897, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406127384] : ((1406127384, -6.779644377797894, 492609224), (1406127384, -0.909292025454424, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406127275] : ((1406127275, -6.860629477293634, 492609224), (1406127275, -0.7750459217416796, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406127169] : ((1406127169, -6.831730481551529, 492609224), (1406127169, -0.7757564610569833, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406127094] : ((1406127094, -6.687721115783683, 492609224), (1406127094, -0.7865740063646784, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406125705] : ((1406125705, -6.861653770822133, 492609224), (1406125705, -0.7227500853112819, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com args[1406125562] : ((1406125562, -4.646501819597975, 492609224), (1406125562, -3.1514967845666324, 501862349), '0.037756703317901236') We are sending mail with results at report@fotonower.com refus_total : 0.037756703317901236 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30263395 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30263395_30-01-2026_14_44_58.pdf results_Auto_P30263395_30-01-2026_14_44_58.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30263395_30-01-2026_14_44_58.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30263395','results_Auto_P30263395_30-01-2026_14_44_58.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30263395_30-01-2026_14_44_58.pdf','pdf','','0.8','0.037756703317901236') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1406129081, 1406128587, 1406128513, 1406128407, 1406128325, 1406128207, 1406128062, 1406127592, 1406127486, 1406127384, 1406127275, 1406127169, 1406127094, 1406125705, 1406125562] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406129081', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128587', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128513', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128407', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128325', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128207', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128062', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127592', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127486', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127384', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127275', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127169', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127094', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125705', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125562', None, None, None, None, None, '4337851') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.017127037048339844 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.906991481781006 time spend to save output : 0.01735973358154297 total time spend for step 9 : 7.924351215362549 step10:split_time_score Fri Jan 30 14:45:06 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 15),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 30012026 30263395 Nombre de photos uploadées : 15 / 23040 (0%) 30012026 30263395 Nombre de photos taguées (types de déchets): 0 / 15 (0%) 30012026 30263395 Nombre de photos taguées (volume) : 0 / 15 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 3.814697265625e-06 ??????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005078315734863281 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2733426094055176 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08305865771663742 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30258957_30-01-2026_07_35_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30258957 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30258957 AND mptpi.`type`=3726 To do Qualite : 0.015338524815286839 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30258958_30-01-2026_07_37_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30258958 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30258958 AND mptpi.`type`=3726 To do Qualite : 0.17729412062954902 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30259258_30-01-2026_08_38_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30259258 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30259258 AND mptpi.`type`=3726 To do Qualite : 0.12719301977479786 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30259262_30-01-2026_08_36_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30259262 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30259262 AND mptpi.`type`=3726 To do Qualite : 0.11090058036716498 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30260107_30-01-2026_09_41_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30260107 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30260107 AND mptpi.`type`=3726 To do Qualite : 0.12848659854511252 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30260110_30-01-2026_09_38_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30260110 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30260110 AND mptpi.`type`=3726 To do Qualite : 0.10777898699740986 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30260114_30-01-2026_09_36_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30260114 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30260114 AND mptpi.`type`=3726 To do Qualite : 0.05828336924847002 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30260984_30-01-2026_11_05_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30260984 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30260984 AND mptpi.`type`=3726 To do Qualite : 0.06597571307509743 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30261003_30-01-2026_11_05_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30261003 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30261003 AND mptpi.`type`=3726 To do Qualite : 0.026683909069708602 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30261518_30-01-2026_12_13_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30261518 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30261518 AND mptpi.`type`=3726 To do Qualite : 0.08054898661853417 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30261519_30-01-2026_12_09_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30261519 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30261519 AND mptpi.`type`=3726 To do Qualite : 0.029121202132309863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30261559_30-01-2026_12_07_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30261559 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30261559 AND mptpi.`type`=3726 To do Qualite : 0.0189675079094158 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30261560_30-01-2026_12_07_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30261560 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30261560 AND mptpi.`type`=3726 To do Qualite : 0.03874551159962845 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30262810_30-01-2026_14_08_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30262810 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30262810 AND mptpi.`type`=3726 To do Qualite : 0.06482424237892118 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30262812_30-01-2026_14_11_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30262812 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30262812 AND mptpi.`type`=3726 To do Qualite : 0.07260135359287428 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30262193_30-01-2026_13_05_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30262193 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30262193 AND mptpi.`type`=3726 To do Qualite : 0.08874749436750169 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30262814_30-01-2026_14_08_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30262814 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30262814 AND mptpi.`type`=3726 To do Qualite : 0.06951470621292626 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30262817_30-01-2026_14_11_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30262817 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30262817 AND mptpi.`type`=3726 To do Qualite : 0.12637867517390536 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30262818_30-01-2026_14_09_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30262818 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30262818 AND mptpi.`type`=3726 To do Qualite : 0.02772881072146082 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30263392_30-01-2026_14_39_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30263392 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30263392 AND mptpi.`type`=3726 To do Qualite : 0.03278929583522887 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30263393_30-01-2026_14_38_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30263393 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30263393 AND mptpi.`type`=3726 To do Qualite : 0.037756703317901236 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30263395_30-01-2026_14_44_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30263395 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30263395 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'30012026': {'nb_upload': 15, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1406129081, 1406128587, 1406128513, 1406128407, 1406128325, 1406128207, 1406128062, 1406127592, 1406127486, 1406127384, 1406127275, 1406127169, 1406127094, 1406125705, 1406125562] Looping around the photos to save general results len do output : 1 /30263395Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406129081', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128587', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128513', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128407', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128325', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128207', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406128062', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127592', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127486', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127384', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127275', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127169', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406127094', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125705', None, None, None, None, None, '4337851') ('3318', None, None, None, None, None, None, None, '4337851') ('3318', '30263395', '1406125562', None, None, None, None, None, '4337851') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.01684713363647461 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.079435110092163 time spend to save output : 0.01706552505493164 total time spend for step 10 : 2.0965006351470947 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 15 set_done_treatment 134.56user 110.84system 4:42.82elapsed 86%CPU (0avgtext+0avgdata 4701060maxresident)k 212264inputs+123424outputs (9642major+12152875minor)pagefaults 0swaps