python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1162243 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4329691'] with mtr_portfolio_ids : ['30105368'] and first list_photo_ids : [] new path : /proc/1162243/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 2.217158555984497 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Jan 13 19:40:30 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10826 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-13 19:40:34.826218: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-13 19:40:34.858513: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-13 19:40:34.861029: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f38e0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-13 19:40:34.861086: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-13 19:40:34.866592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-13 19:40:35.127173: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3521f0d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-13 19:40:35.127221: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-13 19:40:35.129131: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-13 19:40:35.130952: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-13 19:40:35.162645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-13 19:40:35.180976: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-13 19:40:35.184801: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-13 19:40:35.216128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-13 19:40:35.220434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-13 19:40:35.275362: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-13 19:40:35.277245: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-13 19:40:35.277650: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-13 19:40:35.281760: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-13 19:40:35.281793: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-13 19:40:35.281804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-13 19:40:35.284451: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-13 19:40:35.707958: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-13 19:40:35.708093: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-13 19:40:35.708117: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-13 19:40:35.708139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-13 19:40:35.708159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-13 19:40:35.708180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-13 19:40:35.708200: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-13 19:40:35.708221: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-13 19:40:35.709794: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-13 19:40:35.711252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-13 19:40:35.711288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-13 19:40:35.711303: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-13 19:40:35.711317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-13 19:40:35.711331: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-13 19:40:35.711344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-13 19:40:35.711358: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-13 19:40:35.711371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-13 19:40:35.712647: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-13 19:40:35.712682: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-13 19:40:35.712690: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-13 19:40:35.712698: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-13 19:40:35.714023: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-13 19:40:48.960344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-13 19:40:49.288356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 1162701 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5537 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10826 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1596, 978, 1836, 1224] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009508132934570312 nb_pixel_total : 32634 time to create 1 rle with old method : 0.03779482841491699 length of segment : 223 DEBUG bbox = [978, 1494, 1362, 2124] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0035774707794189453 nb_pixel_total : 155939 time to create 1 rle with new method : 0.008978843688964844 length of segment : 357 DEBUG bbox = [1662, 2718, 1920, 2928] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005662441253662109 nb_pixel_total : 19367 time to create 1 rle with old method : 0.02207040786743164 length of segment : 236 DEBUG bbox = [342, 360, 576, 558] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000484466552734375 nb_pixel_total : 27495 time to create 1 rle with old method : 0.031031131744384766 length of segment : 272 DEBUG bbox = [996, 864, 1200, 1068] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004024505615234375 nb_pixel_total : 23250 time to create 1 rle with old method : 0.026161909103393555 length of segment : 194 DEBUG bbox = [1290, 894, 1512, 1074] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004150867462158203 nb_pixel_total : 28238 time to create 1 rle with old method : 0.032095909118652344 length of segment : 211 DEBUG bbox = [1668, 738, 1986, 996] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009262561798095703 nb_pixel_total : 46372 time to create 1 rle with old method : 0.052489280700683594 length of segment : 332 DEBUG bbox = [744, 2598, 1272, 3114] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003977537155151367 nb_pixel_total : 177876 time to create 1 rle with new method : 0.009120941162109375 length of segment : 475 DEBUG bbox = [432, 1044, 612, 1260] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005280971527099609 nb_pixel_total : 23458 time to create 1 rle with old method : 0.027492523193359375 length of segment : 171 DEBUG bbox = [294, 1248, 1014, 2178] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.5948131084442139 nb_pixel_total : 358453 time to create 1 rle with new method : 0.03534746170043945 length of segment : 806 DEBUG bbox = [360, 2796, 660, 3120] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012755393981933594 nb_pixel_total : 53501 time to create 1 rle with old method : 0.07631945610046387 length of segment : 339 DEBUG bbox = [1464, 1278, 2010, 2442] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005921125411987305 nb_pixel_total : 141316 time to create 1 rle with old method : 0.20206785202026367 length of segment : 636 DEBUG bbox = [1830, 1032, 2112, 1260] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008080005645751953 nb_pixel_total : 54483 time to create 1 rle with old method : 0.06084561347961426 length of segment : 282 DEBUG bbox = [396, 30, 882, 498] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018239021301269531 nb_pixel_total : 107103 time to create 1 rle with old method : 0.12038946151733398 length of segment : 339 DEBUG bbox = [870, 570, 984, 690] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00018215179443359375 nb_pixel_total : 9897 time to create 1 rle with old method : 0.01105809211730957 length of segment : 114 DEBUG bbox = [54, 3042, 624, 3594] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002906322479248047 nb_pixel_total : 175159 time to create 1 rle with new method : 0.00950932502746582 length of segment : 543 DEBUG bbox = [120, 1590, 384, 2100] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001096963882446289 nb_pixel_total : 76033 time to create 1 rle with old method : 0.08246397972106934 length of segment : 279 DEBUG bbox = [1440, 720, 1806, 960] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007889270782470703 nb_pixel_total : 55071 time to create 1 rle with old method : 0.061980485916137695 length of segment : 328 DEBUG bbox = [42, 2100, 366, 2262] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005202293395996094 nb_pixel_total : 25303 time to create 1 rle with old method : 0.03406524658203125 length of segment : 253 DEBUG bbox = [1224, 1182, 1398, 1392] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00044226646423339844 nb_pixel_total : 17937 time to create 1 rle with old method : 0.02283000946044922 length of segment : 136 DEBUG bbox = [180, 1122, 438, 1536] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011394023895263672 nb_pixel_total : 53821 time to create 1 rle with old method : 0.07397580146789551 length of segment : 266 DEBUG bbox = [96, 3054, 612, 3582] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031020641326904297 nb_pixel_total : 181319 time to create 1 rle with new method : 0.007402181625366211 length of segment : 501 DEBUG bbox = [360, 1872, 720, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014863014221191406 nb_pixel_total : 70761 time to create 1 rle with old method : 0.1070241928100586 length of segment : 341 DEBUG bbox = [2076, 1662, 2154, 1830] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003647804260253906 nb_pixel_total : 9942 time to create 1 rle with old method : 0.01753377914428711 length of segment : 77 DEBUG bbox = [432, 36, 876, 498] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0027360916137695312 nb_pixel_total : 110561 time to create 1 rle with old method : 0.12678766250610352 length of segment : 379 DEBUG bbox = [90, 3006, 282, 3210] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00048041343688964844 nb_pixel_total : 24792 time to create 1 rle with old method : 0.04055953025817871 length of segment : 180 DEBUG bbox = [384, 2598, 684, 2874] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007734298706054688 nb_pixel_total : 50164 time to create 1 rle with old method : 0.05593252182006836 length of segment : 368 DEBUG bbox = [6, 1926, 102, 2178] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002880096435546875 nb_pixel_total : 17512 time to create 1 rle with old method : 0.02047276496887207 length of segment : 87 DEBUG bbox = [864, 570, 972, 690] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00016927719116210938 nb_pixel_total : 9912 time to create 1 rle with old method : 0.01153421401977539 length of segment : 108 DEBUG bbox = [42, 1668, 396, 2058] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011851787567138672 nb_pixel_total : 91740 time to create 1 rle with old method : 0.09914159774780273 length of segment : 349 DEBUG bbox = [0, 3024, 96, 3210] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00023651123046875 nb_pixel_total : 13207 time to create 1 rle with old method : 0.01508641242980957 length of segment : 91 DEBUG bbox = [1074, 378, 1692, 636] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018019676208496094 nb_pixel_total : 90271 time to create 1 rle with old method : 0.09945321083068848 length of segment : 579 DEBUG bbox = [1422, 432, 1686, 582] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004012584686279297 nb_pixel_total : 18651 time to create 1 rle with old method : 0.02130270004272461 length of segment : 251 DEBUG bbox = [852, 1074, 1008, 1236] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00034046173095703125 nb_pixel_total : 12726 time to create 1 rle with old method : 0.01772928237915039 length of segment : 143 DEBUG bbox = [564, 1746, 936, 2220] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014522075653076172 nb_pixel_total : 67717 time to create 1 rle with old method : 0.07578158378601074 length of segment : 350 DEBUG bbox = [1410, 1926, 1860, 2358] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018756389617919922 nb_pixel_total : 120243 time to create 1 rle with old method : 0.1349484920501709 length of segment : 407 DEBUG bbox = [702, 2220, 942, 2484] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007128715515136719 nb_pixel_total : 41765 time to create 1 rle with old method : 0.0450899600982666 length of segment : 240 DEBUG bbox = [1488, 1182, 1650, 1392] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003750324249267578 nb_pixel_total : 20389 time to create 1 rle with old method : 0.023292064666748047 length of segment : 147 DEBUG bbox = [12, 2592, 156, 2778] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040841102600097656 nb_pixel_total : 14656 time to create 1 rle with old method : 0.018750667572021484 length of segment : 132 DEBUG bbox = [456, 1116, 660, 1254] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003750324249267578 nb_pixel_total : 18867 time to create 1 rle with old method : 0.022001981735229492 length of segment : 193 DEBUG bbox = [12, 1302, 174, 1404] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00026226043701171875 nb_pixel_total : 9553 time to create 1 rle with old method : 0.011359453201293945 length of segment : 153 DEBUG bbox = [6, 54, 144, 252] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003533363342285156 nb_pixel_total : 20039 time to create 1 rle with old method : 0.02376699447631836 length of segment : 147 DEBUG bbox = [1812, 1944, 2136, 2628] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020437240600585938 nb_pixel_total : 159511 time to create 1 rle with new method : 0.006679534912109375 length of segment : 296 DEBUG bbox = [1746, 318, 2148, 780] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022182464599609375 nb_pixel_total : 144731 time to create 1 rle with old method : 0.18146753311157227 length of segment : 395 DEBUG bbox = [732, 1476, 1122, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010535717010498047 nb_pixel_total : 58970 time to create 1 rle with old method : 0.06771111488342285 length of segment : 309 DEBUG bbox = [462, 2934, 762, 3090] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00048160552978515625 nb_pixel_total : 24475 time to create 1 rle with old method : 0.028184175491333008 length of segment : 275 DEBUG bbox = [516, 2616, 828, 2850] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008094310760498047 nb_pixel_total : 48566 time to create 1 rle with old method : 0.05561566352844238 length of segment : 299 DEBUG bbox = [1614, 750, 2016, 1200] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022385120391845703 nb_pixel_total : 117249 time to create 1 rle with old method : 0.1312873363494873 length of segment : 371 DEBUG bbox = [732, 1764, 1110, 2070] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010437965393066406 nb_pixel_total : 71943 time to create 1 rle with old method : 0.07873702049255371 length of segment : 478 DEBUG bbox = [180, 1842, 432, 2046] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00048041343688964844 nb_pixel_total : 26541 time to create 1 rle with old method : 0.03151392936706543 length of segment : 195 DEBUG bbox = [60, 360, 504, 858] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018317699432373047 nb_pixel_total : 150046 time to create 1 rle with new method : 0.0038886070251464844 length of segment : 528 DEBUG bbox = [762, 1860, 1068, 2208] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009703636169433594 nb_pixel_total : 72542 time to create 1 rle with old method : 0.0787649154663086 length of segment : 297 DEBUG bbox = [510, 912, 834, 1200] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007243156433105469 nb_pixel_total : 53638 time to create 1 rle with old method : 0.05787944793701172 length of segment : 308 DEBUG bbox = [510, 384, 690, 804] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006048679351806641 nb_pixel_total : 41370 time to create 1 rle with old method : 0.0520787239074707 length of segment : 164 DEBUG bbox = [1680, 1578, 2076, 2088] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001386880874633789 nb_pixel_total : 80040 time to create 1 rle with old method : 0.09575772285461426 length of segment : 482 DEBUG bbox = [6, 2820, 468, 3468] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002530813217163086 nb_pixel_total : 199393 time to create 1 rle with new method : 0.006821155548095703 length of segment : 446 DEBUG bbox = [18, 96, 462, 456] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012717247009277344 nb_pixel_total : 84844 time to create 1 rle with old method : 0.09383726119995117 length of segment : 457 DEBUG bbox = [408, 1686, 672, 1824] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003712177276611328 nb_pixel_total : 24913 time to create 1 rle with old method : 0.03226161003112793 length of segment : 248 DEBUG bbox = [78, 1974, 270, 2424] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010266304016113281 nb_pixel_total : 35371 time to create 1 rle with old method : 0.041192054748535156 length of segment : 184 DEBUG bbox = [342, 1164, 702, 1542] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016536712646484375 nb_pixel_total : 84997 time to create 1 rle with old method : 0.09783434867858887 length of segment : 342 DEBUG bbox = [24, 150, 408, 426] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016064643859863281 nb_pixel_total : 83065 time to create 1 rle with old method : 0.09190702438354492 length of segment : 378 DEBUG bbox = [1242, 2148, 1488, 2406] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000980377197265625 nb_pixel_total : 41568 time to create 1 rle with old method : 0.04766035079956055 length of segment : 245 DEBUG bbox = [942, 2658, 1254, 2838] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009729862213134766 nb_pixel_total : 37515 time to create 1 rle with old method : 0.04320025444030762 length of segment : 284 DEBUG bbox = [2010, 930, 2160, 1128] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005316734313964844 nb_pixel_total : 20578 time to create 1 rle with old method : 0.023828744888305664 length of segment : 147 DEBUG bbox = [1296, 1554, 1776, 2310] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003631114959716797 nb_pixel_total : 164513 time to create 1 rle with new method : 0.00991201400756836 length of segment : 409 DEBUG bbox = [642, 2670, 798, 2856] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003180503845214844 nb_pixel_total : 17830 time to create 1 rle with old method : 0.020600318908691406 length of segment : 153 DEBUG bbox = [1896, 1602, 2064, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00029850006103515625 nb_pixel_total : 20165 time to create 1 rle with old method : 0.0238494873046875 length of segment : 141 DEBUG bbox = [762, 660, 1272, 1014] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001580953598022461 nb_pixel_total : 110940 time to create 1 rle with old method : 0.12265896797180176 length of segment : 504 DEBUG bbox = [1482, 1512, 1674, 1698] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006024837493896484 nb_pixel_total : 18806 time to create 1 rle with old method : 0.020551443099975586 length of segment : 152 DEBUG bbox = [558, 1128, 762, 1278] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006349086761474609 nb_pixel_total : 22987 time to create 1 rle with old method : 0.026466846466064453 length of segment : 189 DEBUG bbox = [1260, 1578, 1608, 2046] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017561912536621094 nb_pixel_total : 48144 time to create 1 rle with old method : 0.05441856384277344 length of segment : 324 DEBUG bbox = [330, 3138, 552, 3294] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006678104400634766 nb_pixel_total : 22626 time to create 1 rle with old method : 0.025686025619506836 length of segment : 196 DEBUG bbox = [1224, 2640, 1398, 2820] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006153583526611328 nb_pixel_total : 20708 time to create 1 rle with old method : 0.023029327392578125 length of segment : 166 DEBUG bbox = [1026, 1704, 1308, 2040] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012409687042236328 nb_pixel_total : 66082 time to create 1 rle with old method : 0.07270956039428711 length of segment : 256 DEBUG bbox = [1518, 972, 1734, 1266] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009298324584960938 nb_pixel_total : 21725 time to create 1 rle with old method : 0.024518728256225586 length of segment : 183 DEBUG bbox = [1278, 2118, 1410, 2238] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003337860107421875 nb_pixel_total : 9908 time to create 1 rle with old method : 0.011129379272460938 length of segment : 120 DEBUG bbox = [84, 1236, 444, 1914] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0030090808868408203 nb_pixel_total : 100680 time to create 1 rle with old method : 0.11336278915405273 length of segment : 379 DEBUG bbox = [1596, 2004, 1776, 2232] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000591278076171875 nb_pixel_total : 21388 time to create 1 rle with old method : 0.023264408111572266 length of segment : 170 DEBUG bbox = [1146, 498, 1380, 666] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000629425048828125 nb_pixel_total : 25350 time to create 1 rle with old method : 0.027596473693847656 length of segment : 232 DEBUG bbox = [0, 210, 2160, 2730] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.22658085823059082 nb_pixel_total : 4340979 time to create 1 rle with new method : 0.722175121307373 length of segment : 1976 DEBUG bbox = [1668, 930, 1824, 1128] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000316619873046875 nb_pixel_total : 17791 time to create 1 rle with old method : 0.02001357078552246 length of segment : 140 DEBUG bbox = [1650, 1266, 1770, 1452] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 8798 time to create 1 rle with old method : 0.009882688522338867 length of segment : 94 time spent for convertir_results : 10.119672775268555 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 82 chid ids of type : 3594 Number RLEs to save : 24927 save missing photos in datou_result : time spend for datou_step_exec : 83.18063282966614 time spend to save output : 1.5299351215362549 total time spend for step 1 : 84.71056795120239 step2:crop_condition Tue Jan 13 19:41:55 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 82 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768329724_1162243 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885824_0.png', 0, 235, 223, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885826_0.png', 0, 199, 236, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885827_0.png', 0, 197, 224, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885828_0.png', 0, 199, 193, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885829_0.png', 0, 179, 210, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885839_0.png', 0, 460, 506, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885841_0.png', 0, 238, 328, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885843_0.png', 0, 184, 135, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885845_0.png', 0, 494, 462, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885846_0.png', 0, 367, 305, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885847_0.png', 0, 163, 76, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885850_0.png', 0, 275, 297, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885855_0.png', 0, 248, 613, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885856_0.png', 0, 133, 251, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885858_0.png', 0, 447, 336, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885861_0.png', 0, 205, 147, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885863_0.png', 0, 131, 193, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885870_0.png', 0, 233, 299, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885876_0.png', 0, 273, 308, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885878_0.png', 0, 499, 334, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885881_0.png', 0, 132, 248, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885887_0.png', 0, 195, 143, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885888_0.png', 0, 724, 373, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85_rle_crop_4098885890_0.png', 0, 170, 139, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885893_0.png', 0, 150, 189, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885894_0.png', 0, 414, 296, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885898_0.png', 0, 280, 183, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885899_0.png', 0, 109, 119, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329731), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885904_0.png', 0, 179, 140, 0, 1768329731,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.431040525436401 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768329738_1162243 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885833_0.png', 0, 886, 693, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885842_0.png', 0, 153, 251, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885849_0.png', 0, 200, 180, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885857_0.png', 0, 128, 140, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885859_0.png', 0, 348, 398, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885860_0.png', 0, 250, 232, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885869_0.png', 0, 143, 274, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885882_0.png', 0, 354, 145, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885885_0.png', 0, 255, 236, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85_rle_crop_4098885889_0.png', 0, 172, 153, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885895_0.png', 0, 154, 194, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329740), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885901_0.png', 0, 209, 170, 0, 1768329740,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.100379467010498 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768329743_1162243 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329743), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885830_0.png', 0, 200, 312, 0, 1768329743,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329743), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885886_0.png', 0, 161, 284, 0, 1768329743,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329743), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885897_0.png', 0, 332, 250, 0, 1768329743,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.116119384765625 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 3736932 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768329775_1162243 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885825_0.png', 0, 567, 353, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885831_0.png', 0, 501, 466, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885834_0.png', 0, 314, 287, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885835_0.png', 0, 943, 379, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885836_0.png', 0, 209, 280, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885837_0.png', 0, 407, 329, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885840_0.png', 0, 454, 249, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885844_0.png', 0, 397, 203, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885848_0.png', 0, 406, 351, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885851_0.png', 0, 250, 82, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885853_0.png', 0, 366, 346, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885854_0.png', 0, 171, 88, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885862_0.png', 0, 164, 132, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885864_0.png', 0, 93, 153, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885865_0.png', 0, 188, 131, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885866_0.png', 0, 660, 295, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885867_0.png', 0, 443, 395, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885868_0.png', 0, 279, 306, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885871_0.png', 0, 394, 364, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885872_0.png', 0, 286, 367, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885873_0.png', 0, 176, 193, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885874_0.png', 0, 491, 417, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885875_0.png', 0, 326, 277, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885877_0.png', 0, 417, 159, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885879_0.png', 0, 513, 445, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885880_0.png', 0, 326, 423, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885883_0.png', 0, 362, 342, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885884_0.png', 0, 262, 377, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85_rle_crop_4098885891_0.png', 0, 323, 497, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885900_0.png', 0, 574, 283, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885902_0.png', 0, 163, 232, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329782), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885903_0.png', 0, 2445, 1935, 0, 1768329782,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 32 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.278352499008179 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768329786_1162243 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329787), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885832_0.png', 0, 177, 171, 0, 1768329787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329787), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885838_0.png', 0, 107, 114, 0, 1768329787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329787), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885852_0.png', 0, 107, 108, 0, 1768329787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329787), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885892_0.png', 0, 165, 150, 0, 1768329787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329787), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885896_0.png', 0, 158, 166, 0, 1768329787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768329787), 0.0, 0.0, 14, '', 0, 0, '1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885905_0.png', 0, 181, 91, 0, 1768329787,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7177841663360596 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1403692120, 1403692114, 1403692092, 1403692088, 1403692077, 1403692039, 1403692016, 1403691978, 1403691191, 1403691189, 1403691174, 1403691159] Looping around the photos to save general results len do output : 82 /1403696660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403696857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692120', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692114', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692092', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692088', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692077', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692039', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692016', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691978', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691191', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691189', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691174', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691159', None, None, None, None, None, '4329691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 258 time used for this insertion : 0.03811073303222656 save_final save missing photos in datou_result : time spend for datou_step_exec : 72.51320457458496 time spend to save output : 0.04061698913574219 total time spend for step 2 : 72.5538215637207 step3:rle_unique_nms_with_priority Tue Jan 13 19:43:08 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 82 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 5 time to prepare the origin masks : 6.38293719291687 time for calcul the mask position with numpy : 0.7202303409576416 nb_pixel_total : 7152018 time to create 1 rle with new method : 0.8564562797546387 time for calcul the mask position with numpy : 0.023555517196655273 nb_pixel_total : 54483 time to create 1 rle with old method : 0.058823347091674805 time for calcul the mask position with numpy : 0.025145292282104492 nb_pixel_total : 141316 time to create 1 rle with old method : 0.15103602409362793 time for calcul the mask position with numpy : 0.025298357009887695 nb_pixel_total : 53501 time to create 1 rle with old method : 0.060132741928100586 time for calcul the mask position with numpy : 0.02902674674987793 nb_pixel_total : 358453 time to create 1 rle with new method : 1.0455749034881592 time for calcul the mask position with numpy : 0.02431464195251465 nb_pixel_total : 23458 time to create 1 rle with old method : 0.030680418014526367 time for calcul the mask position with numpy : 0.029020071029663086 nb_pixel_total : 177876 time to create 1 rle with new method : 0.8202147483825684 time for calcul the mask position with numpy : 0.02569580078125 nb_pixel_total : 46372 time to create 1 rle with old method : 0.053624868392944336 time for calcul the mask position with numpy : 0.024979591369628906 nb_pixel_total : 28238 time to create 1 rle with old method : 0.03138995170593262 time for calcul the mask position with numpy : 0.025350093841552734 nb_pixel_total : 23250 time to create 1 rle with old method : 0.025391578674316406 time for calcul the mask position with numpy : 0.02644491195678711 nb_pixel_total : 27495 time to create 1 rle with old method : 0.030793428421020508 time for calcul the mask position with numpy : 0.0262148380279541 nb_pixel_total : 19367 time to create 1 rle with old method : 0.02170586585998535 time for calcul the mask position with numpy : 0.025578022003173828 nb_pixel_total : 155939 time to create 1 rle with new method : 1.0186433792114258 time for calcul the mask position with numpy : 0.02527904510498047 nb_pixel_total : 32634 time to create 1 rle with old method : 0.0354304313659668 create new chi : 5.40565037727356 time to delete rle : 0.02779674530029297 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 11228 TO DO : save crop sub photo not yet done ! save time : 0.688471794128418 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 4.496935129165649 time for calcul the mask position with numpy : 0.6326158046722412 nb_pixel_total : 7774076 time to create 1 rle with new method : 0.823108434677124 time for calcul the mask position with numpy : 0.025135517120361328 nb_pixel_total : 53821 time to create 1 rle with old method : 0.0607295036315918 time for calcul the mask position with numpy : 0.025867700576782227 nb_pixel_total : 17937 time to create 1 rle with old method : 0.019534587860107422 time for calcul the mask position with numpy : 0.024153947830200195 nb_pixel_total : 25303 time to create 1 rle with old method : 0.027044057846069336 time for calcul the mask position with numpy : 0.024287700653076172 nb_pixel_total : 55071 time to create 1 rle with old method : 0.05956315994262695 time for calcul the mask position with numpy : 0.024313688278198242 nb_pixel_total : 76033 time to create 1 rle with old method : 0.08323144912719727 time for calcul the mask position with numpy : 0.026345014572143555 nb_pixel_total : 175159 time to create 1 rle with new method : 0.8366842269897461 time for calcul the mask position with numpy : 0.02492547035217285 nb_pixel_total : 9897 time to create 1 rle with old method : 0.01097249984741211 time for calcul the mask position with numpy : 0.0257570743560791 nb_pixel_total : 107103 time to create 1 rle with old method : 0.11940431594848633 create new chi : 2.9487690925598145 time to delete rle : 0.0009036064147949219 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 6676 TO DO : save crop sub photo not yet done ! save time : 0.4465043544769287 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 4.522757291793823 time for calcul the mask position with numpy : 1.0090975761413574 nb_pixel_total : 7727725 time to create 1 rle with new method : 1.268502950668335 time for calcul the mask position with numpy : 0.023383140563964844 nb_pixel_total : 91740 time to create 1 rle with old method : 0.09641075134277344 time for calcul the mask position with numpy : 0.02468085289001465 nb_pixel_total : 9912 time to create 1 rle with old method : 0.01080322265625 time for calcul the mask position with numpy : 0.025377750396728516 nb_pixel_total : 17512 time to create 1 rle with old method : 0.018706560134887695 time for calcul the mask position with numpy : 0.02409505844116211 nb_pixel_total : 50164 time to create 1 rle with old method : 0.0527193546295166 time for calcul the mask position with numpy : 0.023968219757080078 nb_pixel_total : 24764 time to create 1 rle with old method : 0.026953697204589844 time for calcul the mask position with numpy : 0.025580406188964844 nb_pixel_total : 110561 time to create 1 rle with old method : 0.11666369438171387 time for calcul the mask position with numpy : 0.023438215255737305 nb_pixel_total : 9942 time to create 1 rle with old method : 0.010119199752807617 time for calcul the mask position with numpy : 0.023514270782470703 nb_pixel_total : 70761 time to create 1 rle with old method : 0.0750584602355957 time for calcul the mask position with numpy : 0.025220394134521484 nb_pixel_total : 181319 time to create 1 rle with new method : 0.7480566501617432 create new chi : 3.7176406383514404 time to delete rle : 0.000993490219116211 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 6930 TO DO : save crop sub photo not yet done ! save time : 0.4534323215484619 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 9.99129343032837 time for calcul the mask position with numpy : 0.8095686435699463 nb_pixel_total : 7702840 time to create 1 rle with new method : 1.1548802852630615 time for calcul the mask position with numpy : 0.02585148811340332 nb_pixel_total : 159511 time to create 1 rle with new method : 0.9639840126037598 time for calcul the mask position with numpy : 0.024220705032348633 nb_pixel_total : 20039 time to create 1 rle with old method : 0.021426916122436523 time for calcul the mask position with numpy : 0.0242459774017334 nb_pixel_total : 9553 time to create 1 rle with old method : 0.009955167770385742 time for calcul the mask position with numpy : 0.023866891860961914 nb_pixel_total : 18867 time to create 1 rle with old method : 0.020323991775512695 time for calcul the mask position with numpy : 0.02360248565673828 nb_pixel_total : 14656 time to create 1 rle with old method : 0.01570296287536621 time for calcul the mask position with numpy : 0.026033878326416016 nb_pixel_total : 20389 time to create 1 rle with old method : 0.022464513778686523 time for calcul the mask position with numpy : 0.025292634963989258 nb_pixel_total : 41765 time to create 1 rle with old method : 0.044759273529052734 time for calcul the mask position with numpy : 0.030714988708496094 nb_pixel_total : 120243 time to create 1 rle with old method : 0.1279590129852295 time for calcul the mask position with numpy : 0.024494647979736328 nb_pixel_total : 67717 time to create 1 rle with old method : 0.07274985313415527 time for calcul the mask position with numpy : 0.02364182472229004 nb_pixel_total : 12726 time to create 1 rle with old method : 0.013888835906982422 time for calcul the mask position with numpy : 0.024535179138183594 nb_pixel_total : 2616 time to create 1 rle with old method : 0.002952098846435547 time for calcul the mask position with numpy : 0.026121854782104492 nb_pixel_total : 90271 time to create 1 rle with old method : 0.09473896026611328 time for calcul the mask position with numpy : 0.024183988571166992 nb_pixel_total : 13207 time to create 1 rle with old method : 0.013498544692993164 create new chi : 3.7823781967163086 time to delete rle : 0.0011448860168457031 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 8306 TO DO : save crop sub photo not yet done ! save time : 0.54459547996521 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 4.390676736831665 time for calcul the mask position with numpy : 0.9360496997833252 nb_pixel_total : 7801925 time to create 1 rle with new method : 1.0631422996520996 time for calcul the mask position with numpy : 0.024320602416992188 nb_pixel_total : 26541 time to create 1 rle with old method : 0.028846263885498047 time for calcul the mask position with numpy : 0.023075103759765625 nb_pixel_total : 71943 time to create 1 rle with old method : 0.07493114471435547 time for calcul the mask position with numpy : 0.024501562118530273 nb_pixel_total : 117249 time to create 1 rle with old method : 0.12314462661743164 time for calcul the mask position with numpy : 0.02311873435974121 nb_pixel_total : 48566 time to create 1 rle with old method : 0.04976701736450195 time for calcul the mask position with numpy : 0.023882389068603516 nb_pixel_total : 24475 time to create 1 rle with old method : 0.02532792091369629 time for calcul the mask position with numpy : 0.024523258209228516 nb_pixel_total : 58970 time to create 1 rle with old method : 0.06116676330566406 time for calcul the mask position with numpy : 0.024529695510864258 nb_pixel_total : 144731 time to create 1 rle with old method : 0.15467500686645508 create new chi : 2.7354633808135986 time to delete rle : 0.0012540817260742188 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 6804 TO DO : save crop sub photo not yet done ! save time : 0.43776774406433105 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.408350706100464 time for calcul the mask position with numpy : 1.1520748138427734 nb_pixel_total : 7976804 time to create 1 rle with new method : 1.7234108448028564 time for calcul the mask position with numpy : 0.028220415115356445 nb_pixel_total : 41370 time to create 1 rle with old method : 0.04855060577392578 time for calcul the mask position with numpy : 0.024683475494384766 nb_pixel_total : 53638 time to create 1 rle with old method : 0.056938886642456055 time for calcul the mask position with numpy : 0.025613069534301758 nb_pixel_total : 72542 time to create 1 rle with old method : 0.0766758918762207 time for calcul the mask position with numpy : 0.024658918380737305 nb_pixel_total : 150046 time to create 1 rle with new method : 0.9700484275817871 create new chi : 4.198930740356445 time to delete rle : 0.0006592273712158203 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 4754 TO DO : save crop sub photo not yet done ! save time : 0.3288564682006836 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 4.650785446166992 time for calcul the mask position with numpy : 0.8360595703125 nb_pixel_total : 7784842 time to create 1 rle with new method : 1.1902446746826172 time for calcul the mask position with numpy : 0.023828744888305664 nb_pixel_total : 84997 time to create 1 rle with old method : 0.08889508247375488 time for calcul the mask position with numpy : 0.023623943328857422 nb_pixel_total : 35371 time to create 1 rle with old method : 0.037927865982055664 time for calcul the mask position with numpy : 0.02376580238342285 nb_pixel_total : 24913 time to create 1 rle with old method : 0.02583456039428711 time for calcul the mask position with numpy : 0.023765087127685547 nb_pixel_total : 84844 time to create 1 rle with old method : 0.08873581886291504 time for calcul the mask position with numpy : 0.02887129783630371 nb_pixel_total : 199393 time to create 1 rle with new method : 1.2935850620269775 time for calcul the mask position with numpy : 0.02503228187561035 nb_pixel_total : 80040 time to create 1 rle with old method : 0.08168840408325195 create new chi : 3.8574469089508057 time to delete rle : 0.0008537769317626953 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 6478 TO DO : save crop sub photo not yet done ! save time : 0.4227113723754883 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 3.6455190181732178 time for calcul the mask position with numpy : 1.1147165298461914 nb_pixel_total : 7947161 time to create 1 rle with new method : 0.9595630168914795 time for calcul the mask position with numpy : 0.03865647315979004 nb_pixel_total : 164513 time to create 1 rle with new method : 1.2642207145690918 time for calcul the mask position with numpy : 0.03812766075134277 nb_pixel_total : 20578 time to create 1 rle with old method : 0.021569013595581055 time for calcul the mask position with numpy : 0.03912830352783203 nb_pixel_total : 37515 time to create 1 rle with old method : 0.04038429260253906 time for calcul the mask position with numpy : 0.023428916931152344 nb_pixel_total : 41568 time to create 1 rle with old method : 0.043730974197387695 time for calcul the mask position with numpy : 0.023549318313598633 nb_pixel_total : 83065 time to create 1 rle with old method : 0.08838605880737305 create new chi : 3.757822036743164 time to delete rle : 0.0016067028045654297 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 5086 TO DO : save crop sub photo not yet done ! save time : 0.34068751335144043 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 2.842191219329834 time for calcul the mask position with numpy : 1.488539218902588 nb_pixel_total : 8145465 time to create 1 rle with new method : 1.1454641819000244 time for calcul the mask position with numpy : 0.039774179458618164 nb_pixel_total : 110940 time to create 1 rle with old method : 0.1202852725982666 time for calcul the mask position with numpy : 0.0316619873046875 nb_pixel_total : 20165 time to create 1 rle with old method : 0.020688295364379883 time for calcul the mask position with numpy : 0.024384021759033203 nb_pixel_total : 17830 time to create 1 rle with old method : 0.018892526626586914 create new chi : 2.933006763458252 time to delete rle : 0.0006241798400878906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3756 TO DO : save crop sub photo not yet done ! save time : 0.2695317268371582 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.981431722640991 time for calcul the mask position with numpy : 1.2227790355682373 nb_pixel_total : 8181837 time to create 1 rle with new method : 0.9552106857299805 time for calcul the mask position with numpy : 0.024509906768798828 nb_pixel_total : 22626 time to create 1 rle with old method : 0.023456335067749023 time for calcul the mask position with numpy : 0.023511409759521484 nb_pixel_total : 48144 time to create 1 rle with old method : 0.050911903381347656 time for calcul the mask position with numpy : 0.025935888290405273 nb_pixel_total : 22987 time to create 1 rle with old method : 0.025158166885375977 time for calcul the mask position with numpy : 0.024323463439941406 nb_pixel_total : 18806 time to create 1 rle with old method : 0.01988053321838379 create new chi : 2.4370288848876953 time to delete rle : 0.0006895065307617188 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3882 TO DO : save crop sub photo not yet done ! save time : 0.2731151580810547 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 3.6880950927734375 time for calcul the mask position with numpy : 0.554755449295044 nb_pixel_total : 8075297 time to create 1 rle with new method : 1.9654185771942139 time for calcul the mask position with numpy : 0.04079866409301758 nb_pixel_total : 100680 time to create 1 rle with old method : 0.10609912872314453 time for calcul the mask position with numpy : 0.024555206298828125 nb_pixel_total : 9908 time to create 1 rle with old method : 0.010431766510009766 time for calcul the mask position with numpy : 0.02448129653930664 nb_pixel_total : 21725 time to create 1 rle with old method : 0.022784709930419922 time for calcul the mask position with numpy : 0.023123741149902344 nb_pixel_total : 66082 time to create 1 rle with old method : 0.0688023567199707 time for calcul the mask position with numpy : 0.022953271865844727 nb_pixel_total : 20708 time to create 1 rle with old method : 0.022047996520996094 create new chi : 2.9262735843658447 time to delete rle : 0.0007255077362060547 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 4368 TO DO : save crop sub photo not yet done ! save time : 0.30791711807250977 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 2.5968000888824463 time for calcul the mask position with numpy : 0.4041104316711426 nb_pixel_total : 3952129 time to create 1 rle with new method : 1.0989911556243896 time for calcul the mask position with numpy : 0.5078020095825195 nb_pixel_total : 4295533 time to create 1 rle with new method : 1.0047202110290527 time for calcul the mask position with numpy : 0.026805877685546875 nb_pixel_total : 25350 time to create 1 rle with old method : 0.027030467987060547 time for calcul the mask position with numpy : 0.024510622024536133 nb_pixel_total : 21388 time to create 1 rle with old method : 0.021854400634765625 create new chi : 3.187440872192383 time to delete rle : 0.0010366439819335938 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 6829 TO DO : save crop sub photo not yet done ! save time : 0.4465351104736328 map_output_result : {1403692120: (0.0, 'Should be the crop_list due to order', 0), 1403692114: (0.0, 'Should be the crop_list due to order', 0), 1403692092: (0.0, 'Should be the crop_list due to order', 0), 1403692088: (0.0, 'Should be the crop_list due to order', 0), 1403692077: (0.0, 'Should be the crop_list due to order', 0), 1403692039: (0.0, 'Should be the crop_list due to order', 0), 1403692016: (0.0, 'Should be the crop_list due to order', 0), 1403691978: (0.0, 'Should be the crop_list due to order', 0), 1403691191: (0.0, 'Should be the crop_list due to order', 0), 1403691189: (0.0, 'Should be the crop_list due to order', 0), 1403691174: (0.0, 'Should be the crop_list due to order', 0), 1403691159: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1403692120, 1403692114, 1403692092, 1403692088, 1403692077, 1403692039, 1403692016, 1403691978, 1403691191, 1403691189, 1403691174, 1403691159] Looping around the photos to save general results len do output : 12 /1403692120.Didn't retrieve data . /1403692114.Didn't retrieve data . /1403692092.Didn't retrieve data . /1403692088.Didn't retrieve data . /1403692077.Didn't retrieve data . /1403692039.Didn't retrieve data . /1403692016.Didn't retrieve data . /1403691978.Didn't retrieve data . /1403691191.Didn't retrieve data . /1403691189.Didn't retrieve data . /1403691174.Didn't retrieve data . /1403691159.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692120', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692114', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692092', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692088', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692077', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692039', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692016', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691978', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691191', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691189', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691174', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691159', None, None, None, None, None, '4329691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.015758514404296875 save_final save missing photos in datou_result : time spend for datou_step_exec : 100.9493637084961 time spend to save output : 0.01625800132751465 total time spend for step 3 : 100.96562170982361 step4:ventilate_hashtags_in_portfolio Tue Jan 13 19:44:49 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30105368 get user id for portfolio 30105368 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30105368 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','papier','pet_clair','mal_croppe','pehd','metal','flou','background','autre','environnement','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30105368 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','papier','pet_clair','mal_croppe','pehd','metal','flou','background','autre','environnement','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30105368 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','papier','pet_clair','mal_croppe','pehd','metal','flou','background','autre','environnement','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30105458,30105459,30105460,30105461,30105462,30105463,30105464,30105465,30105466,30105467,30105468?tags=carton,papier,pet_clair,mal_croppe,pehd,metal,flou,background,autre,environnement,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1403692120, 1403692114, 1403692092, 1403692088, 1403692077, 1403692039, 1403692016, 1403691978, 1403691191, 1403691189, 1403691174, 1403691159] Looping around the photos to save general results len do output : 1 /30105368. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692120', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692114', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692092', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692088', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692077', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692039', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692016', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691978', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691191', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691189', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691174', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691159', None, None, None, None, None, '4329691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.018992900848388672 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9778788089752197 time spend to save output : 0.0193936824798584 total time spend for step 4 : 1.9972724914550781 step5:final Tue Jan 13 19:44:51 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1403692120: ('0.09354384685249487',), 1403692114: ('0.09354384685249487',), 1403692092: ('0.09354384685249487',), 1403692088: ('0.09354384685249487',), 1403692077: ('0.09354384685249487',), 1403692039: ('0.09354384685249487',), 1403692016: ('0.09354384685249487',), 1403691978: ('0.09354384685249487',), 1403691191: ('0.09354384685249487',), 1403691189: ('0.09354384685249487',), 1403691174: ('0.09354384685249487',), 1403691159: ('0.09354384685249487',)} new output for save of step final : {1403692120: ('0.09354384685249487',), 1403692114: ('0.09354384685249487',), 1403692092: ('0.09354384685249487',), 1403692088: ('0.09354384685249487',), 1403692077: ('0.09354384685249487',), 1403692039: ('0.09354384685249487',), 1403692016: ('0.09354384685249487',), 1403691978: ('0.09354384685249487',), 1403691191: ('0.09354384685249487',), 1403691189: ('0.09354384685249487',), 1403691174: ('0.09354384685249487',), 1403691159: ('0.09354384685249487',)} [1403692120, 1403692114, 1403692092, 1403692088, 1403692077, 1403692039, 1403692016, 1403691978, 1403691191, 1403691189, 1403691174, 1403691159] Looping around the photos to save general results len do output : 12 /1403692120.Didn't retrieve data . /1403692114.Didn't retrieve data . /1403692092.Didn't retrieve data . /1403692088.Didn't retrieve data . /1403692077.Didn't retrieve data . /1403692039.Didn't retrieve data . /1403692016.Didn't retrieve data . /1403691978.Didn't retrieve data . /1403691191.Didn't retrieve data . /1403691189.Didn't retrieve data . /1403691174.Didn't retrieve data . /1403691159.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692120', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692114', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692092', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692088', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692077', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692039', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692016', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691978', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691191', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691189', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691174', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691159', None, None, None, None, None, '4329691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.015741348266601562 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14437437057495117 time spend to save output : 0.016376972198486328 total time spend for step 5 : 0.1607513427734375 step6:blur_detection Tue Jan 13 19:44:51 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84.jpg resize: (2160, 3840) 1403692120 -6.1395760494335 treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b.jpg resize: (2160, 3840) 1403692114 -7.13730896157548 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601.jpg resize: (2160, 3840) 1403692092 -7.191275140438561 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510.jpg resize: (2160, 3840) 1403692088 -7.009343167479014 treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41.jpg resize: (2160, 3840) 1403692077 -6.969920969338931 treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0.jpg resize: (2160, 3840) 1403692039 -6.8515822947313145 treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a.jpg resize: (2160, 3840) 1403692016 -7.060410310337907 treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e.jpg resize: (2160, 3840) 1403691978 -6.408207422844236 treat image : temp/1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85.jpg resize: (2160, 3840) 1403691191 -7.029083613625262 treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605.jpg resize: (2160, 3840) 1403691189 -6.960328296487165 treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6.jpg resize: (2160, 3840) 1403691174 -6.788822400378863 treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98.jpg resize: (2160, 3840) 1403691159 -3.9326481281477927 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885824_0.png resize: (223, 235) 1403696660 -3.7476992204895594 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885826_0.png resize: (236, 199) 1403696661 -4.31162852605912 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885827_0.png resize: (224, 197) 1403696662 -4.113410400710247 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885828_0.png resize: (193, 199) 1403696663 -3.9308964196532807 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885829_0.png resize: (210, 179) 1403696664 -5.1666486068309485 treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885839_0.png resize: (506, 460) 1403696665 -5.369335308240498 treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885841_0.png resize: (328, 238) 1403696666 -5.580118385078203 treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885843_0.png resize: (135, 184) 1403696667 -4.668944679117393 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885845_0.png resize: (462, 494) 1403696668 -5.40180002097543 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885846_0.png resize: (305, 367) 1403696670 -4.1771604412174215 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885847_0.png resize: (76, 163) 1403696671 -3.5336649102379383 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885850_0.png resize: (297, 275) 1403696672 -4.727375958289427 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885855_0.png resize: (613, 248) 1403696673 -5.1917803979964186 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885856_0.png resize: (251, 133) 1403696674 -4.743651278207827 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885858_0.png resize: (336, 447) 1403696675 -4.741724904766729 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885861_0.png resize: (147, 205) 1403696676 -4.0726764661805746 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885863_0.png resize: (193, 131) 1403696677 -3.5670460563805664 treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885870_0.png resize: (299, 233) 1403696678 -4.005979891699164 treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885876_0.png resize: (308, 273) 1403696679 -4.347378090624238 treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885878_0.png resize: (334, 499) 1403696680 -3.746096404231001 treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885881_0.png resize: (248, 132) 1403696681 -3.4543475537940784 treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885887_0.png resize: (143, 195) 1403696682 -3.7412850823656365 treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885888_0.png resize: (373, 724) 1403696683 -4.958706411969145 treat image : temp/1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85_rle_crop_4098885890_0.png resize: (139, 170) 1403696684 -4.721790095612721 treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885893_0.png resize: (189, 150) 1403696685 -3.2091465998023794 treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885894_0.png resize: (296, 414) 1403696686 -3.8397251959603014 treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885898_0.png resize: (183, 280) 1403696687 -3.8244061936044265 treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885899_0.png resize: (119, 109) 1403696688 -3.3610126636484985 treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885904_0.png resize: (140, 179) 1403696689 -4.34964105561862 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885833_0.png resize: (693, 886) 1403696743 -3.030544520597259 treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885842_0.png resize: (251, 153) 1403696745 -1.4416281547455523 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885849_0.png resize: (180, 200) 1403696746 -3.411117057572975 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885857_0.png resize: (140, 128) 1403696747 -2.4013044479721497 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885859_0.png resize: (398, 348) 1403696749 -3.8863452782516306 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885860_0.png resize: (232, 250) 1403696750 -4.100931319927097 treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885869_0.png resize: (274, 143) 1403696751 -4.1687346473208535 treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885882_0.png resize: (145, 354) 1403696753 -2.2013542588028923 treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885885_0.png resize: (236, 255) 1403696754 -3.4365399890585695 treat image : temp/1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85_rle_crop_4098885889_0.png resize: (153, 172) 1403696755 -2.933143686774027 treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885895_0.png resize: (194, 154) 1403696757 -3.0149809802822958 treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885901_0.png resize: (170, 209) 1403696758 -3.313080759560622 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885830_0.png resize: (312, 200) 1403696788 -5.154043734975033 treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885886_0.png resize: (284, 161) 1403696790 -4.276709892276677 treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885897_0.png resize: (250, 332) 1403696791 -5.429949835653046 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885825_0.png resize: (353, 567) 1403696815 -4.378252769792025 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885831_0.png resize: (466, 501) 1403696816 -6.114024005015041 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885834_0.png resize: (287, 314) 1403696817 -4.577211896458543 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885835_0.png resize: (379, 943) 1403696818 -2.716629133336492 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885836_0.png resize: (280, 209) 1403696819 -4.511110008724839 treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885837_0.png resize: (329, 407) 1403696820 -5.182558596544832 treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885840_0.png resize: (249, 454) 1403696821 -5.703131239002477 treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885844_0.png resize: (203, 397) 1403696822 -3.022042112111622 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885848_0.png resize: (351, 406) 1403696823 -5.320456136577432 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885851_0.png resize: (82, 250) 1403696824 -4.362210546832892 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885853_0.png resize: (346, 366) 1403696825 -5.725534649146836 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885854_0.png resize: (88, 171) 1403696826 -2.7174265046032464 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885862_0.png resize: (132, 164) 1403696827 -4.059404956287639 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885864_0.png resize: (153, 93) 1403696828 -3.898828636300458 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885865_0.png resize: (131, 188) 1403696829 -4.64024970605541 treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885866_0.png resize: (295, 660) 1403696830 -5.2152892568897995 treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885867_0.png resize: (395, 443) 1403696832 -4.126602106752264 treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885868_0.png resize: (306, 279) 1403696833 -4.71071922072126 treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885871_0.png resize: (364, 394) 1403696835 -6.025661649408521 treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885872_0.png resize: (367, 286) 1403696836 -5.532033357932794 treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885873_0.png resize: (193, 176) 1403696837 -3.858637616612645 treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885874_0.png resize: (417, 491) 1403696838 -5.0313293323286175 treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885875_0.png resize: (277, 326) 1403696839 -4.798498329909443 treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885877_0.png resize: (159, 417) 1403696841 -4.184793422171079 treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885879_0.png resize: (445, 513) 1403696842 -5.275487328358962 treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885880_0.png resize: (423, 326) 1403696843 -4.851447553094034 treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885883_0.png resize: (342, 362) 1403696844 -5.414534189990572 treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885884_0.png resize: (377, 262) 1403696845 -4.8262632059253985 treat image : temp/1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85_rle_crop_4098885891_0.png resize: (497, 323) 1403696846 -5.87920476992935 treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885900_0.png resize: (283, 574) 1403696847 -3.6017922039006063 treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885902_0.png resize: (232, 163) 1403696848 -4.585054796549662 treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885903_0.png resize: (1935, 2445) 1403696849 -4.2382885692779455 treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885832_0.png resize: (171, 177) 1403696851 -2.549640596177761 treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885838_0.png resize: (114, 107) 1403696853 -3.7681552747521763 treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885852_0.png resize: (108, 107) 1403696854 -3.409617721041761 treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885892_0.png resize: (150, 165) 1403696855 -3.6228192156668713 treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885896_0.png resize: (166, 158) 1403696856 -2.6836050845167643 treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885905_0.png resize: (91, 181) 1403696857 -4.140901088937262 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 94 time used for this insertion : 0.019120216369628906 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 94 time used for this insertion : 0.018985986709594727 save missing photos in datou_result : time spend for datou_step_exec : 60.17876887321472 time spend to save output : 0.04428267478942871 total time spend for step 6 : 60.22305154800415 step7:brightness Tue Jan 13 19:45:51 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84.jpg treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b.jpg treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601.jpg treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510.jpg treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41.jpg treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0.jpg treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a.jpg treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e.jpg treat image : temp/1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85.jpg treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605.jpg treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6.jpg treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98.jpg treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885824_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885826_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885827_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885828_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885829_0.png treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885839_0.png treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885841_0.png treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885843_0.png treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885845_0.png treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885846_0.png treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885847_0.png treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885850_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885855_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885856_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885858_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885861_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885863_0.png treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885870_0.png treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885876_0.png treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885878_0.png treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885881_0.png treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885887_0.png treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885888_0.png treat image : temp/1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85_rle_crop_4098885890_0.png treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885893_0.png treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885894_0.png treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885898_0.png treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885899_0.png treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885904_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885833_0.png treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885842_0.png treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885849_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885857_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885859_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885860_0.png treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885869_0.png treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885882_0.png treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885885_0.png treat image : temp/1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85_rle_crop_4098885889_0.png treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885895_0.png treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885901_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885830_0.png treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885886_0.png treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885897_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885825_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885831_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885834_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885835_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885836_0.png treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885837_0.png treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885840_0.png treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885844_0.png treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885848_0.png treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885851_0.png treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885853_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885854_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885862_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885864_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885865_0.png treat image : temp/1768329628_1162243_1403692088_0d2509e84423b735dd56b3e2fb44d510_rle_crop_4098885866_0.png treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885867_0.png treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885868_0.png treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885871_0.png treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885872_0.png treat image : temp/1768329628_1162243_1403692077_e4496f33058024b8ad079b08eb839d41_rle_crop_4098885873_0.png treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885874_0.png treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885875_0.png treat image : temp/1768329628_1162243_1403692039_2cd8e672f8389e18d01440e6ba3d06d0_rle_crop_4098885877_0.png treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885879_0.png treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885880_0.png treat image : temp/1768329628_1162243_1403692016_6b130725c4f12b917f04f44feffe2a2a_rle_crop_4098885883_0.png treat image : temp/1768329628_1162243_1403691978_d9922e9bfc4b1dd7b40cd33140a7d74e_rle_crop_4098885884_0.png treat image : temp/1768329628_1162243_1403691191_e4af3d6b40cf53d32e5646ff487e5c85_rle_crop_4098885891_0.png treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885900_0.png treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885902_0.png treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885903_0.png treat image : temp/1768329628_1162243_1403692120_8dc8227994feb9fbcf3a239aed88dc84_rle_crop_4098885832_0.png treat image : temp/1768329628_1162243_1403692114_f1dccb0014c62ede6181a68543be483b_rle_crop_4098885838_0.png treat image : temp/1768329628_1162243_1403692092_a022102640af065d0bad4ca1fb543601_rle_crop_4098885852_0.png treat image : temp/1768329628_1162243_1403691189_85ba5f7fec138521057debeeee272605_rle_crop_4098885892_0.png treat image : temp/1768329628_1162243_1403691174_8006cc6087bb3a597878d57d37be29f6_rle_crop_4098885896_0.png treat image : temp/1768329628_1162243_1403691159_96c4c5023b78e040e234228170274a98_rle_crop_4098885905_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 94 time used for this insertion : 0.0173189640045166 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 94 time used for this insertion : 0.019466161727905273 save missing photos in datou_result : time spend for datou_step_exec : 14.144882678985596 time spend to save output : 0.0431368350982666 total time spend for step 7 : 14.188019514083862 step8:velours_tree Tue Jan 13 19:46:05 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.24427318572998047 time spend to save output : 4.267692565917969e-05 total time spend for step 8 : 0.24431586265563965 step9:send_mail_cod Tue Jan 13 19:46:06 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30105368_13-01-2026_19_46_06.pdf 30105458 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301054581768329966 30105459 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301054591768329967 30105460 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301054601768329969 30105461 imagette301054611768329971 30105462 imagette301054621768329971 30105463 change filename to text .change filename to text .change filename to text .imagette301054631768329971 30105464 imagette301054641768329972 30105465 imagette301054651768329972 30105466 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301054661768329972 30105468 imagette301054681768329972 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30105368 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30105458,30105459,30105460,30105461,30105462,30105463,30105464,30105465,30105466,30105467,30105468?tags=carton,papier,pet_clair,mal_croppe,pehd,metal,flou,background,autre,environnement,pet_fonce your option no_mail is active, we will not send the real mail to your client args[1403692120] : ((1403692120, -6.1395760494335, 492609224), (1403692120, -0.4283752750765103, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403692114] : ((1403692114, -7.13730896157548, 492609224), (1403692114, -0.294395113969625, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403692092] : ((1403692092, -7.191275140438561, 492609224), (1403692092, -0.2580665096096226, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403692088] : ((1403692088, -7.009343167479014, 492609224), (1403692088, -0.19409848060881899, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403692077] : ((1403692077, -6.969920969338931, 492609224), (1403692077, -0.2973766825262774, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403692039] : ((1403692039, -6.8515822947313145, 492609224), (1403692039, -0.28021734484658856, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403692016] : ((1403692016, -7.060410310337907, 492609224), (1403692016, -0.17158258260127743, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403691978] : ((1403691978, -6.408207422844236, 492609224), (1403691978, -0.400664757847704, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403691191] : ((1403691191, -7.029083613625262, 492609224), (1403691191, -0.2620363102917238, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403691189] : ((1403691189, -6.960328296487165, 492609224), (1403691189, -0.35055149224845467, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403691174] : ((1403691174, -6.788822400378863, 492609224), (1403691174, -0.22561673546477595, 496442774), '0.09354384685249487') We are sending mail with results at report@fotonower.com args[1403691159] : ((1403691159, -3.9326481281477927, 492609224), (1403691159, -2.709034403173925, 501862349), '0.09354384685249487') We are sending mail with results at report@fotonower.com refus_total : 0.09354384685249487 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30105368 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30105368_13-01-2026_19_46_06.pdf results_Auto_P30105368_13-01-2026_19_46_06.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30105368_13-01-2026_19_46_06.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30105368','results_Auto_P30105368_13-01-2026_19_46_06.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30105368_13-01-2026_19_46_06.pdf','pdf','','1.23','0.09354384685249487') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1403692120, 1403692114, 1403692092, 1403692088, 1403692077, 1403692039, 1403692016, 1403691978, 1403691191, 1403691189, 1403691174, 1403691159] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692120', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692114', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692092', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692088', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692077', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692039', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692016', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691978', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691191', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691189', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691174', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691159', None, None, None, None, None, '4329691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.015008687973022461 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.971652507781982 time spend to save output : 0.015353679656982422 total time spend for step 9 : 9.987006187438965 step10:split_time_score Tue Jan 13 19:46:16 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13012026 30105368 Nombre de photos uploadées : 12 / 23040 (0%) 13012026 30105368 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 13012026 30105368 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007884502410888672 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.25509166717529297 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.10104790200367852 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30098288_13-01-2026_07_11_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30098288 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30098288 AND mptpi.`type`=3726 To do Qualite : 0.16873757749621032 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30098289_13-01-2026_07_10_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30098289 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30098289 AND mptpi.`type`=3726 To do Qualite : 0.07592311238974493 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30098290_13-01-2026_07_08_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30098290 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30098290 AND mptpi.`type`=3726 To do Qualite : 0.06411229654182356 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30098291_13-01-2026_07_10_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30098291 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30098291 AND mptpi.`type`=3726 To do Qualite : 0.0703580597856429 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30099737_13-01-2026_09_38_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30099737 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30099737 AND mptpi.`type`=3726 To do Qualite : 0.04496563198503982 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30098293_13-01-2026_07_08_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30098293 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30098293 AND mptpi.`type`=3726 To do Qualite : 0.012105069082044725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30098295_13-01-2026_07_07_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30098295 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30098295 AND mptpi.`type`=3726 To do Qualite : 0.09741533005807806 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30098297_13-01-2026_07_04_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30098297 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30098297 AND mptpi.`type`=3726 To do Qualite : 0.024502979104453627 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30099740_13-01-2026_09_40_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30099740 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30099740 AND mptpi.`type`=3726 To do Qualite : 0.013608277509382215 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30100793_13-01-2026_11_06_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30100793 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30100793 AND mptpi.`type`=3726 To do Qualite : 0.00449405136174602 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30100820_13-01-2026_11_05_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30100820 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30100820 AND mptpi.`type`=3726 To do Qualite : 0.04998877039241624 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30100824_13-01-2026_11_13_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30100824 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30100824 AND mptpi.`type`=3594 To do Qualite : 0.06743103708467783 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30101962_13-01-2026_15_38_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30101962 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30101962 AND mptpi.`type`=3726 To do Qualite : 0.015939207518959258 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30101963_13-01-2026_17_05_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30101963 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30101963 AND mptpi.`type`=3726 To do Qualite : 0.11519163501272865 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30104813_13-01-2026_18_08_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30104813 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30104813 AND mptpi.`type`=3726 To do Qualite : 0.034171073885555125 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30104815_13-01-2026_18_10_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30104815 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30104815 AND mptpi.`type`=3726 To do Qualite : 0.09354384685249487 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30105368_13-01-2026_19_46_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30105368 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30105368 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13012026': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1403692120, 1403692114, 1403692092, 1403692088, 1403692077, 1403692039, 1403692016, 1403691978, 1403691191, 1403691189, 1403691174, 1403691159] Looping around the photos to save general results len do output : 1 /30105368Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692120', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692114', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692092', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692088', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692077', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692039', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403692016', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691978', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691191', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691189', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691174', None, None, None, None, None, '4329691') ('3318', None, None, None, None, None, None, None, '4329691') ('3318', '30105368', '1403691159', None, None, None, None, None, '4329691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.015677690505981445 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.67769193649292 time spend to save output : 0.01595306396484375 total time spend for step 10 : 1.6936450004577637 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 148.81user 164.63system 5:52.63elapsed 88%CPU (0avgtext+0avgdata 4595508maxresident)k 2338960inputs+183144outputs (11985major+12444091minor)pagefaults 0swaps