python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 476225 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4019264'] with mtr_portfolio_ids : ['28325353'] and first list_photo_ids : [] new path : /proc/476225/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 25 ; length of list_pids : 25 ; length of list_args : 25 time to download the photos : 3.396540880203247 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Nov 7 20:10:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-07 20:10:35.320831: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-07 20:10:35.346537: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-07 20:10:35.348514: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f272c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-07 20:10:35.348561: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-07 20:10:35.352151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-07 20:10:35.656181: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x21816a20 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-07 20:10:35.656223: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-07 20:10:35.657726: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-07 20:10:35.658124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-07 20:10:35.661154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-07 20:10:35.663754: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-07 20:10:35.664186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-07 20:10:35.666669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-07 20:10:35.667919: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-07 20:10:35.672876: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-07 20:10:35.674616: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-07 20:10:35.674695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-07 20:10:35.675474: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-07 20:10:35.675489: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-07 20:10:35.675498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-07 20:10:35.676889: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-07 20:10:35.951573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-07 20:10:35.951656: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-07 20:10:35.951676: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-07 20:10:35.951694: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-07 20:10:35.951712: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-07 20:10:35.951729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-07 20:10:35.951746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-07 20:10:35.951764: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-07 20:10:35.953354: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-07 20:10:35.954665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-07 20:10:35.954701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-07 20:10:35.954719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-07 20:10:35.954736: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-07 20:10:35.954753: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-07 20:10:35.954769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-07 20:10:35.954786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-07 20:10:35.954811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-07 20:10:35.956402: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-07 20:10:35.956433: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-07 20:10:35.956443: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-07 20:10:35.956453: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-07 20:10:35.958081: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-07 20:10:43.869149: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-07 20:10:44.040319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 25 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 52.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 46.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 62.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 476844 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 417 tf kernel not reseted sub process len(results) : 25 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 25 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0001857280731201172 nb_pixel_total : 6249 time to create 1 rle with old method : 0.007044553756713867 length of segment : 66 time for calcul the mask position with numpy : 0.0001361370086669922 nb_pixel_total : 5728 time to create 1 rle with old method : 0.006501913070678711 length of segment : 82 time for calcul the mask position with numpy : 0.0002760887145996094 nb_pixel_total : 16778 time to create 1 rle with old method : 0.017895936965942383 length of segment : 128 time for calcul the mask position with numpy : 0.013874053955078125 nb_pixel_total : 776807 time to create 1 rle with new method : 0.20311212539672852 length of segment : 1009 time for calcul the mask position with numpy : 0.0002918243408203125 nb_pixel_total : 9823 time to create 1 rle with old method : 0.01213216781616211 length of segment : 118 time for calcul the mask position with numpy : 0.00044345855712890625 nb_pixel_total : 17420 time to create 1 rle with old method : 0.024285316467285156 length of segment : 215 time for calcul the mask position with numpy : 0.0001366138458251953 nb_pixel_total : 4869 time to create 1 rle with old method : 0.0071485042572021484 length of segment : 74 time for calcul the mask position with numpy : 0.0002474784851074219 nb_pixel_total : 13737 time to create 1 rle with old method : 0.016541481018066406 length of segment : 180 time for calcul the mask position with numpy : 0.001890420913696289 nb_pixel_total : 111568 time to create 1 rle with old method : 0.13343071937561035 length of segment : 528 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 15019 time to create 1 rle with old method : 0.017455339431762695 length of segment : 111 time for calcul the mask position with numpy : 0.00038552284240722656 nb_pixel_total : 21769 time to create 1 rle with old method : 0.02572321891784668 length of segment : 211 time for calcul the mask position with numpy : 0.00016427040100097656 nb_pixel_total : 9338 time to create 1 rle with old method : 0.010946035385131836 length of segment : 92 time for calcul the mask position with numpy : 0.0016150474548339844 nb_pixel_total : 105015 time to create 1 rle with old method : 0.11819267272949219 length of segment : 510 time for calcul the mask position with numpy : 0.001272439956665039 nb_pixel_total : 59855 time to create 1 rle with old method : 0.06697702407836914 length of segment : 217 time for calcul the mask position with numpy : 0.0008394718170166016 nb_pixel_total : 51595 time to create 1 rle with old method : 0.05780363082885742 length of segment : 196 time for calcul the mask position with numpy : 0.0004394054412841797 nb_pixel_total : 22484 time to create 1 rle with old method : 0.026373863220214844 length of segment : 84 time for calcul the mask position with numpy : 0.0021479129791259766 nb_pixel_total : 105433 time to create 1 rle with old method : 0.12366557121276855 length of segment : 521 time for calcul the mask position with numpy : 0.00044035911560058594 nb_pixel_total : 6415 time to create 1 rle with old method : 0.00802755355834961 length of segment : 107 time for calcul the mask position with numpy : 0.0009458065032958984 nb_pixel_total : 43287 time to create 1 rle with old method : 0.05299782752990723 length of segment : 235 time for calcul the mask position with numpy : 0.0006279945373535156 nb_pixel_total : 21188 time to create 1 rle with old method : 0.02336859703063965 length of segment : 268 time for calcul the mask position with numpy : 0.0187075138092041 nb_pixel_total : 1278047 time to create 1 rle with new method : 0.07770347595214844 length of segment : 1126 time for calcul the mask position with numpy : 0.0003819465637207031 nb_pixel_total : 8726 time to create 1 rle with old method : 0.011865615844726562 length of segment : 95 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 4025 time to create 1 rle with old method : 0.004825115203857422 length of segment : 76 time for calcul the mask position with numpy : 0.00016355514526367188 nb_pixel_total : 2907 time to create 1 rle with old method : 0.003404855728149414 length of segment : 65 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 4703 time to create 1 rle with old method : 0.005599498748779297 length of segment : 105 time for calcul the mask position with numpy : 0.0023326873779296875 nb_pixel_total : 99413 time to create 1 rle with old method : 0.14421415328979492 length of segment : 535 time for calcul the mask position with numpy : 0.015870332717895508 nb_pixel_total : 714444 time to create 1 rle with new method : 0.05268383026123047 length of segment : 1024 time for calcul the mask position with numpy : 0.015766620635986328 nb_pixel_total : 1245171 time to create 1 rle with new method : 0.21942400932312012 length of segment : 1604 time for calcul the mask position with numpy : 0.013988018035888672 nb_pixel_total : 729875 time to create 1 rle with new method : 0.04183244705200195 length of segment : 988 time for calcul the mask position with numpy : 0.0008974075317382812 nb_pixel_total : 21370 time to create 1 rle with old method : 0.024451732635498047 length of segment : 405 time for calcul the mask position with numpy : 0.0005624294281005859 nb_pixel_total : 31611 time to create 1 rle with old method : 0.034746408462524414 length of segment : 189 time for calcul the mask position with numpy : 0.015130758285522461 nb_pixel_total : 958006 time to create 1 rle with new method : 0.035536766052246094 length of segment : 1003 time for calcul the mask position with numpy : 0.0012216567993164062 nb_pixel_total : 43633 time to create 1 rle with old method : 0.04723191261291504 length of segment : 368 time for calcul the mask position with numpy : 0.0024356842041015625 nb_pixel_total : 103748 time to create 1 rle with old method : 0.11347532272338867 length of segment : 529 time for calcul the mask position with numpy : 0.00032258033752441406 nb_pixel_total : 16266 time to create 1 rle with old method : 0.018937349319458008 length of segment : 108 time for calcul the mask position with numpy : 0.0002651214599609375 nb_pixel_total : 9617 time to create 1 rle with old method : 0.011141777038574219 length of segment : 166 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 4244 time to create 1 rle with old method : 0.005182743072509766 length of segment : 66 time for calcul the mask position with numpy : 0.0001404285430908203 nb_pixel_total : 6137 time to create 1 rle with old method : 0.0069713592529296875 length of segment : 82 time for calcul the mask position with numpy : 0.00021958351135253906 nb_pixel_total : 6412 time to create 1 rle with old method : 0.007264614105224609 length of segment : 84 time for calcul the mask position with numpy : 0.0005004405975341797 nb_pixel_total : 19171 time to create 1 rle with old method : 0.02168440818786621 length of segment : 140 time for calcul the mask position with numpy : 0.00022840499877929688 nb_pixel_total : 5618 time to create 1 rle with old method : 0.006560087203979492 length of segment : 71 time for calcul the mask position with numpy : 0.0005903244018554688 nb_pixel_total : 29996 time to create 1 rle with old method : 0.032808542251586914 length of segment : 191 time for calcul the mask position with numpy : 0.0011739730834960938 nb_pixel_total : 57267 time to create 1 rle with old method : 0.06392478942871094 length of segment : 285 time for calcul the mask position with numpy : 0.0002455711364746094 nb_pixel_total : 10397 time to create 1 rle with old method : 0.011755943298339844 length of segment : 88 time for calcul the mask position with numpy : 0.00021314620971679688 nb_pixel_total : 7236 time to create 1 rle with old method : 0.007871150970458984 length of segment : 104 time for calcul the mask position with numpy : 0.0003075599670410156 nb_pixel_total : 13198 time to create 1 rle with old method : 0.014106035232543945 length of segment : 172 time for calcul the mask position with numpy : 0.0003178119659423828 nb_pixel_total : 11747 time to create 1 rle with old method : 0.012423276901245117 length of segment : 131 time for calcul the mask position with numpy : 0.0013132095336914062 nb_pixel_total : 67342 time to create 1 rle with old method : 0.07461023330688477 length of segment : 359 time for calcul the mask position with numpy : 0.011811494827270508 nb_pixel_total : 489340 time to create 1 rle with new method : 0.0213472843170166 length of segment : 998 time for calcul the mask position with numpy : 0.00017023086547851562 nb_pixel_total : 9006 time to create 1 rle with old method : 0.010361909866333008 length of segment : 122 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 4915 time to create 1 rle with old method : 0.005759716033935547 length of segment : 118 time for calcul the mask position with numpy : 0.00012254714965820312 nb_pixel_total : 8559 time to create 1 rle with old method : 0.009822845458984375 length of segment : 55 time for calcul the mask position with numpy : 0.000453948974609375 nb_pixel_total : 22647 time to create 1 rle with old method : 0.026109933853149414 length of segment : 163 time for calcul the mask position with numpy : 0.0025014877319335938 nb_pixel_total : 117222 time to create 1 rle with old method : 0.1278526782989502 length of segment : 599 time for calcul the mask position with numpy : 0.00019812583923339844 nb_pixel_total : 10471 time to create 1 rle with old method : 0.011858940124511719 length of segment : 85 time for calcul the mask position with numpy : 0.002084016799926758 nb_pixel_total : 89460 time to create 1 rle with old method : 0.09615683555603027 length of segment : 492 time for calcul the mask position with numpy : 0.00019979476928710938 nb_pixel_total : 5128 time to create 1 rle with old method : 0.006118059158325195 length of segment : 42 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1836 time to create 1 rle with old method : 0.0022661685943603516 length of segment : 58 time for calcul the mask position with numpy : 0.0006792545318603516 nb_pixel_total : 32467 time to create 1 rle with old method : 0.035452842712402344 length of segment : 140 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 3134 time to create 1 rle with old method : 0.003767251968383789 length of segment : 38 time for calcul the mask position with numpy : 0.00016379356384277344 nb_pixel_total : 2729 time to create 1 rle with old method : 0.003017425537109375 length of segment : 106 time for calcul the mask position with numpy : 0.0005404949188232422 nb_pixel_total : 24544 time to create 1 rle with old method : 0.026735305786132812 length of segment : 190 time for calcul the mask position with numpy : 0.001905202865600586 nb_pixel_total : 103601 time to create 1 rle with old method : 0.10822796821594238 length of segment : 514 time spent for convertir_results : 5.813848495483398 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 63 chid ids of type : 3594 Number RLEs to save : 18831 save missing photos in datou_result : time spend for datou_step_exec : 39.96312761306763 time spend to save output : 1.253291130065918 total time spend for step 1 : 41.216418743133545 step2:crop_condition Fri Nov 7 20:11:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 25 ! batch 1 Loaded 63 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762542675_476225 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688310_0.png', 0, 98, 79, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688313_0.png', 0, 178, 118, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688315_0.png', 0, 91, 74, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175399_516970df24c5fc7ba49deecdfcef5c27_rle_crop_4025688328_0.png', 0, 152, 208, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175346_ced7499890096ecb1460dacd87261622_rle_crop_4025688330_0.png', 0, 141, 88, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688331_0.png', 0, 143, 74, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688332_0.png', 0, 54, 65, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958_rle_crop_4025688349_0.png', 0, 140, 71, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393173034_eb1c8295c9059b65d38f1046a281b7dc_rle_crop_4025688350_0.png', 0, 240, 167, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688352_0.png', 0, 172, 88, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688353_0.png', 0, 105, 104, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688354_0.png', 0, 113, 172, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688356_0.png', 0, 511, 227, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688358_0.png', 0, 105, 122, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542678), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42_rle_crop_4025688366_0.png', 0, 49, 58, 0, 1762542678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.5977768898010254 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762542680_476225 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542680), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688316_0.png', 0, 108, 171, 0, 1762542680,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542680), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688326_0.png', 0, 109, 89, 0, 1762542680,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542680), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958_rle_crop_4025688348_0.png', 0, 184, 129, 0, 1762542680,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0061702728271484 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 41 About to insert : list_path_to_insert length 41 new photo from crops ! About to upload 41 photos upload in portfolio : 3736932 init cache_photo without model_param we have 41 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762542710_476225 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688311_0.png', 0, 216, 120, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688312_0.png', 0, 1062, 999, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688314_0.png', 0, 113, 214, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688317_0.png', 0, 351, 526, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688318_0.png', 0, 194, 109, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688319_0.png', 0, 142, 211, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0_rle_crop_4025688320_0.png', 0, 133, 89, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0_rle_crop_4025688321_0.png', 0, 366, 507, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0_rle_crop_4025688322_0.png', 0, 336, 215, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175404_05e3d55c6f47fdccd29f395fea90478e_rle_crop_4025688323_0.png', 0, 394, 194, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688324_0.png', 0, 376, 70, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688325_0.png', 0, 319, 519, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688327_0.png', 0, 284, 226, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175399_516970df24c5fc7ba49deecdfcef5c27_rle_crop_4025688329_0.png', 0, 1539, 1006, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688333_0.png', 0, 50, 105, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688334_0.png', 0, 316, 530, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688335_0.png', 0, 1103, 977, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174678_51ac009aec0d5a353a6f838eee7a0a1e_rle_crop_4025688336_0.png', 0, 1738, 899, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174606_1f8ecd515499fc5b12b50f8df98ad90d_rle_crop_4025688337_0.png', 0, 999, 976, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174530_e3a1d69110e0ae45a947d611801e6fe6_rle_crop_4025688338_0.png', 0, 169, 254, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174081_15d84bb6563a7cb62958c33dc3d27f21_rle_crop_4025688339_0.png', 0, 216, 187, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174081_15d84bb6563a7cb62958c33dc3d27f21_rle_crop_4025688340_0.png', 0, 1117, 992, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688342_0.png', 0, 321, 526, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688343_0.png', 0, 207, 107, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688344_0.png', 0, 86, 166, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393173950_0957fde68224d0a9796db6a42af9022b_rle_crop_4025688345_0.png', 0, 95, 65, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393173950_0957fde68224d0a9796db6a42af9022b_rle_crop_4025688346_0.png', 0, 94, 82, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958_rle_crop_4025688347_0.png', 0, 97, 84, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393173034_eb1c8295c9059b65d38f1046a281b7dc_rle_crop_4025688351_0.png', 0, 594, 174, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688355_0.png', 0, 131, 131, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688357_0.png', 0, 660, 998, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688359_0.png', 0, 129, 118, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688361_0.png', 0, 254, 159, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172909_0126c69dc6adf8f630664ebe3ea0b4fc_rle_crop_4025688362_0.png', 0, 352, 586, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172909_0126c69dc6adf8f630664ebe3ea0b4fc_rle_crop_4025688363_0.png', 0, 153, 83, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42_rle_crop_4025688364_0.png', 0, 338, 486, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42_rle_crop_4025688365_0.png', 0, 145, 42, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf_rle_crop_4025688367_0.png', 0, 312, 140, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf_rle_crop_4025688368_0.png', 0, 100, 38, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172715_af13e5a6b8af0ca23221087d559cf848_rle_crop_4025688370_0.png', 0, 238, 166, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542718), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172715_af13e5a6b8af0ca23221087d559cf848_rle_crop_4025688371_0.png', 0, 318, 505, 0, 1762542718,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 41 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.629046201705933 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762542721_476225 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542721), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688341_0.png', 0, 167, 368, 0, 1762542721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542721), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf_rle_crop_4025688369_0.png', 0, 43, 109, 0, 1762542721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9098081588745117 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762542722_476225 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542723), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688309_0.png', 0, 136, 65, 0, 1762542723,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762542723), 0.0, 0.0, 14, '', 0, 0, '1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688360_0.png', 0, 196, 53, 0, 1762542723,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7834296226501465 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1393175979, 1393175929, 1393175407, 1393175404, 1393175401, 1393175399, 1393175386, 1393175346, 1393174890, 1393174821, 1393174745, 1393174678, 1393174606, 1393174530, 1393174081, 1393174028, 1393173990, 1393173950, 1393173912, 1393173034, 1393172968, 1393172909, 1393172827, 1393172762, 1393172715] Looping around the photos to save general results len do output : 63 /1393224122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393224286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175979', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175929', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175407', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175404', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175401', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175399', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175386', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175346', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174890', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174821', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174745', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174678', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174606', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174530', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174081', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174028', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173990', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173950', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173912', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173034', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172968', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172909', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172827', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172762', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172715', None, None, None, None, None, '4019264') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 214 time used for this insertion : 0.02342963218688965 save_final save missing photos in datou_result : time spend for datou_step_exec : 49.451504707336426 time spend to save output : 0.025551795959472656 total time spend for step 2 : 49.4770565032959 step3:rle_unique_nms_with_priority Fri Nov 7 20:12:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 63 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 1.2905316352844238 time for calcul the mask position with numpy : 0.04299783706665039 nb_pixel_total : 1258215 time to create 1 rle with new method : 0.5304498672485352 time for calcul the mask position with numpy : 0.0064334869384765625 nb_pixel_total : 9823 time to create 1 rle with old method : 0.010767221450805664 time for calcul the mask position with numpy : 0.016634702682495117 nb_pixel_total : 776807 time to create 1 rle with new method : 0.0791788101196289 time for calcul the mask position with numpy : 0.0063397884368896484 nb_pixel_total : 16778 time to create 1 rle with old method : 0.01875138282775879 time for calcul the mask position with numpy : 0.006520748138427734 nb_pixel_total : 5728 time to create 1 rle with old method : 0.006428241729736328 time for calcul the mask position with numpy : 0.006566047668457031 nb_pixel_total : 6249 time to create 1 rle with old method : 0.007128477096557617 create new chi : 0.7542967796325684 time to delete rle : 0.022247314453125 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3886 TO DO : save crop sub photo not yet done ! save time : 0.2666010856628418 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.34013962745666504 time for calcul the mask position with numpy : 0.062398433685302734 nb_pixel_total : 1889251 time to create 1 rle with new method : 0.09699797630310059 time for calcul the mask position with numpy : 0.006544589996337891 nb_pixel_total : 21769 time to create 1 rle with old method : 0.024300813674926758 time for calcul the mask position with numpy : 0.0063970088958740234 nb_pixel_total : 15019 time to create 1 rle with old method : 0.016735553741455078 time for calcul the mask position with numpy : 0.00677490234375 nb_pixel_total : 111535 time to create 1 rle with old method : 0.12323975563049316 time for calcul the mask position with numpy : 0.0058307647705078125 nb_pixel_total : 13737 time to create 1 rle with old method : 0.014352083206176758 time for calcul the mask position with numpy : 0.00580143928527832 nb_pixel_total : 4869 time to create 1 rle with old method : 0.005151987075805664 time for calcul the mask position with numpy : 0.005999326705932617 nb_pixel_total : 17420 time to create 1 rle with old method : 0.018528223037719727 create new chi : 0.40948939323425293 time to delete rle : 0.0005364418029785156 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 3683 TO DO : save crop sub photo not yet done ! save time : 0.2529888153076172 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06554412841796875 time for calcul the mask position with numpy : 0.03045487403869629 nb_pixel_total : 1899392 time to create 1 rle with new method : 0.0667276382446289 time for calcul the mask position with numpy : 0.006326913833618164 nb_pixel_total : 59855 time to create 1 rle with old method : 0.06486749649047852 time for calcul the mask position with numpy : 0.0068433284759521484 nb_pixel_total : 105015 time to create 1 rle with old method : 0.1174008846282959 time for calcul the mask position with numpy : 0.0065114498138427734 nb_pixel_total : 9338 time to create 1 rle with old method : 0.011937141418457031 create new chi : 0.3115968704223633 time to delete rle : 0.0003464221954345703 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2718 TO DO : save crop sub photo not yet done ! save time : 0.1933448314666748 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.041571855545043945 time for calcul the mask position with numpy : 0.01991724967956543 nb_pixel_total : 2022005 time to create 1 rle with new method : 0.10507082939147949 time for calcul the mask position with numpy : 0.006215572357177734 nb_pixel_total : 51595 time to create 1 rle with old method : 0.06179666519165039 create new chi : 0.19980382919311523 time to delete rle : 0.00042724609375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1472 TO DO : save crop sub photo not yet done ! save time : 0.1156167984008789 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.1123955249786377 time for calcul the mask position with numpy : 0.06872987747192383 nb_pixel_total : 1895981 time to create 1 rle with new method : 0.5899884700775146 time for calcul the mask position with numpy : 0.006779670715332031 nb_pixel_total : 43287 time to create 1 rle with old method : 0.04695701599121094 time for calcul the mask position with numpy : 0.006280422210693359 nb_pixel_total : 6415 time to create 1 rle with old method : 0.006814241409301758 time for calcul the mask position with numpy : 0.006627798080444336 nb_pixel_total : 105433 time to create 1 rle with old method : 0.1131901741027832 time for calcul the mask position with numpy : 0.00645756721496582 nb_pixel_total : 22484 time to create 1 rle with old method : 0.024929523468017578 create new chi : 0.8880898952484131 time to delete rle : 0.0005586147308349609 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2974 TO DO : save crop sub photo not yet done ! save time : 0.20031476020812988 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04323148727416992 time for calcul the mask position with numpy : 0.011418819427490234 nb_pixel_total : 795553 time to create 1 rle with new method : 0.07734966278076172 time for calcul the mask position with numpy : 0.015395879745483398 nb_pixel_total : 1256859 time to create 1 rle with new method : 0.02894759178161621 time for calcul the mask position with numpy : 0.006132364273071289 nb_pixel_total : 21188 time to create 1 rle with old method : 0.02250957489013672 create new chi : 0.16225218772888184 time to delete rle : 0.0005824565887451172 batch 1 Loaded 5 chid ids of type : 3594 +++++++Number RLEs to save : 3868 TO DO : save crop sub photo not yet done ! save time : 0.25865697860717773 No data in photo_id : 1393175386 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04362320899963379 time for calcul the mask position with numpy : 0.20180034637451172 nb_pixel_total : 2064874 time to create 1 rle with new method : 0.13045883178710938 time for calcul the mask position with numpy : 0.008380651473999023 nb_pixel_total : 8726 time to create 1 rle with old method : 0.009772539138793945 create new chi : 0.35858654975891113 time to delete rle : 0.0002713203430175781 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1270 TO DO : save crop sub photo not yet done ! save time : 0.10988378524780273 No data in photo_id : 1393174890 No data in photo_id : 1393174821 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.21813297271728516 time for calcul the mask position with numpy : 0.036931753158569336 nb_pixel_total : 1248108 time to create 1 rle with new method : 0.09349560737609863 time for calcul the mask position with numpy : 0.014556169509887695 nb_pixel_total : 714444 time to create 1 rle with new method : 0.08553361892700195 time for calcul the mask position with numpy : 0.011230230331420898 nb_pixel_total : 99413 time to create 1 rle with old method : 0.11088705062866211 time for calcul the mask position with numpy : 0.010378599166870117 nb_pixel_total : 4703 time to create 1 rle with old method : 0.00534510612487793 time for calcul the mask position with numpy : 0.010272741317749023 nb_pixel_total : 2907 time to create 1 rle with old method : 0.003383159637451172 time for calcul the mask position with numpy : 0.010669231414794922 nb_pixel_total : 4025 time to create 1 rle with old method : 0.004616498947143555 create new chi : 0.4057331085205078 time to delete rle : 0.0011887550354003906 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4690 TO DO : save crop sub photo not yet done ! save time : 0.30522942543029785 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07241582870483398 time for calcul the mask position with numpy : 0.015378475189208984 nb_pixel_total : 828429 time to create 1 rle with new method : 0.032373905181884766 time for calcul the mask position with numpy : 0.015629053115844727 nb_pixel_total : 1245171 time to create 1 rle with new method : 0.06223344802856445 create new chi : 0.1330101490020752 time to delete rle : 0.0003914833068847656 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 4288 TO DO : save crop sub photo not yet done ! save time : 0.284468412399292 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03533673286437988 time for calcul the mask position with numpy : 0.014963150024414062 nb_pixel_total : 1343725 time to create 1 rle with new method : 0.030579566955566406 time for calcul the mask position with numpy : 0.011237859725952148 nb_pixel_total : 729875 time to create 1 rle with new method : 0.02967071533203125 create new chi : 0.09227561950683594 time to delete rle : 0.0004017353057861328 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3056 TO DO : save crop sub photo not yet done ! save time : 0.21031904220581055 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04273486137390137 time for calcul the mask position with numpy : 0.029998302459716797 nb_pixel_total : 2052230 time to create 1 rle with new method : 1.3755886554718018 time for calcul the mask position with numpy : 0.009874582290649414 nb_pixel_total : 21370 time to create 1 rle with old method : 0.02213120460510254 create new chi : 1.4458191394805908 time to delete rle : 0.0004189014434814453 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1890 TO DO : save crop sub photo not yet done ! save time : 0.1483302116394043 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.08801531791687012 time for calcul the mask position with numpy : 0.025162935256958008 nb_pixel_total : 1107347 time to create 1 rle with new method : 0.07924389839172363 time for calcul the mask position with numpy : 0.016234874725341797 nb_pixel_total : 934642 time to create 1 rle with new method : 0.832202672958374 time for calcul the mask position with numpy : 0.006356477737426758 nb_pixel_total : 31611 time to create 1 rle with old method : 0.034336090087890625 create new chi : 1.0021171569824219 time to delete rle : 0.000537872314453125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3441 TO DO : save crop sub photo not yet done ! save time : 0.23123836517333984 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06456398963928223 time for calcul the mask position with numpy : 0.1735079288482666 nb_pixel_total : 1900336 time to create 1 rle with new method : 0.1931324005126953 time for calcul the mask position with numpy : 0.006116628646850586 nb_pixel_total : 9617 time to create 1 rle with old method : 0.010452985763549805 time for calcul the mask position with numpy : 0.006957530975341797 nb_pixel_total : 16266 time to create 1 rle with old method : 0.01775050163269043 time for calcul the mask position with numpy : 0.010937690734863281 nb_pixel_total : 103748 time to create 1 rle with old method : 0.11248207092285156 time for calcul the mask position with numpy : 0.007650852203369141 nb_pixel_total : 43633 time to create 1 rle with old method : 0.047739267349243164 create new chi : 0.5966205596923828 time to delete rle : 0.0005791187286376953 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3422 TO DO : save crop sub photo not yet done ! save time : 0.2224256992340088 No data in photo_id : 1393173990 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04909229278564453 time for calcul the mask position with numpy : 0.02312445640563965 nb_pixel_total : 2063219 time to create 1 rle with new method : 0.1447610855102539 time for calcul the mask position with numpy : 0.006045341491699219 nb_pixel_total : 6137 time to create 1 rle with old method : 0.006654024124145508 time for calcul the mask position with numpy : 0.005754232406616211 nb_pixel_total : 4244 time to create 1 rle with old method : 0.004643917083740234 create new chi : 0.19790887832641602 time to delete rle : 0.0002827644348144531 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1376 TO DO : save crop sub photo not yet done ! save time : 0.11129403114318848 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.0649111270904541 time for calcul the mask position with numpy : 0.11892390251159668 nb_pixel_total : 2042399 time to create 1 rle with new method : 0.07699060440063477 time for calcul the mask position with numpy : 0.005898475646972656 nb_pixel_total : 5618 time to create 1 rle with old method : 0.005921363830566406 time for calcul the mask position with numpy : 0.0057871341705322266 nb_pixel_total : 19171 time to create 1 rle with old method : 0.020511627197265625 time for calcul the mask position with numpy : 0.005616903305053711 nb_pixel_total : 6412 time to create 1 rle with old method : 0.00696873664855957 create new chi : 0.25647735595703125 time to delete rle : 0.00030803680419921875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1670 TO DO : save crop sub photo not yet done ! save time : 0.12929701805114746 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.040639638900756836 time for calcul the mask position with numpy : 0.038973093032836914 nb_pixel_total : 1986337 time to create 1 rle with new method : 0.12975335121154785 time for calcul the mask position with numpy : 0.006424903869628906 nb_pixel_total : 57267 time to create 1 rle with old method : 0.061376333236694336 time for calcul the mask position with numpy : 0.0059299468994140625 nb_pixel_total : 29996 time to create 1 rle with old method : 0.03142714500427246 create new chi : 0.28227877616882324 time to delete rle : 0.0003979206085205078 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 2032 TO DO : save crop sub photo not yet done ! save time : 0.16482281684875488 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 0.3851926326751709 time for calcul the mask position with numpy : 0.1075429916381836 nb_pixel_total : 1465980 time to create 1 rle with new method : 0.1803736686706543 time for calcul the mask position with numpy : 0.006042957305908203 nb_pixel_total : 8559 time to create 1 rle with old method : 0.009411811828613281 time for calcul the mask position with numpy : 0.0057871341705322266 nb_pixel_total : 4915 time to create 1 rle with old method : 0.005505800247192383 time for calcul the mask position with numpy : 0.0060045719146728516 nb_pixel_total : 3927 time to create 1 rle with old method : 0.004422187805175781 time for calcul the mask position with numpy : 0.009073495864868164 nb_pixel_total : 489340 time to create 1 rle with new method : 0.07182955741882324 time for calcul the mask position with numpy : 0.0059282779693603516 nb_pixel_total : 58301 time to create 1 rle with old method : 0.06365251541137695 time for calcul the mask position with numpy : 0.0061414241790771484 nb_pixel_total : 11747 time to create 1 rle with old method : 0.01284480094909668 time for calcul the mask position with numpy : 0.0064470767974853516 nb_pixel_total : 13198 time to create 1 rle with old method : 0.014951229095458984 time for calcul the mask position with numpy : 0.006340503692626953 nb_pixel_total : 7236 time to create 1 rle with old method : 0.008150100708007812 time for calcul the mask position with numpy : 0.005917549133300781 nb_pixel_total : 10397 time to create 1 rle with old method : 0.011512041091918945 create new chi : 0.5569174289703369 time to delete rle : 0.0008523464202880859 batch 1 Loaded 20 chid ids of type : 3594 +++++++++++++Number RLEs to save : 5131 TO DO : save crop sub photo not yet done ! save time : 0.3274118900299072 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05079245567321777 time for calcul the mask position with numpy : 0.024181365966796875 nb_pixel_total : 1945907 time to create 1 rle with new method : 0.032607316970825195 time for calcul the mask position with numpy : 0.005958080291748047 nb_pixel_total : 10471 time to create 1 rle with old method : 0.011491537094116211 time for calcul the mask position with numpy : 0.007560253143310547 nb_pixel_total : 117222 time to create 1 rle with old method : 0.1273365020751953 create new chi : 0.22385406494140625 time to delete rle : 0.00035953521728515625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2448 TO DO : save crop sub photo not yet done ! save time : 0.1675255298614502 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.049530744552612305 time for calcul the mask position with numpy : 0.04180502891540527 nb_pixel_total : 1977176 time to create 1 rle with new method : 0.17712974548339844 time for calcul the mask position with numpy : 0.005918025970458984 nb_pixel_total : 1836 time to create 1 rle with old method : 0.0019121170043945312 time for calcul the mask position with numpy : 0.00591731071472168 nb_pixel_total : 5128 time to create 1 rle with old method : 0.005344390869140625 time for calcul the mask position with numpy : 0.006088972091674805 nb_pixel_total : 89460 time to create 1 rle with old method : 0.09440279006958008 create new chi : 0.3476238250732422 time to delete rle : 0.0003993511199951172 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2264 TO DO : save crop sub photo not yet done ! save time : 0.16785240173339844 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.08882546424865723 time for calcul the mask position with numpy : 0.05931377410888672 nb_pixel_total : 2035270 time to create 1 rle with new method : 0.2895622253417969 time for calcul the mask position with numpy : 0.006182193756103516 nb_pixel_total : 2729 time to create 1 rle with old method : 0.003125429153442383 time for calcul the mask position with numpy : 0.0059185028076171875 nb_pixel_total : 3134 time to create 1 rle with old method : 0.0035877227783203125 time for calcul the mask position with numpy : 0.006308078765869141 nb_pixel_total : 32467 time to create 1 rle with old method : 0.034650325775146484 create new chi : 0.418468713760376 time to delete rle : 0.0003445148468017578 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1648 TO DO : save crop sub photo not yet done ! save time : 0.13693499565124512 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04538321495056152 time for calcul the mask position with numpy : 0.01775193214416504 nb_pixel_total : 1945455 time to create 1 rle with new method : 0.13829851150512695 time for calcul the mask position with numpy : 0.006926298141479492 nb_pixel_total : 103601 time to create 1 rle with old method : 0.11956143379211426 time for calcul the mask position with numpy : 0.0061571598052978516 nb_pixel_total : 24544 time to create 1 rle with old method : 0.026444196701049805 create new chi : 0.3220961093902588 time to delete rle : 0.0004038810729980469 batch 1 Loaded 5 chid ids of type : 3594 +++++Number RLEs to save : 2488 TO DO : save crop sub photo not yet done ! save time : 0.18416881561279297 map_output_result : {1393175979: (0.0, 'Should be the crop_list due to order', 0), 1393175929: (0.0, 'Should be the crop_list due to order', 0), 1393175407: (0.0, 'Should be the crop_list due to order', 0), 1393175404: (0.0, 'Should be the crop_list due to order', 0), 1393175401: (0.0, 'Should be the crop_list due to order', 0), 1393175399: (0.0, 'Should be the crop_list due to order', 0), 1393175386: (0.0, 'Should be the crop_list due to order', 0.0), 1393175346: (0.0, 'Should be the crop_list due to order', 0), 1393174890: (0.0, 'Should be the crop_list due to order', 0.0), 1393174821: (0.0, 'Should be the crop_list due to order', 0.0), 1393174745: (0.0, 'Should be the crop_list due to order', 0), 1393174678: (0.0, 'Should be the crop_list due to order', 0), 1393174606: (0.0, 'Should be the crop_list due to order', 0), 1393174530: (0.0, 'Should be the crop_list due to order', 0), 1393174081: (0.0, 'Should be the crop_list due to order', 0), 1393174028: (0.0, 'Should be the crop_list due to order', 0), 1393173990: (0.0, 'Should be the crop_list due to order', 0.0), 1393173950: (0.0, 'Should be the crop_list due to order', 0), 1393173912: (0.0, 'Should be the crop_list due to order', 0), 1393173034: (0.0, 'Should be the crop_list due to order', 0), 1393172968: (0.0, 'Should be the crop_list due to order', 0), 1393172909: (0.0, 'Should be the crop_list due to order', 0), 1393172827: (0.0, 'Should be the crop_list due to order', 0), 1393172762: (0.0, 'Should be the crop_list due to order', 0), 1393172715: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1393175979, 1393175929, 1393175407, 1393175404, 1393175401, 1393175399, 1393175386, 1393175346, 1393174890, 1393174821, 1393174745, 1393174678, 1393174606, 1393174530, 1393174081, 1393174028, 1393173990, 1393173950, 1393173912, 1393173034, 1393172968, 1393172909, 1393172827, 1393172762, 1393172715] Looping around the photos to save general results len do output : 25 /1393175979.Didn't retrieve data . /1393175929.Didn't retrieve data . /1393175407.Didn't retrieve data . /1393175404.Didn't retrieve data . /1393175401.Didn't retrieve data . /1393175399.Didn't retrieve data . /1393175386.Didn't retrieve data . /1393175346.Didn't retrieve data . /1393174890.Didn't retrieve data . /1393174821.Didn't retrieve data . /1393174745.Didn't retrieve data . /1393174678.Didn't retrieve data . /1393174606.Didn't retrieve data . /1393174530.Didn't retrieve data . /1393174081.Didn't retrieve data . /1393174028.Didn't retrieve data . /1393173990.Didn't retrieve data . /1393173950.Didn't retrieve data . /1393173912.Didn't retrieve data . /1393173034.Didn't retrieve data . /1393172968.Didn't retrieve data . /1393172909.Didn't retrieve data . /1393172827.Didn't retrieve data . /1393172762.Didn't retrieve data . /1393172715.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175979', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175929', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175407', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175404', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175401', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175399', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175386', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175346', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174890', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174821', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174745', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174678', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174606', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174530', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174081', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174028', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173990', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173950', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173912', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173034', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172968', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172909', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172827', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172762', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172715', None, None, None, None, None, '4019264') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 75 time used for this insertion : 0.01660752296447754 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.46054172515869 time spend to save output : 0.017392635345458984 total time spend for step 3 : 17.47793436050415 step4:ventilate_hashtags_in_portfolio Fri Nov 7 20:12:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28325353 get user id for portfolio 28325353 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28325353 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','autre','flou','environnement','pet_clair','metal','background','mal_croppe','pehd','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28325353 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','autre','flou','environnement','pet_clair','metal','background','mal_croppe','pehd','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28325353 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','autre','flou','environnement','pet_clair','metal','background','mal_croppe','pehd','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28325744,28325745,28325746,28325747,28325748,28325749,28325750,28325751,28325752,28325753,28325754?tags=papier,autre,flou,environnement,pet_clair,metal,background,mal_croppe,pehd,carton,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1393175979, 1393175929, 1393175407, 1393175404, 1393175401, 1393175399, 1393175386, 1393175346, 1393174890, 1393174821, 1393174745, 1393174678, 1393174606, 1393174530, 1393174081, 1393174028, 1393173990, 1393173950, 1393173912, 1393173034, 1393172968, 1393172909, 1393172827, 1393172762, 1393172715] Looping around the photos to save general results len do output : 1 /28325353. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175979', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175929', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175407', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175404', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175401', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175399', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175386', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175346', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174890', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174821', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174745', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174678', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174606', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174530', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174081', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174028', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173990', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173950', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173912', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173034', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172968', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172909', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172827', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172762', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172715', None, None, None, None, None, '4019264') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 26 time used for this insertion : 0.01613306999206543 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7057726383209229 time spend to save output : 0.01650071144104004 total time spend for step 4 : 1.722273349761963 step5:final Fri Nov 7 20:12:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1393175979: ('0.15004650848765433',), 1393175929: ('0.15004650848765433',), 1393175407: ('0.15004650848765433',), 1393175404: ('0.15004650848765433',), 1393175401: ('0.15004650848765433',), 1393175399: ('0.15004650848765433',), 1393175386: ('0.15004650848765433',), 1393175346: ('0.15004650848765433',), 1393174890: ('0.15004650848765433',), 1393174821: ('0.15004650848765433',), 1393174745: ('0.15004650848765433',), 1393174678: ('0.15004650848765433',), 1393174606: ('0.15004650848765433',), 1393174530: ('0.15004650848765433',), 1393174081: ('0.15004650848765433',), 1393174028: ('0.15004650848765433',), 1393173990: ('0.15004650848765433',), 1393173950: ('0.15004650848765433',), 1393173912: ('0.15004650848765433',), 1393173034: ('0.15004650848765433',), 1393172968: ('0.15004650848765433',), 1393172909: ('0.15004650848765433',), 1393172827: ('0.15004650848765433',), 1393172762: ('0.15004650848765433',), 1393172715: ('0.15004650848765433',)} new output for save of step final : {1393175979: ('0.15004650848765433',), 1393175929: ('0.15004650848765433',), 1393175407: ('0.15004650848765433',), 1393175404: ('0.15004650848765433',), 1393175401: ('0.15004650848765433',), 1393175399: ('0.15004650848765433',), 1393175386: ('0.15004650848765433',), 1393175346: ('0.15004650848765433',), 1393174890: ('0.15004650848765433',), 1393174821: ('0.15004650848765433',), 1393174745: ('0.15004650848765433',), 1393174678: ('0.15004650848765433',), 1393174606: ('0.15004650848765433',), 1393174530: ('0.15004650848765433',), 1393174081: ('0.15004650848765433',), 1393174028: ('0.15004650848765433',), 1393173990: ('0.15004650848765433',), 1393173950: ('0.15004650848765433',), 1393173912: ('0.15004650848765433',), 1393173034: ('0.15004650848765433',), 1393172968: ('0.15004650848765433',), 1393172909: ('0.15004650848765433',), 1393172827: ('0.15004650848765433',), 1393172762: ('0.15004650848765433',), 1393172715: ('0.15004650848765433',)} [1393175979, 1393175929, 1393175407, 1393175404, 1393175401, 1393175399, 1393175386, 1393175346, 1393174890, 1393174821, 1393174745, 1393174678, 1393174606, 1393174530, 1393174081, 1393174028, 1393173990, 1393173950, 1393173912, 1393173034, 1393172968, 1393172909, 1393172827, 1393172762, 1393172715] Looping around the photos to save general results len do output : 25 /1393175979.Didn't retrieve data . /1393175929.Didn't retrieve data . /1393175407.Didn't retrieve data . /1393175404.Didn't retrieve data . /1393175401.Didn't retrieve data . /1393175399.Didn't retrieve data . /1393175386.Didn't retrieve data . /1393175346.Didn't retrieve data . /1393174890.Didn't retrieve data . /1393174821.Didn't retrieve data . /1393174745.Didn't retrieve data . /1393174678.Didn't retrieve data . /1393174606.Didn't retrieve data . /1393174530.Didn't retrieve data . /1393174081.Didn't retrieve data . /1393174028.Didn't retrieve data . /1393173990.Didn't retrieve data . /1393173950.Didn't retrieve data . /1393173912.Didn't retrieve data . /1393173034.Didn't retrieve data . /1393172968.Didn't retrieve data . /1393172909.Didn't retrieve data . /1393172827.Didn't retrieve data . /1393172762.Didn't retrieve data . /1393172715.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175979', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175929', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175407', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175404', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175401', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175399', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175386', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175346', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174890', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174821', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174745', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174678', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174606', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174530', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174081', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174028', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173990', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173950', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173912', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173034', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172968', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172909', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172827', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172762', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172715', None, None, None, None, None, '4019264') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 75 time used for this insertion : 0.01823592185974121 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12092924118041992 time spend to save output : 0.019397497177124023 total time spend for step 5 : 0.14032673835754395 step6:blur_detection Fri Nov 7 20:12:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162.jpg resize: (1080, 1920) 1393175979 -1.0093282098963512 treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf.jpg resize: (1080, 1920) 1393175929 -3.438664220609801 treat image : temp/1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0.jpg resize: (1080, 1920) 1393175407 0.7172584568663022 treat image : temp/1762542629_476225_1393175404_05e3d55c6f47fdccd29f395fea90478e.jpg resize: (1080, 1920) 1393175404 -0.3683378975339334 treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61.jpg resize: (1080, 1920) 1393175401 -3.742013874123541 treat image : temp/1762542629_476225_1393175399_516970df24c5fc7ba49deecdfcef5c27.jpg resize: (1080, 1920) 1393175399 0.4729258462701696 treat image : temp/1762542629_476225_1393175386_beebb0cd1f8ac5dd6ab233779570e97b.jpg resize: (1080, 1920) 1393175386 0.01814190126813551 treat image : temp/1762542629_476225_1393175346_ced7499890096ecb1460dacd87261622.jpg resize: (1080, 1920) 1393175346 -3.4056348078220298 treat image : temp/1762542629_476225_1393174890_7e7dfdef1e75b6a6d36994996262119b.jpg resize: (1080, 1920) 1393174890 -1.3868694253172709 treat image : temp/1762542629_476225_1393174821_f9245c680d888bb82c9436eb92845bd2.jpg resize: (1080, 1920) 1393174821 -0.891780473929586 treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e.jpg resize: (1080, 1920) 1393174745 5.246567192189892 treat image : temp/1762542629_476225_1393174678_51ac009aec0d5a353a6f838eee7a0a1e.jpg resize: (1080, 1920) 1393174678 1.2334249981742516 treat image : temp/1762542629_476225_1393174606_1f8ecd515499fc5b12b50f8df98ad90d.jpg resize: (1080, 1920) 1393174606 -0.5232357637494156 treat image : temp/1762542629_476225_1393174530_e3a1d69110e0ae45a947d611801e6fe6.jpg resize: (1080, 1920) 1393174530 -0.12160273184573456 treat image : temp/1762542629_476225_1393174081_15d84bb6563a7cb62958c33dc3d27f21.jpg resize: (1080, 1920) 1393174081 0.20910316349506458 treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee.jpg resize: (1080, 1920) 1393174028 -4.206134211201659 treat image : temp/1762542629_476225_1393173990_7e2dc0f2137822cddd0fe6680b6a3daa.jpg resize: (1080, 1920) 1393173990 0.1558306575413208 treat image : temp/1762542629_476225_1393173950_0957fde68224d0a9796db6a42af9022b.jpg resize: (1080, 1920) 1393173950 -3.6884256994707596 treat image : temp/1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958.jpg resize: (1080, 1920) 1393173912 -4.021174844306121 treat image : temp/1762542629_476225_1393173034_eb1c8295c9059b65d38f1046a281b7dc.jpg resize: (1080, 1920) 1393173034 3.9804512411361257 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8.jpg resize: (1080, 1920) 1393172968 -0.12088067167094649 treat image : temp/1762542629_476225_1393172909_0126c69dc6adf8f630664ebe3ea0b4fc.jpg resize: (1080, 1920) 1393172909 -4.641837487281178 treat image : temp/1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42.jpg resize: (1080, 1920) 1393172827 -1.0944140020013995 treat image : temp/1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf.jpg resize: (1080, 1920) 1393172762 -1.8697210736963292 treat image : temp/1762542629_476225_1393172715_af13e5a6b8af0ca23221087d559cf848.jpg resize: (1080, 1920) 1393172715 2.795248668209163 treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688310_0.png resize: (79, 98) 1393224122 -0.13486493025373433 treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688313_0.png resize: (118, 178) 1393224123 -1.2467914656037706 treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688315_0.png resize: (74, 91) 1393224124 -0.9813258246186107 treat image : temp/1762542629_476225_1393175399_516970df24c5fc7ba49deecdfcef5c27_rle_crop_4025688328_0.png resize: (208, 152) 1393224125 -0.33974119755422627 treat image : temp/1762542629_476225_1393175346_ced7499890096ecb1460dacd87261622_rle_crop_4025688330_0.png resize: (88, 141) 1393224126 -1.6522420231014037 treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688331_0.png resize: (74, 143) 1393224127 -2.3897411777526756 treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688332_0.png resize: (65, 54) 1393224128 20.0 treat image : temp/1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958_rle_crop_4025688349_0.png resize: (71, 140) 1393224129 -2.4998030329257337 treat image : temp/1762542629_476225_1393173034_eb1c8295c9059b65d38f1046a281b7dc_rle_crop_4025688350_0.png resize: (167, 240) 1393224130 -1.3697387557274519 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688352_0.png resize: (88, 172) 1393224131 -0.018259861774149948 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688353_0.png resize: (104, 105) 1393224132 1.7558031922050374 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688354_0.png resize: (172, 113) 1393224133 -0.6152927152582398 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688356_0.png resize: (227, 511) 1393224134 -1.2058492798489453 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688358_0.png resize: (122, 105) 1393224135 -0.10864305362326213 treat image : temp/1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42_rle_crop_4025688366_0.png resize: (58, 49) 1393224136 0.2842399382938778 treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688316_0.png resize: (171, 108) 1393224137 -1.24488470838007 treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688326_0.png resize: (89, 109) 1393224138 -3.267162466056178 treat image : temp/1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958_rle_crop_4025688348_0.png resize: (129, 184) 1393224139 -0.6946364637104595 treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688311_0.png resize: (120, 216) 1393224242 -4.221465272602881 treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688312_0.png resize: (999, 1062) 1393224243 -0.10917863351091273 treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688314_0.png resize: (214, 113) 1393224244 -2.6295564537364764 treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688317_0.png resize: (526, 351) 1393224245 0.2581464134588995 treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688318_0.png resize: (109, 194) 1393224246 -1.4624374763438863 treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688319_0.png resize: (211, 142) 1393224247 -5.037170756935245 treat image : temp/1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0_rle_crop_4025688320_0.png resize: (89, 133) 1393224248 -1.4286904593274665 treat image : temp/1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0_rle_crop_4025688321_0.png resize: (507, 366) 1393224249 0.34448082697447213 treat image : temp/1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0_rle_crop_4025688322_0.png resize: (215, 336) 1393224250 0.27028367719238 treat image : temp/1762542629_476225_1393175404_05e3d55c6f47fdccd29f395fea90478e_rle_crop_4025688323_0.png resize: (194, 394) 1393224251 -1.5543037334717884 treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688324_0.png resize: (70, 376) 1393224252 -2.5966241716168805 treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688325_0.png resize: (519, 319) 1393224253 0.20753799170700363 treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688327_0.png resize: (226, 284) 1393224254 -4.552172944404466 treat image : temp/1762542629_476225_1393175399_516970df24c5fc7ba49deecdfcef5c27_rle_crop_4025688329_0.png resize: (1006, 1539) 1393224255 -0.60704186060689 treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688333_0.png resize: (105, 50) 1393224256 1.953401026642225 treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688334_0.png resize: (530, 316) 1393224257 0.05225166543749694 treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688335_0.png resize: (977, 1103) 1393224258 1.3922183710484655 treat image : temp/1762542629_476225_1393174678_51ac009aec0d5a353a6f838eee7a0a1e_rle_crop_4025688336_0.png resize: (899, 1738) 1393224259 -1.183805058319056 treat image : temp/1762542629_476225_1393174606_1f8ecd515499fc5b12b50f8df98ad90d_rle_crop_4025688337_0.png resize: (976, 999) 1393224260 0.16638432570075407 treat image : temp/1762542629_476225_1393174530_e3a1d69110e0ae45a947d611801e6fe6_rle_crop_4025688338_0.png resize: (254, 169) 1393224261 -2.108007672963577 treat image : temp/1762542629_476225_1393174081_15d84bb6563a7cb62958c33dc3d27f21_rle_crop_4025688339_0.png resize: (187, 216) 1393224262 -1.5607719489300849 treat image : temp/1762542629_476225_1393174081_15d84bb6563a7cb62958c33dc3d27f21_rle_crop_4025688340_0.png resize: (992, 1117) 1393224263 -0.32621735003223445 treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688342_0.png resize: (526, 321) 1393224264 0.08221951015286356 treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688343_0.png resize: (107, 207) 1393224265 -1.2129545187430848 treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688344_0.png resize: (166, 86) 1393224266 -4.563580250725314 treat image : temp/1762542629_476225_1393173950_0957fde68224d0a9796db6a42af9022b_rle_crop_4025688345_0.png resize: (65, 95) 1393224267 -3.163415534143754 treat image : temp/1762542629_476225_1393173950_0957fde68224d0a9796db6a42af9022b_rle_crop_4025688346_0.png resize: (82, 94) 1393224268 -3.945973885345828 treat image : temp/1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958_rle_crop_4025688347_0.png resize: (84, 97) 1393224269 -4.100967925677217 treat image : temp/1762542629_476225_1393173034_eb1c8295c9059b65d38f1046a281b7dc_rle_crop_4025688351_0.png resize: (174, 594) 1393224270 -1.9181110941413744 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688355_0.png resize: (131, 131) 1393224271 -3.397868971477457 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688357_0.png resize: (998, 660) 1393224272 0.06569764311100351 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688359_0.png resize: (118, 129) 1393224273 -3.6189583570355324 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688361_0.png resize: (159, 254) 1393224274 -0.5729031418280301 treat image : temp/1762542629_476225_1393172909_0126c69dc6adf8f630664ebe3ea0b4fc_rle_crop_4025688362_0.png resize: (586, 352) 1393224275 0.21391637704496339 treat image : temp/1762542629_476225_1393172909_0126c69dc6adf8f630664ebe3ea0b4fc_rle_crop_4025688363_0.png resize: (83, 153) 1393224276 -1.3802450882204322 treat image : temp/1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42_rle_crop_4025688364_0.png resize: (486, 338) 1393224277 0.01469637269068863 treat image : temp/1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42_rle_crop_4025688365_0.png resize: (42, 145) 1393224278 -0.628640768227713 treat image : temp/1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf_rle_crop_4025688367_0.png resize: (140, 312) 1393224279 -1.5165085641255116 treat image : temp/1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf_rle_crop_4025688368_0.png resize: (38, 100) 1393224280 4.047650386037806 treat image : temp/1762542629_476225_1393172715_af13e5a6b8af0ca23221087d559cf848_rle_crop_4025688370_0.png resize: (166, 238) 1393224281 -1.2785211216863392 treat image : temp/1762542629_476225_1393172715_af13e5a6b8af0ca23221087d559cf848_rle_crop_4025688371_0.png resize: (505, 318) 1393224282 0.03626257825663858 treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688341_0.png resize: (368, 167) 1393224283 -0.6815288503885027 treat image : temp/1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf_rle_crop_4025688369_0.png resize: (109, 43) 1393224284 -1.9342070353297223 treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688309_0.png resize: (65, 136) 1393224285 -2.420484696053615 treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688360_0.png resize: (53, 196) 1393224286 0.011935604935854932 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 88 time used for this insertion : 0.013574361801147461 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 88 time used for this insertion : 0.016315937042236328 save missing photos in datou_result : time spend for datou_step_exec : 23.820701599121094 time spend to save output : 0.03503251075744629 total time spend for step 6 : 23.85573410987854 step7:brightness Fri Nov 7 20:12:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162.jpg treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf.jpg treat image : temp/1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0.jpg treat image : temp/1762542629_476225_1393175404_05e3d55c6f47fdccd29f395fea90478e.jpg treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61.jpg treat image : temp/1762542629_476225_1393175399_516970df24c5fc7ba49deecdfcef5c27.jpg treat image : temp/1762542629_476225_1393175386_beebb0cd1f8ac5dd6ab233779570e97b.jpg treat image : temp/1762542629_476225_1393175346_ced7499890096ecb1460dacd87261622.jpg treat image : temp/1762542629_476225_1393174890_7e7dfdef1e75b6a6d36994996262119b.jpg treat image : temp/1762542629_476225_1393174821_f9245c680d888bb82c9436eb92845bd2.jpg treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e.jpg treat image : temp/1762542629_476225_1393174678_51ac009aec0d5a353a6f838eee7a0a1e.jpg treat image : temp/1762542629_476225_1393174606_1f8ecd515499fc5b12b50f8df98ad90d.jpg treat image : temp/1762542629_476225_1393174530_e3a1d69110e0ae45a947d611801e6fe6.jpg treat image : temp/1762542629_476225_1393174081_15d84bb6563a7cb62958c33dc3d27f21.jpg treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee.jpg treat image : temp/1762542629_476225_1393173990_7e2dc0f2137822cddd0fe6680b6a3daa.jpg treat image : temp/1762542629_476225_1393173950_0957fde68224d0a9796db6a42af9022b.jpg treat image : temp/1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958.jpg treat image : temp/1762542629_476225_1393173034_eb1c8295c9059b65d38f1046a281b7dc.jpg treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8.jpg treat image : temp/1762542629_476225_1393172909_0126c69dc6adf8f630664ebe3ea0b4fc.jpg treat image : temp/1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42.jpg treat image : temp/1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf.jpg treat image : temp/1762542629_476225_1393172715_af13e5a6b8af0ca23221087d559cf848.jpg treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688310_0.png treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688313_0.png treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688315_0.png treat image : temp/1762542629_476225_1393175399_516970df24c5fc7ba49deecdfcef5c27_rle_crop_4025688328_0.png treat image : temp/1762542629_476225_1393175346_ced7499890096ecb1460dacd87261622_rle_crop_4025688330_0.png treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688331_0.png treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688332_0.png treat image : temp/1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958_rle_crop_4025688349_0.png treat image : temp/1762542629_476225_1393173034_eb1c8295c9059b65d38f1046a281b7dc_rle_crop_4025688350_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688352_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688353_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688354_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688356_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688358_0.png treat image : temp/1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42_rle_crop_4025688366_0.png treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688316_0.png treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688326_0.png treat image : temp/1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958_rle_crop_4025688348_0.png treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688311_0.png treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688312_0.png treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688314_0.png treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688317_0.png treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688318_0.png treat image : temp/1762542629_476225_1393175929_709ec303b0355a503ac665619df67ebf_rle_crop_4025688319_0.png treat image : temp/1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0_rle_crop_4025688320_0.png treat image : temp/1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0_rle_crop_4025688321_0.png treat image : temp/1762542629_476225_1393175407_627384f69df3065649827837a42e6ef0_rle_crop_4025688322_0.png treat image : temp/1762542629_476225_1393175404_05e3d55c6f47fdccd29f395fea90478e_rle_crop_4025688323_0.png treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688324_0.png treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688325_0.png treat image : temp/1762542629_476225_1393175401_d2933f24c8934ac09d6e4c1f5f6a2b61_rle_crop_4025688327_0.png treat image : temp/1762542629_476225_1393175399_516970df24c5fc7ba49deecdfcef5c27_rle_crop_4025688329_0.png treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688333_0.png treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688334_0.png treat image : temp/1762542629_476225_1393174745_0755ed71394ff4d6be78a24c43eff95e_rle_crop_4025688335_0.png treat image : temp/1762542629_476225_1393174678_51ac009aec0d5a353a6f838eee7a0a1e_rle_crop_4025688336_0.png treat image : temp/1762542629_476225_1393174606_1f8ecd515499fc5b12b50f8df98ad90d_rle_crop_4025688337_0.png treat image : temp/1762542629_476225_1393174530_e3a1d69110e0ae45a947d611801e6fe6_rle_crop_4025688338_0.png treat image : temp/1762542629_476225_1393174081_15d84bb6563a7cb62958c33dc3d27f21_rle_crop_4025688339_0.png treat image : temp/1762542629_476225_1393174081_15d84bb6563a7cb62958c33dc3d27f21_rle_crop_4025688340_0.png treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688342_0.png treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688343_0.png treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688344_0.png treat image : temp/1762542629_476225_1393173950_0957fde68224d0a9796db6a42af9022b_rle_crop_4025688345_0.png treat image : temp/1762542629_476225_1393173950_0957fde68224d0a9796db6a42af9022b_rle_crop_4025688346_0.png treat image : temp/1762542629_476225_1393173912_de06ec7e96a3108946ba3ae2122a1958_rle_crop_4025688347_0.png treat image : temp/1762542629_476225_1393173034_eb1c8295c9059b65d38f1046a281b7dc_rle_crop_4025688351_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688355_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688357_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688359_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688361_0.png treat image : temp/1762542629_476225_1393172909_0126c69dc6adf8f630664ebe3ea0b4fc_rle_crop_4025688362_0.png treat image : temp/1762542629_476225_1393172909_0126c69dc6adf8f630664ebe3ea0b4fc_rle_crop_4025688363_0.png treat image : temp/1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42_rle_crop_4025688364_0.png treat image : temp/1762542629_476225_1393172827_a7295a517f91474ef9402ae294ed6a42_rle_crop_4025688365_0.png treat image : temp/1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf_rle_crop_4025688367_0.png treat image : temp/1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf_rle_crop_4025688368_0.png treat image : temp/1762542629_476225_1393172715_af13e5a6b8af0ca23221087d559cf848_rle_crop_4025688370_0.png treat image : temp/1762542629_476225_1393172715_af13e5a6b8af0ca23221087d559cf848_rle_crop_4025688371_0.png treat image : temp/1762542629_476225_1393174028_c82f6cef6cf73bec7293660df3d9c9ee_rle_crop_4025688341_0.png treat image : temp/1762542629_476225_1393172762_e73e97fde25bef4fb5adb2a540263daf_rle_crop_4025688369_0.png treat image : temp/1762542629_476225_1393175979_6914670f50464ae12a772aba73d33162_rle_crop_4025688309_0.png treat image : temp/1762542629_476225_1393172968_61bbebdaa7d40774469289499958fda8_rle_crop_4025688360_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 88 time used for this insertion : 0.01374673843383789 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 88 time used for this insertion : 0.016602754592895508 save missing photos in datou_result : time spend for datou_step_exec : 6.464958906173706 time spend to save output : 0.035265445709228516 total time spend for step 7 : 6.500224351882935 step8:velours_tree Fri Nov 7 20:12:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09208178520202637 time spend to save output : 4.363059997558594e-05 total time spend for step 8 : 0.09212541580200195 step9:send_mail_cod Fri Nov 7 20:12:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28325353_07-11-2025_20_12_53.pdf 28325744 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283257441762542773 28325745 change filename to text .change filename to text .imagette283257451762542774 28325746 imagette283257461762542774 28325748 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283257481762542774 28325749 imagette283257491762542775 28325750 imagette283257501762542775 28325751 imagette283257511762542775 28325752 imagette283257521762542775 28325753 change filename to text .change filename to text .change filename to text .imagette283257531762542775 28325754 change filename to text .change filename to text .imagette283257541762542776 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28325353 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28325744,28325745,28325746,28325747,28325748,28325749,28325750,28325751,28325752,28325753,28325754?tags=papier,autre,flou,environnement,pet_clair,metal,background,mal_croppe,pehd,carton,pet_fonce args[1393175979] : ((1393175979, -1.0093282098963512, 492688767), (1393175979, 0.8491148912989116, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393175929] : ((1393175929, -3.438664220609801, 492609224), (1393175929, 0.4178906569806655, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393175407] : ((1393175407, 0.7172584568663022, 492688767), (1393175407, 0.48828199724565424, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393175404] : ((1393175404, -0.3683378975339334, 492688767), (1393175404, 0.8160676830151824, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393175401] : ((1393175401, -3.742013874123541, 492609224), (1393175401, 0.4674065085552493, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393175399] : ((1393175399, 0.4729258462701696, 492688767), (1393175399, 0.7500849021239718, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393175386] : ((1393175386, 0.01814190126813551, 492688767), (1393175386, 0.5160177840006265, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393175346] : ((1393175346, -3.4056348078220298, 492609224), (1393175346, 0.34018360480966303, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393174890] : ((1393174890, -1.3868694253172709, 492688767), (1393174890, 0.607668349333038, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393174821] : ((1393174821, -0.891780473929586, 492688767), (1393174821, 0.32696422892031185, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393174745] : ((1393174745, 5.246567192189892, 492688767), (1393174745, 0.3025621566213395, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393174678] : ((1393174678, 1.2334249981742516, 492688767), (1393174678, 0.26918934007223827, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393174606] : ((1393174606, -0.5232357637494156, 492688767), (1393174606, 0.6495865054627318, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393174530] : ((1393174530, -0.12160273184573456, 492688767), (1393174530, 0.8324110866587103, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393174081] : ((1393174081, 0.20910316349506458, 492688767), (1393174081, 0.5853123206463214, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393174028] : ((1393174028, -4.206134211201659, 492609224), (1393174028, 0.36707887955568597, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393173990] : ((1393173990, 0.1558306575413208, 492688767), (1393173990, 0.7559113903644404, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393173950] : ((1393173950, -3.6884256994707596, 492609224), (1393173950, 0.6992533463881121, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393173912] : ((1393173912, -4.021174844306121, 492609224), (1393173912, 0.4365869197742967, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393173034] : ((1393173034, 3.9804512411361257, 492688767), (1393173034, 0.61917435574391, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393172968] : ((1393172968, -0.12088067167094649, 492688767), (1393172968, 0.6151480131032001, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393172909] : ((1393172909, -4.641837487281178, 492609224), (1393172909, 0.5459994328290743, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393172827] : ((1393172827, -1.0944140020013995, 492688767), (1393172827, 0.9783793602538327, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393172762] : ((1393172762, -1.8697210736963292, 492688767), (1393172762, 0.43347539437527766, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com args[1393172715] : ((1393172715, 2.795248668209163, 492688767), (1393172715, 0.37494930241669117, 2107752395), '0.15004650848765433') We are sending mail with results at report@fotonower.com refus_total : 0.15004650848765433 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28325353 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28325353_07-11-2025_20_12_53.pdf results_Auto_P28325353_07-11-2025_20_12_53.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28325353_07-11-2025_20_12_53.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28325353','results_Auto_P28325353_07-11-2025_20_12_53.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28325353_07-11-2025_20_12_53.pdf','pdf','','0.46','0.15004650848765433') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28325353

https://www.fotonower.com/image?json=false&list_photos_id=1393175979
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393175929
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393175407
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393175404
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393175401
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393175399
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393175386
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393175346
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393174890
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393174821
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393174745
La photo est trop floue, merci de reprendre une photo.(avec le score = 5.246567192189892)
https://www.fotonower.com/image?json=false&list_photos_id=1393174678
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2334249981742516)
https://www.fotonower.com/image?json=false&list_photos_id=1393174606
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393174530
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393174081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393174028
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393173990
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393173950
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393173912
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393173034
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.9804512411361257)
https://www.fotonower.com/image?json=false&list_photos_id=1393172968
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393172909
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393172827
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393172762
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393172715
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.795248668209163)

Dans ces conditions,le taux de refus est: 15.00%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/28325744?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28325745?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28325748?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28325753?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28325754?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28325353_07-11-2025_20_12_53.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28325744,28325745,28325746,28325747,28325748,28325749,28325750,28325751,28325752,28325753,28325754?tags=papier,autre,flou,environnement,pet_clair,metal,background,mal_croppe,pehd,carton,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 07 Nov 2025 19:12:58 GMT Content-Length: 0 Connection: close X-Message-Id: aXTXN5nrSb2Uy1oSgugolg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1393175979, 1393175929, 1393175407, 1393175404, 1393175401, 1393175399, 1393175386, 1393175346, 1393174890, 1393174821, 1393174745, 1393174678, 1393174606, 1393174530, 1393174081, 1393174028, 1393173990, 1393173950, 1393173912, 1393173034, 1393172968, 1393172909, 1393172827, 1393172762, 1393172715] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175979', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175929', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175407', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175404', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175401', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175399', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175386', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175346', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174890', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174821', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174745', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174678', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174606', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174530', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174081', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174028', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173990', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173950', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173912', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173034', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172968', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172909', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172827', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172762', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172715', None, None, None, None, None, '4019264') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.016605138778686523 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.41170334815979 time spend to save output : 0.0168912410736084 total time spend for step 9 : 5.428594589233398 step10:split_time_score Fri Nov 7 20:12:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 25),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07112025 28325353 Nombre de photos uploadées : 25 / 23040 (0%) 07112025 28325353 Nombre de photos taguées (types de déchets): 0 / 25 (0%) 07112025 28325353 Nombre de photos taguées (volume) : 0 / 25 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.001130819320678711 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.19875788688659668 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.004566883144718793 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28298577_07-11-2025_09_51_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28298577 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28298577 AND mptpi.`type`=3594 To do Qualite : 0.01407957175925926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28298579_07-11-2025_09_41_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28298579 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28298579 AND mptpi.`type`=3594 To do Qualite : 0.03971610363618827 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28298580_07-11-2025_09_31_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28298580 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28298580 AND mptpi.`type`=3594 To do Qualite : 0.03227211686847103 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28304078_07-11-2025_12_12_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28304078 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28304078 AND mptpi.`type`=3594 To do Qualite : 0.08912945898622983 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317462_07-11-2025_19_01_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317462 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317462 AND mptpi.`type`=3594 To do Qualite : 0.1594647526577503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317465_07-11-2025_18_51_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317465 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317465 AND mptpi.`type`=3594 To do Qualite : 0.11926633230452677 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317467_07-11-2025_18_41_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317467 AND mptpi.`type`=3594 To do Qualite : 0.24889986014660495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317509_07-11-2025_18_31_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317509 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317509 AND mptpi.`type`=3594 To do Qualite : 0.07542040412808643 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317536_07-11-2025_18_01_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317536 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317536 AND mptpi.`type`=3594 To do Qualite : 0.10745382426697532 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28317550_07-11-2025_17_51_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28317550 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28317550 AND mptpi.`type`=3594 To do Qualite : 0.17492326817558299 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28318849_07-11-2025_18_22_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28318849 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28318849 AND mptpi.`type`=3594 To do Qualite : 0.23744797889287134 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28318855_07-11-2025_19_23_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28318855 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28318855 AND mptpi.`type`=3594 To do Qualite : 0.15004650848765433 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28325353_07-11-2025_20_12_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28325353 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28325353 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07112025': {'nb_upload': 25, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1393175979, 1393175929, 1393175407, 1393175404, 1393175401, 1393175399, 1393175386, 1393175346, 1393174890, 1393174821, 1393174745, 1393174678, 1393174606, 1393174530, 1393174081, 1393174028, 1393173990, 1393173950, 1393173912, 1393173034, 1393172968, 1393172909, 1393172827, 1393172762, 1393172715] Looping around the photos to save general results len do output : 1 /28325353Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175979', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175929', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175407', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175404', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175401', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175399', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175386', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393175346', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174890', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174821', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174745', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174678', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174606', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174530', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174081', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393174028', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173990', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173950', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173912', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393173034', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172968', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172909', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172827', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172762', None, None, None, None, None, '4019264') ('3318', None, None, None, None, None, None, None, '4019264') ('3318', '28325353', '1393172715', None, None, None, None, None, '4019264') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 26 time used for this insertion : 0.014773368835449219 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1547555923461914 time spend to save output : 0.015127420425415039 total time spend for step 10 : 1.1698830127716064 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 25 set_done_treatment 93.03user 38.32system 2:34.40elapsed 85%CPU (0avgtext+0avgdata 3095188maxresident)k 510920inputs+52856outputs (628major+2413416minor)pagefaults 0swaps