python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1706318 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3973925'] with mtr_portfolio_ids : ['28024266'] and first list_photo_ids : [] new path : /proc/1706318/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 2.0660996437072754 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Oct 31 14:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-31 14:50:32.984707: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-31 14:50:33.010527: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-31 14:50:33.012342: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f390c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-31 14:50:33.012386: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-31 14:50:33.017095: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-31 14:50:33.246851: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1ee601d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-31 14:50:33.246895: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-31 14:50:33.248352: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 14:50:33.248744: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 14:50:33.251672: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 14:50:33.254070: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 14:50:33.254498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 14:50:33.257043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 14:50:33.258311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 14:50:33.262866: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 14:50:33.264387: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 14:50:33.264455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 14:50:33.265244: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 14:50:33.265260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 14:50:33.265269: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 14:50:33.266716: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-31 14:50:33.527490: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 14:50:33.527579: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 14:50:33.527598: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 14:50:33.527614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 14:50:33.527629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 14:50:33.527643: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 14:50:33.527657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 14:50:33.527672: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 14:50:33.528993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 14:50:33.530289: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 14:50:33.530340: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 14:50:33.530357: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 14:50:33.530371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 14:50:33.530384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 14:50:33.530399: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 14:50:33.530413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 14:50:33.530427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 14:50:33.531773: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 14:50:33.531805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 14:50:33.531816: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 14:50:33.531827: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 14:50:33.533206: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-31 14:50:45.518756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 14:50:45.757839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 1706899 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1708 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6997 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0030450820922851562 nb_pixel_total : 80439 time to create 1 rle with old method : 0.09380459785461426 length of segment : 294 time for calcul the mask position with numpy : 0.0008056163787841797 nb_pixel_total : 35151 time to create 1 rle with old method : 0.04327797889709473 length of segment : 282 time for calcul the mask position with numpy : 0.0002760887145996094 nb_pixel_total : 15871 time to create 1 rle with old method : 0.021119356155395508 length of segment : 133 time for calcul the mask position with numpy : 0.017459392547607422 nb_pixel_total : 329769 time to create 1 rle with new method : 0.02830219268798828 length of segment : 781 time for calcul the mask position with numpy : 0.0020904541015625 nb_pixel_total : 71305 time to create 1 rle with old method : 0.08044838905334473 length of segment : 275 time for calcul the mask position with numpy : 0.0010805130004882812 nb_pixel_total : 59279 time to create 1 rle with old method : 0.06727313995361328 length of segment : 299 time for calcul the mask position with numpy : 0.0006501674652099609 nb_pixel_total : 18917 time to create 1 rle with old method : 0.02173161506652832 length of segment : 220 time for calcul the mask position with numpy : 0.0005927085876464844 nb_pixel_total : 14018 time to create 1 rle with old method : 0.028204917907714844 length of segment : 167 time for calcul the mask position with numpy : 0.0009250640869140625 nb_pixel_total : 43409 time to create 1 rle with old method : 0.05022621154785156 length of segment : 340 time for calcul the mask position with numpy : 0.00027871131896972656 nb_pixel_total : 7039 time to create 1 rle with old method : 0.010396957397460938 length of segment : 93 time for calcul the mask position with numpy : 0.0004665851593017578 nb_pixel_total : 27115 time to create 1 rle with old method : 0.0326077938079834 length of segment : 293 time for calcul the mask position with numpy : 0.0002493858337402344 nb_pixel_total : 9829 time to create 1 rle with old method : 0.01157379150390625 length of segment : 137 time for calcul the mask position with numpy : 0.0008025169372558594 nb_pixel_total : 21261 time to create 1 rle with old method : 0.024420738220214844 length of segment : 360 time for calcul the mask position with numpy : 0.00041794776916503906 nb_pixel_total : 21050 time to create 1 rle with old method : 0.0260770320892334 length of segment : 244 time for calcul the mask position with numpy : 0.001306772232055664 nb_pixel_total : 82176 time to create 1 rle with old method : 0.09273052215576172 length of segment : 353 time for calcul the mask position with numpy : 0.0004353523254394531 nb_pixel_total : 12927 time to create 1 rle with old method : 0.01618051528930664 length of segment : 172 time for calcul the mask position with numpy : 0.0004432201385498047 nb_pixel_total : 28076 time to create 1 rle with old method : 0.03271126747131348 length of segment : 196 time for calcul the mask position with numpy : 0.0002703666687011719 nb_pixel_total : 14258 time to create 1 rle with old method : 0.021076679229736328 length of segment : 190 time for calcul the mask position with numpy : 0.005674600601196289 nb_pixel_total : 206395 time to create 1 rle with new method : 0.01366877555847168 length of segment : 613 time for calcul the mask position with numpy : 0.0011441707611083984 nb_pixel_total : 20958 time to create 1 rle with old method : 0.023847103118896484 length of segment : 316 time for calcul the mask position with numpy : 0.005260944366455078 nb_pixel_total : 174662 time to create 1 rle with new method : 0.012181758880615234 length of segment : 566 time for calcul the mask position with numpy : 0.0044782161712646484 nb_pixel_total : 119688 time to create 1 rle with old method : 0.13483452796936035 length of segment : 607 time for calcul the mask position with numpy : 0.0010502338409423828 nb_pixel_total : 33301 time to create 1 rle with old method : 0.0472414493560791 length of segment : 193 time for calcul the mask position with numpy : 0.0005788803100585938 nb_pixel_total : 23802 time to create 1 rle with old method : 0.03081488609313965 length of segment : 216 time for calcul the mask position with numpy : 0.0005204677581787109 nb_pixel_total : 12694 time to create 1 rle with old method : 0.014960527420043945 length of segment : 125 time for calcul the mask position with numpy : 0.0019452571868896484 nb_pixel_total : 88293 time to create 1 rle with old method : 0.10677075386047363 length of segment : 371 time for calcul the mask position with numpy : 0.002396106719970703 nb_pixel_total : 65559 time to create 1 rle with old method : 0.07462382316589355 length of segment : 380 time for calcul the mask position with numpy : 0.0017650127410888672 nb_pixel_total : 53188 time to create 1 rle with old method : 0.06012606620788574 length of segment : 359 time for calcul the mask position with numpy : 0.0011386871337890625 nb_pixel_total : 28432 time to create 1 rle with old method : 0.03274846076965332 length of segment : 188 time for calcul the mask position with numpy : 0.0011167526245117188 nb_pixel_total : 28511 time to create 1 rle with old method : 0.032891035079956055 length of segment : 204 time for calcul the mask position with numpy : 0.002267122268676758 nb_pixel_total : 51749 time to create 1 rle with old method : 0.06016063690185547 length of segment : 433 time for calcul the mask position with numpy : 0.0008304119110107422 nb_pixel_total : 15101 time to create 1 rle with old method : 0.025182723999023438 length of segment : 149 time for calcul the mask position with numpy : 0.0023021697998046875 nb_pixel_total : 57802 time to create 1 rle with old method : 0.07067441940307617 length of segment : 300 time for calcul the mask position with numpy : 0.00042629241943359375 nb_pixel_total : 8179 time to create 1 rle with old method : 0.014005899429321289 length of segment : 72 time for calcul the mask position with numpy : 0.0020999908447265625 nb_pixel_total : 59428 time to create 1 rle with old method : 0.13495302200317383 length of segment : 297 time for calcul the mask position with numpy : 0.0017771720886230469 nb_pixel_total : 61435 time to create 1 rle with old method : 0.08211946487426758 length of segment : 236 time for calcul the mask position with numpy : 0.0017852783203125 nb_pixel_total : 44363 time to create 1 rle with old method : 0.05133676528930664 length of segment : 290 time for calcul the mask position with numpy : 0.001007080078125 nb_pixel_total : 15929 time to create 1 rle with old method : 0.018625259399414062 length of segment : 172 time for calcul the mask position with numpy : 0.0009722709655761719 nb_pixel_total : 27501 time to create 1 rle with old method : 0.03209495544433594 length of segment : 206 time for calcul the mask position with numpy : 0.005621433258056641 nb_pixel_total : 163314 time to create 1 rle with new method : 0.011033296585083008 length of segment : 414 time for calcul the mask position with numpy : 0.0039403438568115234 nb_pixel_total : 146672 time to create 1 rle with old method : 0.1695408821105957 length of segment : 407 time for calcul the mask position with numpy : 0.0021047592163085938 nb_pixel_total : 39035 time to create 1 rle with old method : 0.05296492576599121 length of segment : 382 time for calcul the mask position with numpy : 0.0009834766387939453 nb_pixel_total : 26927 time to create 1 rle with old method : 0.03496050834655762 length of segment : 237 time for calcul the mask position with numpy : 0.00038814544677734375 nb_pixel_total : 8621 time to create 1 rle with old method : 0.009981155395507812 length of segment : 108 time for calcul the mask position with numpy : 0.0007357597351074219 nb_pixel_total : 22951 time to create 1 rle with old method : 0.026438236236572266 length of segment : 243 time for calcul the mask position with numpy : 0.0027761459350585938 nb_pixel_total : 92581 time to create 1 rle with old method : 0.11398816108703613 length of segment : 348 time for calcul the mask position with numpy : 0.0004189014434814453 nb_pixel_total : 8457 time to create 1 rle with old method : 0.011934518814086914 length of segment : 100 time for calcul the mask position with numpy : 0.0010194778442382812 nb_pixel_total : 28724 time to create 1 rle with old method : 0.0370481014251709 length of segment : 218 time for calcul the mask position with numpy : 0.0013670921325683594 nb_pixel_total : 23158 time to create 1 rle with old method : 0.028785228729248047 length of segment : 332 time for calcul the mask position with numpy : 0.002362489700317383 nb_pixel_total : 54310 time to create 1 rle with old method : 0.06925415992736816 length of segment : 294 time for calcul the mask position with numpy : 0.00146484375 nb_pixel_total : 58999 time to create 1 rle with old method : 0.08595132827758789 length of segment : 364 time for calcul the mask position with numpy : 0.0007736682891845703 nb_pixel_total : 36232 time to create 1 rle with old method : 0.04147481918334961 length of segment : 292 time for calcul the mask position with numpy : 0.0009918212890625 nb_pixel_total : 31494 time to create 1 rle with old method : 0.03617501258850098 length of segment : 253 time for calcul the mask position with numpy : 0.0010840892791748047 nb_pixel_total : 35103 time to create 1 rle with old method : 0.03975081443786621 length of segment : 268 time for calcul the mask position with numpy : 0.005148172378540039 nb_pixel_total : 167538 time to create 1 rle with new method : 0.013257980346679688 length of segment : 558 time for calcul the mask position with numpy : 0.0033419132232666016 nb_pixel_total : 118736 time to create 1 rle with old method : 0.13475775718688965 length of segment : 341 time for calcul the mask position with numpy : 0.0009067058563232422 nb_pixel_total : 18967 time to create 1 rle with old method : 0.021590471267700195 length of segment : 243 time for calcul the mask position with numpy : 0.001363515853881836 nb_pixel_total : 33844 time to create 1 rle with old method : 0.03957867622375488 length of segment : 209 time for calcul the mask position with numpy : 0.0008559226989746094 nb_pixel_total : 22941 time to create 1 rle with old method : 0.026334285736083984 length of segment : 143 time for calcul the mask position with numpy : 0.001834869384765625 nb_pixel_total : 43474 time to create 1 rle with old method : 0.04949498176574707 length of segment : 290 time for calcul the mask position with numpy : 0.0006825923919677734 nb_pixel_total : 16650 time to create 1 rle with old method : 0.021297454833984375 length of segment : 133 time for calcul the mask position with numpy : 0.0007319450378417969 nb_pixel_total : 24574 time to create 1 rle with old method : 0.028184175491333008 length of segment : 121 time for calcul the mask position with numpy : 0.0007679462432861328 nb_pixel_total : 19085 time to create 1 rle with old method : 0.021853208541870117 length of segment : 213 time for calcul the mask position with numpy : 0.0005190372467041016 nb_pixel_total : 19015 time to create 1 rle with old method : 0.022598981857299805 length of segment : 128 time for calcul the mask position with numpy : 0.0022115707397460938 nb_pixel_total : 95107 time to create 1 rle with old method : 0.10777473449707031 length of segment : 355 time for calcul the mask position with numpy : 0.0006020069122314453 nb_pixel_total : 14572 time to create 1 rle with old method : 0.016583919525146484 length of segment : 226 time for calcul the mask position with numpy : 0.0017559528350830078 nb_pixel_total : 68095 time to create 1 rle with old method : 0.07634305953979492 length of segment : 385 time for calcul the mask position with numpy : 0.0012843608856201172 nb_pixel_total : 45654 time to create 1 rle with old method : 0.052290916442871094 length of segment : 193 time for calcul the mask position with numpy : 0.0008492469787597656 nb_pixel_total : 40514 time to create 1 rle with old method : 0.09674572944641113 length of segment : 218 time spent for convertir_results : 7.440065383911133 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 69 chid ids of type : 3594 Number RLEs to save : 19138 save missing photos in datou_result : time spend for datou_step_exec : 59.593764543533325 time spend to save output : 1.0826845169067383 total time spend for step 1 : 60.67644906044006 step2:crop_condition Fri Oct 31 14:51:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 69 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 3736932 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918702_1706318 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080959_0.png', 0, 142, 133, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080960_0.png', 0, 631, 775, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080968_0.png', 0, 108, 137, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080975_0.png', 0, 703, 438, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080976_0.png', 0, 119, 316, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080977_0.png', 0, 451, 566, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080978_0.png', 0, 343, 555, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080979_0.png', 0, 198, 190, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080980_0.png', 0, 178, 216, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080981_0.png', 0, 151, 124, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080983_0.png', 0, 262, 380, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080986_0.png', 0, 239, 204, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080987_0.png', 0, 236, 433, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080988_0.png', 0, 218, 148, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080989_0.png', 0, 294, 283, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080994_0.png', 0, 133, 172, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080995_0.png', 0, 190, 206, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080996_0.png', 0, 581, 414, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080997_0.png', 0, 523, 407, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081001_0.png', 0, 112, 230, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081004_0.png', 0, 197, 218, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081005_0.png', 0, 257, 318, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081006_0.png', 0, 304, 294, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081008_0.png', 0, 192, 290, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081011_0.png', 0, 501, 555, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081014_0.png', 0, 369, 173, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081017_0.png', 0, 217, 119, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081019_0.png', 0, 125, 210, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081020_0.png', 0, 218, 127, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081022_0.png', 0, 82, 224, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081023_0.png', 0, 294, 376, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918708), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081025_0.png', 0, 230, 216, 0, 1761918708,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 32 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.906024694442749 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918714_1706318 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080957_0.png', 0, 395, 293, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080958_0.png', 0, 190, 264, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080963_0.png', 0, 120, 220, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080964_0.png', 0, 126, 165, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080965_0.png', 0, 261, 271, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080969_0.png', 0, 176, 306, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080970_0.png', 0, 159, 234, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080972_0.png', 0, 112, 169, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080974_0.png', 0, 112, 188, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080984_0.png', 0, 218, 345, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080985_0.png', 0, 267, 180, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080999_0.png', 0, 171, 234, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081009_0.png', 0, 149, 253, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081010_0.png', 0, 177, 268, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081012_0.png', 0, 490, 341, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918717), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081013_0.png', 0, 114, 243, 0, 1761918717,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.09648871421814 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918720_1706318 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918721), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080966_0.png', 0, 100, 93, 0, 1761918721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918721), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081000_0.png', 0, 98, 104, 0, 1761918721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918721), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081003_0.png', 0, 108, 99, 0, 1761918721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918721), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081015_0.png', 0, 196, 141, 0, 1761918721,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7993278503417969 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918727_1706318 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080961_0.png', 0, 335, 275, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080967_0.png', 0, 129, 293, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080971_0.png', 0, 349, 349, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080982_0.png', 0, 276, 370, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080990_0.png', 0, 132, 68, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080991_0.png', 0, 249, 296, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080992_0.png', 0, 334, 234, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080993_0.png', 0, 206, 274, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080998_0.png', 0, 162, 382, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081002_0.png', 0, 365, 334, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081007_0.png', 0, 223, 364, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081016_0.png', 0, 204, 286, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081018_0.png', 0, 291, 113, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081021_0.png', 0, 352, 353, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918730), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081024_0.png', 0, 448, 184, 0, 1761918730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.034953594207764 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918732_1706318 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918733), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080973_0.png', 0, 185, 196, 0, 1761918733,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9068477153778076 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918735_1706318 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918735), 0.0, 0.0, 14, '', 0, 0, '1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080962_0.png', 0, 295, 265, 0, 1761918735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5729889869689941 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1391183668, 1391183654, 1391183648, 1391183640, 1391183637, 1391183631, 1391183625, 1391183622] Looping around the photos to save general results len do output : 69 /1391219848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183668', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183654', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183648', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183640', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183637', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183631', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183625', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183622', None, None, None, None, None, '3973925') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 215 time used for this insertion : 0.021474361419677734 save_final save missing photos in datou_result : time spend for datou_step_exec : 44.55631756782532 time spend to save output : 0.024129390716552734 total time spend for step 2 : 44.58044695854187 step3:rle_unique_nms_with_priority Fri Oct 31 14:52:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 69 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 10 nb_hashtags : 5 time to prepare the origin masks : 4.441573858261108 time for calcul the mask position with numpy : 0.6032707691192627 nb_pixel_total : 7619203 time to create 1 rle with new method : 0.7964715957641602 time for calcul the mask position with numpy : 0.023678302764892578 nb_pixel_total : 7039 time to create 1 rle with old method : 0.007632732391357422 time for calcul the mask position with numpy : 0.02492833137512207 nb_pixel_total : 43409 time to create 1 rle with old method : 0.04714560508728027 time for calcul the mask position with numpy : 0.024316072463989258 nb_pixel_total : 14018 time to create 1 rle with old method : 0.015100955963134766 time for calcul the mask position with numpy : 0.023685455322265625 nb_pixel_total : 18917 time to create 1 rle with old method : 0.020382165908813477 time for calcul the mask position with numpy : 0.023787260055541992 nb_pixel_total : 59279 time to create 1 rle with old method : 0.0655527114868164 time for calcul the mask position with numpy : 0.026839494705200195 nb_pixel_total : 71305 time to create 1 rle with old method : 0.07947683334350586 time for calcul the mask position with numpy : 0.027634620666503906 nb_pixel_total : 329769 time to create 1 rle with new method : 0.7778222560882568 time for calcul the mask position with numpy : 0.024965763092041016 nb_pixel_total : 15871 time to create 1 rle with old method : 0.017668724060058594 time for calcul the mask position with numpy : 0.025652408599853516 nb_pixel_total : 35151 time to create 1 rle with old method : 0.039548397064208984 time for calcul the mask position with numpy : 0.026079654693603516 nb_pixel_total : 80439 time to create 1 rle with old method : 0.09178423881530762 create new chi : 2.873220205307007 time to delete rle : 0.018825531005859375 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7928 TO DO : save crop sub photo not yet done ! save time : 0.409700870513916 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 5.095496654510498 time for calcul the mask position with numpy : 0.6455867290496826 nb_pixel_total : 7850355 time to create 1 rle with new method : 0.5400919914245605 time for calcul the mask position with numpy : 0.026172876358032227 nb_pixel_total : 20958 time to create 1 rle with old method : 0.026363372802734375 time for calcul the mask position with numpy : 0.027553558349609375 nb_pixel_total : 206395 time to create 1 rle with new method : 0.7051143646240234 time for calcul the mask position with numpy : 0.032939910888671875 nb_pixel_total : 14258 time to create 1 rle with old method : 0.0159761905670166 time for calcul the mask position with numpy : 0.04050779342651367 nb_pixel_total : 28076 time to create 1 rle with old method : 0.03587031364440918 time for calcul the mask position with numpy : 0.03992271423339844 nb_pixel_total : 12927 time to create 1 rle with old method : 0.014539718627929688 time for calcul the mask position with numpy : 0.040791988372802734 nb_pixel_total : 82176 time to create 1 rle with old method : 0.09106802940368652 time for calcul the mask position with numpy : 0.04047131538391113 nb_pixel_total : 21050 time to create 1 rle with old method : 0.026112794876098633 time for calcul the mask position with numpy : 0.03343486785888672 nb_pixel_total : 21261 time to create 1 rle with old method : 0.023833513259887695 time for calcul the mask position with numpy : 0.024914979934692383 nb_pixel_total : 9829 time to create 1 rle with old method : 0.011097192764282227 time for calcul the mask position with numpy : 0.025770187377929688 nb_pixel_total : 27115 time to create 1 rle with old method : 0.030325889587402344 create new chi : 2.5726423263549805 time to delete rle : 0.0011126995086669922 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7908 TO DO : save crop sub photo not yet done ! save time : 0.4154636859893799 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.3139305114746094 time for calcul the mask position with numpy : 0.5418741703033447 nb_pixel_total : 7723213 time to create 1 rle with new method : 0.6304705142974854 time for calcul the mask position with numpy : 0.028638362884521484 nb_pixel_total : 53188 time to create 1 rle with old method : 0.05955910682678223 time for calcul the mask position with numpy : 0.02604985237121582 nb_pixel_total : 65559 time to create 1 rle with old method : 0.07280325889587402 time for calcul the mask position with numpy : 0.025862932205200195 nb_pixel_total : 88293 time to create 1 rle with old method : 0.1008455753326416 time for calcul the mask position with numpy : 0.024891138076782227 nb_pixel_total : 12694 time to create 1 rle with old method : 0.01441192626953125 time for calcul the mask position with numpy : 0.024472475051879883 nb_pixel_total : 23802 time to create 1 rle with old method : 0.02664804458618164 time for calcul the mask position with numpy : 0.02792048454284668 nb_pixel_total : 33301 time to create 1 rle with old method : 0.041606903076171875 time for calcul the mask position with numpy : 0.028912067413330078 nb_pixel_total : 119688 time to create 1 rle with old method : 0.13698959350585938 time for calcul the mask position with numpy : 0.027849197387695312 nb_pixel_total : 174662 time to create 1 rle with new method : 0.5989646911621094 create new chi : 2.5165557861328125 time to delete rle : 0.0011398792266845703 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 7794 TO DO : save crop sub photo not yet done ! save time : 0.3934648036956787 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 4.302129507064819 time for calcul the mask position with numpy : 0.6070079803466797 nb_pixel_total : 7895970 time to create 1 rle with new method : 0.7348794937133789 time for calcul the mask position with numpy : 0.03315591812133789 nb_pixel_total : 27501 time to create 1 rle with old method : 0.0307309627532959 time for calcul the mask position with numpy : 0.02481245994567871 nb_pixel_total : 15929 time to create 1 rle with old method : 0.017856359481811523 time for calcul the mask position with numpy : 0.025864839553833008 nb_pixel_total : 44363 time to create 1 rle with old method : 0.049128055572509766 time for calcul the mask position with numpy : 0.025269269943237305 nb_pixel_total : 61435 time to create 1 rle with old method : 0.06814694404602051 time for calcul the mask position with numpy : 0.028699159622192383 nb_pixel_total : 59428 time to create 1 rle with old method : 0.06630945205688477 time for calcul the mask position with numpy : 0.025672197341918945 nb_pixel_total : 8179 time to create 1 rle with old method : 0.009269475936889648 time for calcul the mask position with numpy : 0.027061939239501953 nb_pixel_total : 57802 time to create 1 rle with old method : 0.06651854515075684 time for calcul the mask position with numpy : 0.025691509246826172 nb_pixel_total : 15101 time to create 1 rle with old method : 0.01697707176208496 time for calcul the mask position with numpy : 0.026566028594970703 nb_pixel_total : 51749 time to create 1 rle with old method : 0.057653188705444336 time for calcul the mask position with numpy : 0.026871442794799805 nb_pixel_total : 28511 time to create 1 rle with old method : 0.03190469741821289 time for calcul the mask position with numpy : 0.02570652961730957 nb_pixel_total : 28432 time to create 1 rle with old method : 0.031577110290527344 create new chi : 2.1266491413116455 time to delete rle : 0.0011301040649414062 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7254 TO DO : save crop sub photo not yet done ! save time : 0.4004206657409668 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 3.422133207321167 time for calcul the mask position with numpy : 0.5468642711639404 nb_pixel_total : 7785842 time to create 1 rle with new method : 0.8754968643188477 time for calcul the mask position with numpy : 0.024684667587280273 nb_pixel_total : 8457 time to create 1 rle with old method : 0.009492158889770508 time for calcul the mask position with numpy : 0.04243874549865723 nb_pixel_total : 92581 time to create 1 rle with old method : 0.12573027610778809 time for calcul the mask position with numpy : 0.034414052963256836 nb_pixel_total : 22951 time to create 1 rle with old method : 0.02585911750793457 time for calcul the mask position with numpy : 0.02536773681640625 nb_pixel_total : 8621 time to create 1 rle with old method : 0.009762763977050781 time for calcul the mask position with numpy : 0.02484917640686035 nb_pixel_total : 26927 time to create 1 rle with old method : 0.030112504959106445 time for calcul the mask position with numpy : 0.025923490524291992 nb_pixel_total : 39035 time to create 1 rle with old method : 0.043624162673950195 time for calcul the mask position with numpy : 0.026660680770874023 nb_pixel_total : 146672 time to create 1 rle with old method : 0.17195653915405273 time for calcul the mask position with numpy : 0.026421070098876953 nb_pixel_total : 163314 time to create 1 rle with new method : 0.7140429019927979 create new chi : 2.8496673107147217 time to delete rle : 0.0009953975677490234 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6638 TO DO : save crop sub photo not yet done ! save time : 0.3746068477630615 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.7159407138824463 time for calcul the mask position with numpy : 0.4370310306549072 nb_pixel_total : 8026380 time to create 1 rle with new method : 0.4604625701904297 time for calcul the mask position with numpy : 0.02360248565673828 nb_pixel_total : 35103 time to create 1 rle with old method : 0.038712263107299805 time for calcul the mask position with numpy : 0.02454972267150879 nb_pixel_total : 31494 time to create 1 rle with old method : 0.03451061248779297 time for calcul the mask position with numpy : 0.024884700775146484 nb_pixel_total : 36232 time to create 1 rle with old method : 0.039847612380981445 time for calcul the mask position with numpy : 0.024675369262695312 nb_pixel_total : 58999 time to create 1 rle with old method : 0.06465697288513184 time for calcul the mask position with numpy : 0.025288105010986328 nb_pixel_total : 54310 time to create 1 rle with old method : 0.060173988342285156 time for calcul the mask position with numpy : 0.028076887130737305 nb_pixel_total : 23158 time to create 1 rle with old method : 0.02614593505859375 time for calcul the mask position with numpy : 0.024500370025634766 nb_pixel_total : 28724 time to create 1 rle with old method : 0.032048940658569336 create new chi : 1.413484811782837 time to delete rle : 0.0009171962738037109 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 6202 TO DO : save crop sub photo not yet done ! save time : 0.3358020782470703 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 3.993823528289795 time for calcul the mask position with numpy : 0.48567652702331543 nb_pixel_total : 7828591 time to create 1 rle with new method : 1.0591325759887695 time for calcul the mask position with numpy : 0.02422618865966797 nb_pixel_total : 19085 time to create 1 rle with old method : 0.021953105926513672 time for calcul the mask position with numpy : 0.02559351921081543 nb_pixel_total : 24574 time to create 1 rle with old method : 0.04348564147949219 time for calcul the mask position with numpy : 0.03075385093688965 nb_pixel_total : 16650 time to create 1 rle with old method : 0.02572464942932129 time for calcul the mask position with numpy : 0.028428316116333008 nb_pixel_total : 43474 time to create 1 rle with old method : 0.06943964958190918 time for calcul the mask position with numpy : 0.025246381759643555 nb_pixel_total : 22941 time to create 1 rle with old method : 0.02528524398803711 time for calcul the mask position with numpy : 0.024691343307495117 nb_pixel_total : 33844 time to create 1 rle with old method : 0.036850929260253906 time for calcul the mask position with numpy : 0.02888774871826172 nb_pixel_total : 18967 time to create 1 rle with old method : 0.02054286003112793 time for calcul the mask position with numpy : 0.04119610786437988 nb_pixel_total : 118736 time to create 1 rle with old method : 0.13015294075012207 time for calcul the mask position with numpy : 0.0405583381652832 nb_pixel_total : 167538 time to create 1 rle with new method : 0.7124454975128174 create new chi : 2.9716830253601074 time to delete rle : 0.0012907981872558594 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 6662 TO DO : save crop sub photo not yet done ! save time : 0.3460693359375 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.025383710861206 time for calcul the mask position with numpy : 0.5458807945251465 nb_pixel_total : 8011443 time to create 1 rle with new method : 0.861466646194458 time for calcul the mask position with numpy : 0.026514768600463867 nb_pixel_total : 40514 time to create 1 rle with old method : 0.048682212829589844 time for calcul the mask position with numpy : 0.029964208602905273 nb_pixel_total : 45654 time to create 1 rle with old method : 0.05137753486633301 time for calcul the mask position with numpy : 0.026813030242919922 nb_pixel_total : 68095 time to create 1 rle with old method : 0.07659316062927246 time for calcul the mask position with numpy : 0.02623915672302246 nb_pixel_total : 14572 time to create 1 rle with old method : 0.01631927490234375 time for calcul the mask position with numpy : 0.02650904655456543 nb_pixel_total : 95107 time to create 1 rle with old method : 0.10584163665771484 time for calcul the mask position with numpy : 0.026653766632080078 nb_pixel_total : 19015 time to create 1 rle with old method : 0.021512508392333984 create new chi : 1.9389536380767822 time to delete rle : 0.0009570121765136719 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5170 TO DO : save crop sub photo not yet done ! save time : 0.30480408668518066 map_output_result : {1391183668: (0.0, 'Should be the crop_list due to order', 0), 1391183654: (0.0, 'Should be the crop_list due to order', 0), 1391183648: (0.0, 'Should be the crop_list due to order', 0), 1391183640: (0.0, 'Should be the crop_list due to order', 0), 1391183637: (0.0, 'Should be the crop_list due to order', 0), 1391183631: (0.0, 'Should be the crop_list due to order', 0), 1391183625: (0.0, 'Should be the crop_list due to order', 0), 1391183622: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1391183668, 1391183654, 1391183648, 1391183640, 1391183637, 1391183631, 1391183625, 1391183622] Looping around the photos to save general results len do output : 8 /1391183668.Didn't retrieve data . /1391183654.Didn't retrieve data . /1391183648.Didn't retrieve data . /1391183640.Didn't retrieve data . /1391183637.Didn't retrieve data . /1391183631.Didn't retrieve data . /1391183625.Didn't retrieve data . /1391183622.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183668', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183654', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183648', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183640', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183637', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183631', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183625', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183622', None, None, None, None, None, '3973925') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.011404752731323242 save_final save missing photos in datou_result : time spend for datou_step_exec : 53.67972946166992 time spend to save output : 0.011830329895019531 total time spend for step 3 : 53.69155979156494 step4:ventilate_hashtags_in_portfolio Fri Oct 31 14:53:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28024266 get user id for portfolio 28024266 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28024266 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','mal_croppe','papier','pet_fonce','autre','pehd','background','metal','carton','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28024266 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','mal_croppe','papier','pet_fonce','autre','pehd','background','metal','carton','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28024266 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','mal_croppe','papier','pet_fonce','autre','pehd','background','metal','carton','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28026864,28026866,28026867,28026868,28026869,28026870,28026871,28026872,28026873,28026874,28026875?tags=flou,mal_croppe,papier,pet_fonce,autre,pehd,background,metal,carton,environnement,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1391183668, 1391183654, 1391183648, 1391183640, 1391183637, 1391183631, 1391183625, 1391183622] Looping around the photos to save general results len do output : 1 /28024266. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183668', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183654', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183648', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183640', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183637', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183631', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183625', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183622', None, None, None, None, None, '3973925') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.011614799499511719 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.645744800567627 time spend to save output : 0.011890649795532227 total time spend for step 4 : 1.6576354503631592 step5:final Fri Oct 31 14:53:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1391183668: ('0.05446751724054783',), 1391183654: ('0.05446751724054783',), 1391183648: ('0.05446751724054783',), 1391183640: ('0.05446751724054783',), 1391183637: ('0.05446751724054783',), 1391183631: ('0.05446751724054783',), 1391183625: ('0.05446751724054783',), 1391183622: ('0.05446751724054783',)} new output for save of step final : {1391183668: ('0.05446751724054783',), 1391183654: ('0.05446751724054783',), 1391183648: ('0.05446751724054783',), 1391183640: ('0.05446751724054783',), 1391183637: ('0.05446751724054783',), 1391183631: ('0.05446751724054783',), 1391183625: ('0.05446751724054783',), 1391183622: ('0.05446751724054783',)} [1391183668, 1391183654, 1391183648, 1391183640, 1391183637, 1391183631, 1391183625, 1391183622] Looping around the photos to save general results len do output : 8 /1391183668.Didn't retrieve data . /1391183654.Didn't retrieve data . /1391183648.Didn't retrieve data . /1391183640.Didn't retrieve data . /1391183637.Didn't retrieve data . /1391183631.Didn't retrieve data . /1391183625.Didn't retrieve data . /1391183622.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183668', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183654', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183648', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183640', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183637', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183631', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183625', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183622', None, None, None, None, None, '3973925') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.009870290756225586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11269235610961914 time spend to save output : 0.010229825973510742 total time spend for step 5 : 0.12292218208312988 step6:blur_detection Fri Oct 31 14:53:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b.jpg resize: (2160, 3840) 1391183668 -6.851200571718522 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a.jpg resize: (2160, 3840) 1391183654 -7.091512035501208 treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43.jpg resize: (2160, 3840) 1391183648 -7.056435124641322 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a.jpg resize: (2160, 3840) 1391183640 -6.918247693846957 treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986.jpg resize: (2160, 3840) 1391183637 -7.04548346165077 treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01.jpg resize: (2160, 3840) 1391183631 -6.800070999306156 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab.jpg resize: (2160, 3840) 1391183625 -7.037016271120237 treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432.jpg resize: (2160, 3840) 1391183622 -6.858168947984142 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080959_0.png resize: (133, 142) 1391219848 -4.441818289968612 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080960_0.png resize: (775, 631) 1391219849 -4.221594742123186 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080968_0.png resize: (137, 108) 1391219850 -4.692444536602406 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080975_0.png resize: (438, 703) 1391219851 -5.0906024284156866 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080976_0.png resize: (316, 119) 1391219852 -4.672716166693878 treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080977_0.png resize: (566, 451) 1391219853 -3.9848306984282327 treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080978_0.png resize: (555, 343) 1391219854 -5.309162424176829 treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080979_0.png resize: (190, 198) 1391219855 -4.700453286863645 treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080980_0.png resize: (216, 178) 1391219856 -3.9279034825935972 treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080981_0.png resize: (124, 151) 1391219857 -4.449095525732196 treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080983_0.png resize: (380, 262) 1391219858 -3.9498255291020308 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080986_0.png resize: (204, 239) 1391219859 -4.530910492394703 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080987_0.png resize: (433, 236) 1391219860 -4.1771898678338575 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080988_0.png resize: (148, 218) 1391219861 -4.278566685088272 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080989_0.png resize: (283, 294) 1391219862 -4.980149232276732 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080994_0.png resize: (172, 133) 1391219863 -3.8684252167451643 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080995_0.png resize: (206, 190) 1391219864 -3.916429688558637 treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080996_0.png resize: (414, 581) 1391219865 -4.537505853296573 treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080997_0.png resize: (407, 523) 1391219866 -6.120424200094462 treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081001_0.png resize: (230, 112) 1391219867 -5.5220921843898365 treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081004_0.png resize: (218, 197) 1391219868 -4.068072660791733 treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081005_0.png resize: (318, 257) 1391219869 -2.9837397494487403 treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081006_0.png resize: (294, 304) 1391219870 -2.502243236613986 treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081008_0.png resize: (290, 192) 1391219871 -3.2988066537158383 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081011_0.png resize: (555, 501) 1391219872 -4.813466043762195 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081014_0.png resize: (173, 369) 1391219873 -4.853496246552049 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081017_0.png resize: (119, 217) 1391219874 -4.950821950835434 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081019_0.png resize: (210, 125) 1391219875 -4.343892550658408 treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081020_0.png resize: (127, 218) 1391219876 -3.8870551620131804 treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081022_0.png resize: (224, 82) 1391219877 -3.4479345911337993 treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081023_0.png resize: (376, 294) 1391219878 -4.097455955774153 treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081025_0.png resize: (216, 230) 1391219879 -4.00839423069514 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080957_0.png resize: (293, 395) 1391219886 -4.282772191225648 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080958_0.png resize: (264, 190) 1391219887 -3.629964779468672 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080963_0.png resize: (220, 120) 1391219888 -3.231045999894937 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080964_0.png resize: (165, 126) 1391219889 -3.2251106361121242 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080965_0.png resize: (271, 261) 1391219890 -4.027113144881166 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080969_0.png resize: (306, 176) 1391219891 -3.9895186596387537 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080970_0.png resize: (234, 159) 1391219892 -2.85401388824831 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080972_0.png resize: (169, 112) 1391219893 -3.453358447581739 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080974_0.png resize: (188, 112) 1391219894 -1.9847415161784256 treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080984_0.png resize: (345, 218) 1391219895 -4.769639351688548 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080985_0.png resize: (180, 267) 1391219896 -2.2040098779413677 treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080999_0.png resize: (234, 171) 1391219897 -3.1151022310863605 treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081009_0.png resize: (253, 149) 1391219898 -3.146604604466458 treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081010_0.png resize: (268, 177) 1391219899 -4.9729579633417735 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081012_0.png resize: (341, 490) 1391219900 -4.931919985176723 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081013_0.png resize: (243, 114) 1391219901 -3.419267904128846 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080966_0.png resize: (93, 100) 1391219903 -4.442172970836955 treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081000_0.png resize: (104, 98) 1391219904 -4.527399951394572 treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081003_0.png resize: (99, 108) 1391219905 -5.4898135288845005 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081015_0.png resize: (141, 196) 1391219906 -5.118554905963573 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080961_0.png resize: (275, 335) 1391219910 -4.195842673845206 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080967_0.png resize: (293, 129) 1391219911 -5.086783342719999 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080971_0.png resize: (349, 349) 1391219912 -4.8067775691183074 treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080982_0.png resize: (370, 276) 1391219913 -3.341297812235394 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080990_0.png resize: (68, 132) 1391219914 -3.9080419813338714 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080991_0.png resize: (296, 249) 1391219915 -4.492091112543517 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080992_0.png resize: (234, 334) 1391219916 -4.611761445937407 treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080993_0.png resize: (274, 206) 1391219917 -5.606118454597134 treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080998_0.png resize: (382, 162) 1391219918 -4.728506107597869 treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081002_0.png resize: (334, 365) 1391219919 -4.777342637013498 treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081007_0.png resize: (364, 223) 1391219920 -4.311512654268248 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081016_0.png resize: (286, 204) 1391219921 -3.4999796049570597 treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081018_0.png resize: (113, 291) 1391219922 -5.575720085530654 treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081021_0.png resize: (353, 352) 1391219923 -4.059413426614913 treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081024_0.png resize: (184, 448) 1391219924 -4.336205821284073 treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080973_0.png resize: (196, 185) 1391219925 -4.061240578876547 treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080962_0.png resize: (265, 295) 1391219927 -5.1416786821076625 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 77 time used for this insertion : 0.011553525924682617 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 77 time used for this insertion : 0.012720346450805664 save missing photos in datou_result : time spend for datou_step_exec : 33.61792969703674 time spend to save output : 0.029367446899414062 total time spend for step 6 : 33.64729714393616 step7:brightness Fri Oct 31 14:53:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b.jpg treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a.jpg treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43.jpg treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a.jpg treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986.jpg treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01.jpg treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab.jpg treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432.jpg treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080959_0.png treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080960_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080968_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080975_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080976_0.png treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080977_0.png treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080978_0.png treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080979_0.png treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080980_0.png treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080981_0.png treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080983_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080986_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080987_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080988_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080989_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080994_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080995_0.png treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080996_0.png treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080997_0.png treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081001_0.png treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081004_0.png treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081005_0.png treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081006_0.png treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081008_0.png treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081011_0.png treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081014_0.png treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081017_0.png treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081019_0.png treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081020_0.png treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081022_0.png treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081023_0.png treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081025_0.png treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080957_0.png treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080958_0.png treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080963_0.png treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080964_0.png treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080965_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080969_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080970_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080972_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080974_0.png treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080984_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080985_0.png treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080999_0.png treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081009_0.png treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081010_0.png treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081012_0.png treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081013_0.png treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080966_0.png treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081000_0.png treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081003_0.png treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081015_0.png treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080961_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080967_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080971_0.png treat image : temp/1761918628_1706318_1391183648_bf88d289412169e1e295ee91aefc1d43_rle_crop_4010080982_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080990_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080991_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080992_0.png treat image : temp/1761918628_1706318_1391183640_555f640ad72843bddb34a48ae2699a9a_rle_crop_4010080993_0.png treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010080998_0.png treat image : temp/1761918628_1706318_1391183637_5cc9ec91c39c59a661aae15bb9ef6986_rle_crop_4010081002_0.png treat image : temp/1761918628_1706318_1391183631_9adabda9eb3ef21167a5e396ff365c01_rle_crop_4010081007_0.png treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081016_0.png treat image : temp/1761918628_1706318_1391183625_1f912aa8d6cb285cb14adb13f3485cab_rle_crop_4010081018_0.png treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081021_0.png treat image : temp/1761918628_1706318_1391183622_c955fd6a5a8f9489dae7b9ac0b598432_rle_crop_4010081024_0.png treat image : temp/1761918628_1706318_1391183654_30f4251bdbf398b70b70bb1ae255442a_rle_crop_4010080973_0.png treat image : temp/1761918628_1706318_1391183668_d0253493554f0bd3a10dced7cc37f22b_rle_crop_4010080962_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 77 time used for this insertion : 0.012227773666381836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 77 time used for this insertion : 0.014942407608032227 save missing photos in datou_result : time spend for datou_step_exec : 8.469098567962646 time spend to save output : 0.03198695182800293 total time spend for step 7 : 8.50108551979065 step8:velours_tree Fri Oct 31 14:53:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.15471959114074707 time spend to save output : 6.842613220214844e-05 total time spend for step 8 : 0.15478801727294922 step9:send_mail_cod Fri Oct 31 14:53:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28024266_31-10-2025_14_53_53.pdf 28026864 imagette280268641761918833 28026866 imagette280268661761918833 28026867 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280268671761918833 28026868 change filename to text .imagette280268681761918834 28026869 change filename to text .imagette280268691761918835 28026870 imagette280268701761918835 28026871 imagette280268711761918835 28026872 change filename to text .change filename to text .change filename to text .change filename to text .imagette280268721761918835 28026873 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280268731761918835 28026875 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280268751761918836 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28024266 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28026864,28026866,28026867,28026868,28026869,28026870,28026871,28026872,28026873,28026874,28026875?tags=flou,mal_croppe,papier,pet_fonce,autre,pehd,background,metal,carton,environnement,pet_clair args[1391183668] : ((1391183668, -6.851200571718522, 492609224), (1391183668, 0.08397274967041103, 2107752395), '0.05446751724054783') We are sending mail with results at report@fotonower.com args[1391183654] : ((1391183654, -7.091512035501208, 492609224), (1391183654, 0.11530532669003321, 2107752395), '0.05446751724054783') We are sending mail with results at report@fotonower.com args[1391183648] : ((1391183648, -7.056435124641322, 492609224), (1391183648, 0.10796348635780559, 2107752395), '0.05446751724054783') We are sending mail with results at report@fotonower.com args[1391183640] : ((1391183640, -6.918247693846957, 492609224), (1391183640, 0.02883627324667153, 2107752395), '0.05446751724054783') We are sending mail with results at report@fotonower.com args[1391183637] : ((1391183637, -7.04548346165077, 492609224), (1391183637, 0.043491293524770124, 2107752395), '0.05446751724054783') We are sending mail with results at report@fotonower.com args[1391183631] : ((1391183631, -6.800070999306156, 492609224), (1391183631, -0.09252892253811199, 496442774), '0.05446751724054783') We are sending mail with results at report@fotonower.com args[1391183625] : ((1391183625, -7.037016271120237, 492609224), (1391183625, 0.11086811579701195, 2107752395), '0.05446751724054783') We are sending mail with results at report@fotonower.com args[1391183622] : ((1391183622, -6.858168947984142, 492609224), (1391183622, 0.006509243899743935, 2107752395), '0.05446751724054783') We are sending mail with results at report@fotonower.com refus_total : 0.05446751724054783 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28024266 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28024266_31-10-2025_14_53_53.pdf results_Auto_P28024266_31-10-2025_14_53_53.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28024266_31-10-2025_14_53_53.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28024266','results_Auto_P28024266_31-10-2025_14_53_53.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28024266_31-10-2025_14_53_53.pdf','pdf','','0.62','0.05446751724054783') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28024266

https://www.fotonower.com/image?json=false&list_photos_id=1391183668
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391183654
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391183648
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391183640
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391183637
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391183631
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391183625
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391183622
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.45%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/28026867?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28026868?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28026869?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28026872?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28026873?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28026875?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28024266_31-10-2025_14_53_53.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28026864,28026866,28026867,28026868,28026869,28026870,28026871,28026872,28026873,28026874,28026875?tags=flou,mal_croppe,papier,pet_fonce,autre,pehd,background,metal,carton,environnement,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 31 Oct 2025 13:54:01 GMT Content-Length: 0 Connection: close X-Message-Id: ffG63_4zTRO8wIpvXEk6Dg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1391183668, 1391183654, 1391183648, 1391183640, 1391183637, 1391183631, 1391183625, 1391183622] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183668', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183654', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183648', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183640', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183637', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183631', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183625', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183622', None, None, None, None, None, '3973925') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01800060272216797 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.114867210388184 time spend to save output : 0.018233537673950195 total time spend for step 9 : 8.133100748062134 step10:split_time_score Fri Oct 31 14:54:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 31102025 28024266 Nombre de photos uploadées : 8 / 23040 (0%) 31102025 28024266 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 31102025 28024266 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 5.7220458984375e-06 elapsed_time : order_list_meta_photo_and_scores 1.5735626220703125e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0007419586181640625 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21495342254638672 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1218858309417758 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28001975_31-10-2025_07_32_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28001975 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28001975 AND mptpi.`type`=3726 To do Qualite : 0.12201730894904302 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28001990_31-10-2025_07_28_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28001990 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28001990 AND mptpi.`type`=3726 To do Qualite : 0.1094986076263963 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28001993_31-10-2025_07_22_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28001993 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28001993 AND mptpi.`type`=3726 To do Qualite : 0.014271268905993782 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28001996_31-10-2025_07_17_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28001996 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28001996 AND mptpi.`type`=3726 To do Qualite : 0.07056444209985084 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28006918_31-10-2025_08_37_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28006918 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28006918 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008659 order by id desc limit 1 Qualite : 0.026716777097814587 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28012537_31-10-2025_10_21_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28012537 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28012537 AND mptpi.`type`=3726 To do Qualite : 0.023397252240218363 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28020423_31-10-2025_12_17_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28020423 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28020423 AND mptpi.`type`=3726 To do Qualite : 0.03385259912590448 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28020455_31-10-2025_13_33_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28020455 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28020455 AND mptpi.`type`=3726 To do Qualite : 0.0779635644547574 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28024263_31-10-2025_13_37_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28024263 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28024263 AND mptpi.`type`=3726 To do Qualite : 0.05446751724054783 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28024266_31-10-2025_14_53_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28024266 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28024266 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28026384 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'31102025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1391183668, 1391183654, 1391183648, 1391183640, 1391183637, 1391183631, 1391183625, 1391183622] Looping around the photos to save general results len do output : 1 /28024266Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183668', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183654', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183648', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183640', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183637', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183631', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183625', None, None, None, None, None, '3973925') ('3318', None, None, None, None, None, None, None, '3973925') ('3318', '28024266', '1391183622', None, None, None, None, None, '3973925') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.010889291763305664 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.5149247646331787 time spend to save output : 0.011115074157714844 total time spend for step 10 : 3.5260398387908936 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 98.44user 87.54system 3:40.41elapsed 84%CPU (0avgtext+0avgdata 3983344maxresident)k 546720inputs+89872outputs (7384major+9476418minor)pagefaults 0swaps