python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3450136 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3812054'] with mtr_portfolio_ids : ['27417933'] and first list_photo_ids : [] new path : /proc/3450136/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.9323124885559082 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Oct 1 21:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5289 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-01 21:10:32.970359: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-01 21:10:32.996511: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-10-01 21:10:32.998256: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f80a8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-01 21:10:32.998276: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-01 21:10:33.001712: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-01 21:10:33.143131: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3f403340 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-01 21:10:33.143168: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-01 21:10:33.143959: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-01 21:10:33.144242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-01 21:10:33.146700: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-01 21:10:33.149106: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-01 21:10:33.149875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-01 21:10:33.152812: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-01 21:10:33.154191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-01 21:10:33.160201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-01 21:10:33.161366: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-01 21:10:33.161452: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-01 21:10:33.162055: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-01 21:10:33.162070: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-01 21:10:33.162078: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-01 21:10:33.163077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4829 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-01 21:10:33.573803: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-01 21:10:33.573901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-01 21:10:33.573922: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-01 21:10:33.573940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-01 21:10:33.573958: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-01 21:10:33.573976: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-01 21:10:33.573993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-01 21:10:33.574011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-01 21:10:33.575188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-01 21:10:33.576377: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-01 21:10:33.576419: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-01 21:10:33.576438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-01 21:10:33.576455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-01 21:10:33.576472: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-01 21:10:33.576488: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-01 21:10:33.576505: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-01 21:10:33.576522: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-01 21:10:33.577689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-01 21:10:33.577719: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-01 21:10:33.577731: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-01 21:10:33.577740: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-01 21:10:33.579006: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4829 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-01 21:10:44.873858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-01 21:10:45.047476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-01 21:10:46.476373: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 Detection mask done ! Trying to reset tf kernel 3450687 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 408 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5289 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0011785030364990234 nb_pixel_total : 51864 time to create 1 rle with old method : 0.060415029525756836 length of segment : 215 time for calcul the mask position with numpy : 0.0002505779266357422 nb_pixel_total : 14401 time to create 1 rle with old method : 0.017504215240478516 length of segment : 173 time for calcul the mask position with numpy : 0.00021004676818847656 nb_pixel_total : 12306 time to create 1 rle with old method : 0.014837026596069336 length of segment : 133 time for calcul the mask position with numpy : 0.0002493858337402344 nb_pixel_total : 12653 time to create 1 rle with old method : 0.018022537231445312 length of segment : 132 time for calcul the mask position with numpy : 0.00034427642822265625 nb_pixel_total : 23878 time to create 1 rle with old method : 0.028737783432006836 length of segment : 187 time for calcul the mask position with numpy : 0.00047135353088378906 nb_pixel_total : 29349 time to create 1 rle with old method : 0.035533905029296875 length of segment : 233 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 12314 time to create 1 rle with old method : 0.01499176025390625 length of segment : 147 time for calcul the mask position with numpy : 0.0004570484161376953 nb_pixel_total : 27607 time to create 1 rle with old method : 0.03364276885986328 length of segment : 254 time for calcul the mask position with numpy : 0.004435300827026367 nb_pixel_total : 191653 time to create 1 rle with new method : 0.012026548385620117 length of segment : 697 time for calcul the mask position with numpy : 0.000232696533203125 nb_pixel_total : 12185 time to create 1 rle with old method : 0.014979839324951172 length of segment : 145 time for calcul the mask position with numpy : 0.000431060791015625 nb_pixel_total : 25602 time to create 1 rle with old method : 0.030963420867919922 length of segment : 188 time for calcul the mask position with numpy : 0.00023365020751953125 nb_pixel_total : 14704 time to create 1 rle with old method : 0.018683433532714844 length of segment : 118 time for calcul the mask position with numpy : 0.0002751350402832031 nb_pixel_total : 16124 time to create 1 rle with old method : 0.020074129104614258 length of segment : 196 time for calcul the mask position with numpy : 0.0004971027374267578 nb_pixel_total : 33165 time to create 1 rle with old method : 0.047579288482666016 length of segment : 221 time for calcul the mask position with numpy : 0.0006117820739746094 nb_pixel_total : 32988 time to create 1 rle with old method : 0.04748797416687012 length of segment : 198 time for calcul the mask position with numpy : 0.0004551410675048828 nb_pixel_total : 27767 time to create 1 rle with old method : 0.03466343879699707 length of segment : 394 time for calcul the mask position with numpy : 0.0003464221954345703 nb_pixel_total : 18126 time to create 1 rle with old method : 0.02321338653564453 length of segment : 146 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 7656 time to create 1 rle with old method : 0.013602733612060547 length of segment : 124 time for calcul the mask position with numpy : 0.00046515464782714844 nb_pixel_total : 31956 time to create 1 rle with old method : 0.039043426513671875 length of segment : 246 time for calcul the mask position with numpy : 0.00038504600524902344 nb_pixel_total : 28188 time to create 1 rle with old method : 0.034638166427612305 length of segment : 115 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 9482 time to create 1 rle with old method : 0.011980533599853516 length of segment : 117 time for calcul the mask position with numpy : 0.001041412353515625 nb_pixel_total : 73164 time to create 1 rle with old method : 0.09511685371398926 length of segment : 362 time for calcul the mask position with numpy : 0.0005667209625244141 nb_pixel_total : 39946 time to create 1 rle with old method : 0.05559539794921875 length of segment : 154 time for calcul the mask position with numpy : 0.0005199909210205078 nb_pixel_total : 21735 time to create 1 rle with old method : 0.028101444244384766 length of segment : 171 time for calcul the mask position with numpy : 0.0006935596466064453 nb_pixel_total : 25065 time to create 1 rle with old method : 0.046898603439331055 length of segment : 209 time for calcul the mask position with numpy : 0.0019140243530273438 nb_pixel_total : 81437 time to create 1 rle with old method : 0.11738252639770508 length of segment : 382 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 16280 time to create 1 rle with old method : 0.021777629852294922 length of segment : 130 time for calcul the mask position with numpy : 0.0007457733154296875 nb_pixel_total : 17196 time to create 1 rle with old method : 0.025250911712646484 length of segment : 248 time for calcul the mask position with numpy : 0.0009026527404785156 nb_pixel_total : 25079 time to create 1 rle with old method : 0.03702139854431152 length of segment : 178 time for calcul the mask position with numpy : 0.0008275508880615234 nb_pixel_total : 22526 time to create 1 rle with old method : 0.032032012939453125 length of segment : 198 time for calcul the mask position with numpy : 0.0006861686706542969 nb_pixel_total : 29668 time to create 1 rle with old method : 0.03976702690124512 length of segment : 224 time for calcul the mask position with numpy : 0.001004934310913086 nb_pixel_total : 36318 time to create 1 rle with old method : 0.04529905319213867 length of segment : 370 time for calcul the mask position with numpy : 0.001069784164428711 nb_pixel_total : 47907 time to create 1 rle with old method : 0.06431245803833008 length of segment : 269 time for calcul the mask position with numpy : 0.00036025047302246094 nb_pixel_total : 17922 time to create 1 rle with old method : 0.02265787124633789 length of segment : 212 time for calcul the mask position with numpy : 0.0028791427612304688 nb_pixel_total : 163289 time to create 1 rle with new method : 0.006690263748168945 length of segment : 509 time for calcul the mask position with numpy : 0.0007812976837158203 nb_pixel_total : 36146 time to create 1 rle with old method : 0.04477214813232422 length of segment : 223 time for calcul the mask position with numpy : 0.0009253025054931641 nb_pixel_total : 42969 time to create 1 rle with old method : 0.05472087860107422 length of segment : 170 time for calcul the mask position with numpy : 0.0002486705780029297 nb_pixel_total : 7971 time to create 1 rle with old method : 0.010260820388793945 length of segment : 116 time for calcul the mask position with numpy : 0.0007810592651367188 nb_pixel_total : 27920 time to create 1 rle with old method : 0.04985213279724121 length of segment : 211 time for calcul the mask position with numpy : 0.0012094974517822266 nb_pixel_total : 40344 time to create 1 rle with old method : 0.053810834884643555 length of segment : 520 time for calcul the mask position with numpy : 0.0009584426879882812 nb_pixel_total : 41443 time to create 1 rle with old method : 0.052857398986816406 length of segment : 210 time for calcul the mask position with numpy : 0.0007913112640380859 nb_pixel_total : 30576 time to create 1 rle with old method : 0.038660287857055664 length of segment : 217 time for calcul the mask position with numpy : 0.0013628005981445312 nb_pixel_total : 53907 time to create 1 rle with old method : 0.06686854362487793 length of segment : 303 time for calcul the mask position with numpy : 0.002244710922241211 nb_pixel_total : 70909 time to create 1 rle with old method : 0.08921957015991211 length of segment : 289 time for calcul the mask position with numpy : 0.0008130073547363281 nb_pixel_total : 34958 time to create 1 rle with old method : 0.04490208625793457 length of segment : 215 time for calcul the mask position with numpy : 0.0002865791320800781 nb_pixel_total : 7606 time to create 1 rle with old method : 0.010082721710205078 length of segment : 120 time for calcul the mask position with numpy : 0.0012066364288330078 nb_pixel_total : 47028 time to create 1 rle with old method : 0.06121969223022461 length of segment : 354 time for calcul the mask position with numpy : 0.001600503921508789 nb_pixel_total : 72523 time to create 1 rle with old method : 0.11506104469299316 length of segment : 336 time for calcul the mask position with numpy : 0.0010068416595458984 nb_pixel_total : 25839 time to create 1 rle with old method : 0.03432941436767578 length of segment : 309 time for calcul the mask position with numpy : 0.002059459686279297 nb_pixel_total : 85386 time to create 1 rle with old method : 0.10677886009216309 length of segment : 453 time for calcul the mask position with numpy : 0.001241445541381836 nb_pixel_total : 53891 time to create 1 rle with old method : 0.06534433364868164 length of segment : 220 time for calcul the mask position with numpy : 0.0013043880462646484 nb_pixel_total : 66177 time to create 1 rle with old method : 0.08554601669311523 length of segment : 332 time for calcul the mask position with numpy : 0.0006597042083740234 nb_pixel_total : 17596 time to create 1 rle with old method : 0.0224001407623291 length of segment : 163 time for calcul the mask position with numpy : 0.0009272098541259766 nb_pixel_total : 33304 time to create 1 rle with old method : 0.04167914390563965 length of segment : 238 time for calcul the mask position with numpy : 0.0008308887481689453 nb_pixel_total : 26497 time to create 1 rle with old method : 0.033440589904785156 length of segment : 218 time for calcul the mask position with numpy : 0.0006210803985595703 nb_pixel_total : 26263 time to create 1 rle with old method : 0.03312826156616211 length of segment : 225 time for calcul the mask position with numpy : 0.0009276866912841797 nb_pixel_total : 29693 time to create 1 rle with old method : 0.03983950614929199 length of segment : 221 time for calcul the mask position with numpy : 0.0009872913360595703 nb_pixel_total : 37654 time to create 1 rle with old method : 0.0471498966217041 length of segment : 242 time for calcul the mask position with numpy : 0.0003523826599121094 nb_pixel_total : 12400 time to create 1 rle with old method : 0.015249252319335938 length of segment : 111 time for calcul the mask position with numpy : 0.0004887580871582031 nb_pixel_total : 11550 time to create 1 rle with old method : 0.014944314956665039 length of segment : 149 time for calcul the mask position with numpy : 0.00023865699768066406 nb_pixel_total : 9291 time to create 1 rle with old method : 0.011818170547485352 length of segment : 102 time for calcul the mask position with numpy : 0.0005064010620117188 nb_pixel_total : 16919 time to create 1 rle with old method : 0.02155923843383789 length of segment : 133 time for calcul the mask position with numpy : 0.0017845630645751953 nb_pixel_total : 83683 time to create 1 rle with old method : 0.10346460342407227 length of segment : 369 time for calcul the mask position with numpy : 0.0004956722259521484 nb_pixel_total : 24002 time to create 1 rle with old method : 0.029842615127563477 length of segment : 203 time for calcul the mask position with numpy : 0.000782012939453125 nb_pixel_total : 31828 time to create 1 rle with old method : 0.03946328163146973 length of segment : 215 time for calcul the mask position with numpy : 0.0008258819580078125 nb_pixel_total : 35085 time to create 1 rle with old method : 0.043810129165649414 length of segment : 227 time for calcul the mask position with numpy : 0.0004603862762451172 nb_pixel_total : 19898 time to create 1 rle with old method : 0.02480030059814453 length of segment : 213 time for calcul the mask position with numpy : 0.00022220611572265625 nb_pixel_total : 7455 time to create 1 rle with old method : 0.009458065032958984 length of segment : 101 time for calcul the mask position with numpy : 0.0007812976837158203 nb_pixel_total : 36864 time to create 1 rle with old method : 0.04626035690307617 length of segment : 150 time for calcul the mask position with numpy : 0.0006542205810546875 nb_pixel_total : 21743 time to create 1 rle with old method : 0.027457475662231445 length of segment : 182 time spent for convertir_results : 5.520263910293579 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 70 chid ids of type : 3594 Number RLEs to save : 16055 save missing photos in datou_result : time spend for datou_step_exec : 58.151506423950195 time spend to save output : 1.8545351028442383 total time spend for step 1 : 60.006041526794434 step2:crop_condition Wed Oct 1 21:11:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 70 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 44 About to insert : list_path_to_insert length 44 new photo from crops ! About to upload 44 photos upload in portfolio : 3736932 init cache_photo without model_param we have 44 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759345901_3450136 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912888_0.png', 0, 131, 172, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912890_0.png', 0, 121, 131, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912889_0.png', 0, 127, 133, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912891_0.png', 0, 150, 184, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912902_0.png', 0, 110, 365, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912903_0.png', 0, 182, 145, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912899_0.png', 0, 105, 196, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912897_0.png', 0, 202, 186, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912904_0.png', 0, 106, 114, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912898_0.png', 0, 151, 118, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912895_0.png', 0, 477, 595, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912893_0.png', 0, 102, 147, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912896_0.png', 0, 103, 145, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912907_0.png', 0, 112, 117, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912913_0.png', 0, 167, 129, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912906_0.png', 0, 355, 108, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912905_0.png', 0, 228, 203, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912910_0.png', 0, 194, 169, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912914_0.png', 0, 99, 248, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912911_0.png', 0, 254, 209, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912908_0.png', 0, 319, 362, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912918_0.png', 0, 158, 363, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912920_0.png', 0, 168, 164, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912917_0.png', 0, 170, 224, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912919_0.png', 0, 271, 261, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912926_0.png', 0, 178, 381, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912922_0.png', 0, 251, 223, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912924_0.png', 0, 87, 115, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912923_0.png', 0, 358, 170, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912925_0.png', 0, 208, 192, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912930_0.png', 0, 458, 275, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912931_0.png', 0, 217, 214, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912932_0.png', 0, 92, 120, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912938_0.png', 0, 316, 332, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912935_0.png', 0, 263, 194, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912939_0.png', 0, 183, 156, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912943_0.png', 0, 206, 221, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912945_0.png', 0, 135, 107, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912940_0.png', 0, 224, 238, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912946_0.png', 0, 156, 149, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912949_0.png', 0, 420, 338, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912948_0.png', 0, 180, 130, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912950_0.png', 0, 172, 198, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345910), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912953_0.png', 0, 177, 208, 0, 1759345910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 44 photos in the portfolio 3736932 time of upload the photos Elapsed time : 14.625259399414062 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759345919_3450136 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912887_0.png', 0, 334, 210, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912894_0.png', 0, 152, 254, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912892_0.png', 0, 204, 233, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912915_0.png', 0, 220, 176, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912916_0.png', 0, 149, 194, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912927_0.png', 0, 261, 210, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912928_0.png', 0, 207, 217, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912944_0.png', 0, 223, 237, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912941_0.png', 0, 202, 218, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912942_0.png', 0, 132, 225, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912951_0.png', 0, 212, 215, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912952_0.png', 0, 267, 227, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345923), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912956_0.png', 0, 179, 182, 0, 1759345923,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.982206344604492 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759345926_3450136 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345926), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912947_0.png', 0, 110, 102, 0, 1759345926,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8275055885314941 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759345930_3450136 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345931), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912900_0.png', 0, 192, 217, 0, 1759345931,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345931), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912912_0.png', 0, 370, 338, 0, 1759345931,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345931), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912929_0.png', 0, 274, 302, 0, 1759345931,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345931), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912933_0.png', 0, 339, 242, 0, 1759345931,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345931), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912936_0.png', 0, 247, 418, 0, 1759345931,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345931), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912937_0.png', 0, 363, 195, 0, 1759345931,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345931), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912955_0.png', 0, 389, 138, 0, 1759345931,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2739322185516357 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759345935_3450136 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345936), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912901_0.png', 0, 206, 195, 0, 1759345936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345936), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912909_0.png', 0, 295, 153, 0, 1759345936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345936), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912921_0.png', 0, 433, 482, 0, 1759345936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345936), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912954_0.png', 0, 91, 101, 0, 1759345936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5513551235198975 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759345938_3450136 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759345939), 0.0, 0.0, 14, '', 0, 0, '1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912934_0.png', 0, 294, 334, 0, 1759345939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7977707386016846 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1387233555, 1387233553, 1387233551, 1387233550, 1387233549, 1387233547, 1387233540, 1387233539, 1387233538, 1387233537] Looping around the photos to save general results len do output : 70 /1387252513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387252603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233555', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233553', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233551', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233550', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233549', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233547', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233540', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233539', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233538', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233537', None, None, None, None, None, '3812054') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 220 time used for this insertion : 0.04514932632446289 save_final save missing photos in datou_result : time spend for datou_step_exec : 49.18120741844177 time spend to save output : 0.04788494110107422 total time spend for step 2 : 49.22909235954285 step3:rle_unique_nms_with_priority Wed Oct 1 21:12:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 70 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 3.1426122188568115 time for calcul the mask position with numpy : 0.6652188301086426 nb_pixel_total : 8179298 time to create 1 rle with new method : 2.161694049835205 time for calcul the mask position with numpy : 0.0369114875793457 nb_pixel_total : 23878 time to create 1 rle with old method : 0.04752302169799805 time for calcul the mask position with numpy : 0.03352665901184082 nb_pixel_total : 12653 time to create 1 rle with old method : 0.024585485458374023 time for calcul the mask position with numpy : 0.034178972244262695 nb_pixel_total : 12306 time to create 1 rle with old method : 0.0245513916015625 time for calcul the mask position with numpy : 0.040688514709472656 nb_pixel_total : 14401 time to create 1 rle with old method : 0.028084754943847656 time for calcul the mask position with numpy : 0.04851889610290527 nb_pixel_total : 51864 time to create 1 rle with old method : 0.10044074058532715 create new chi : 3.305441379547119 time to delete rle : 0.06856846809387207 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3840 TO DO : save crop sub photo not yet done ! save time : 0.5479240417480469 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 6.750604152679443 time for calcul the mask position with numpy : 0.6064770221710205 nb_pixel_total : 7853418 time to create 1 rle with new method : 0.6596119403839111 time for calcul the mask position with numpy : 0.023192167282104492 nb_pixel_total : 7656 time to create 1 rle with old method : 0.009082317352294922 time for calcul the mask position with numpy : 0.024055004119873047 nb_pixel_total : 18126 time to create 1 rle with old method : 0.02158498764038086 time for calcul the mask position with numpy : 0.024390697479248047 nb_pixel_total : 27767 time to create 1 rle with old method : 0.03222179412841797 time for calcul the mask position with numpy : 0.02355337142944336 nb_pixel_total : 32988 time to create 1 rle with old method : 0.038533926010131836 time for calcul the mask position with numpy : 0.023831605911254883 nb_pixel_total : 33165 time to create 1 rle with old method : 0.0387110710144043 time for calcul the mask position with numpy : 0.023913860321044922 nb_pixel_total : 16124 time to create 1 rle with old method : 0.01893472671508789 time for calcul the mask position with numpy : 0.02473616600036621 nb_pixel_total : 14704 time to create 1 rle with old method : 0.017295360565185547 time for calcul the mask position with numpy : 0.022841453552246094 nb_pixel_total : 25602 time to create 1 rle with old method : 0.02943730354309082 time for calcul the mask position with numpy : 0.02531599998474121 nb_pixel_total : 12185 time to create 1 rle with old method : 0.02093672752380371 time for calcul the mask position with numpy : 0.028875112533569336 nb_pixel_total : 183395 time to create 1 rle with new method : 0.5969069004058838 time for calcul the mask position with numpy : 0.02575826644897461 nb_pixel_total : 27607 time to create 1 rle with old method : 0.03377079963684082 time for calcul the mask position with numpy : 0.024211645126342773 nb_pixel_total : 12314 time to create 1 rle with old method : 0.014894485473632812 time for calcul the mask position with numpy : 0.0245668888092041 nb_pixel_total : 29349 time to create 1 rle with old method : 0.03560829162597656 create new chi : 2.565563917160034 time to delete rle : 0.0010447502136230469 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8048 TO DO : save crop sub photo not yet done ! save time : 0.9825952053070068 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.443280220031738 time for calcul the mask position with numpy : 0.746182918548584 nb_pixel_total : 7949951 time to create 1 rle with new method : 0.8776834011077881 time for calcul the mask position with numpy : 0.02463531494140625 nb_pixel_total : 17196 time to create 1 rle with old method : 0.019835472106933594 time for calcul the mask position with numpy : 0.024087190628051758 nb_pixel_total : 16280 time to create 1 rle with old method : 0.018877267837524414 time for calcul the mask position with numpy : 0.023580074310302734 nb_pixel_total : 81437 time to create 1 rle with old method : 0.09614443778991699 time for calcul the mask position with numpy : 0.025634050369262695 nb_pixel_total : 25065 time to create 1 rle with old method : 0.029023170471191406 time for calcul the mask position with numpy : 0.030408382415771484 nb_pixel_total : 21735 time to create 1 rle with old method : 0.026055097579956055 time for calcul the mask position with numpy : 0.024151086807250977 nb_pixel_total : 39946 time to create 1 rle with old method : 0.047759056091308594 time for calcul the mask position with numpy : 0.024348974227905273 nb_pixel_total : 73164 time to create 1 rle with old method : 0.08639717102050781 time for calcul the mask position with numpy : 0.024900436401367188 nb_pixel_total : 9482 time to create 1 rle with old method : 0.01103973388671875 time for calcul the mask position with numpy : 0.02401256561279297 nb_pixel_total : 28188 time to create 1 rle with old method : 0.03311944007873535 time for calcul the mask position with numpy : 0.025106191635131836 nb_pixel_total : 31956 time to create 1 rle with old method : 0.03868603706359863 create new chi : 2.3223421573638916 time to delete rle : 0.0008718967437744141 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 6428 TO DO : save crop sub photo not yet done ! save time : 0.7930910587310791 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.264955520629883 time for calcul the mask position with numpy : 0.49567532539367676 nb_pixel_total : 7951691 time to create 1 rle with new method : 1.2068328857421875 time for calcul the mask position with numpy : 0.02522134780883789 nb_pixel_total : 163289 time to create 1 rle with new method : 0.9606215953826904 time for calcul the mask position with numpy : 0.02396106719970703 nb_pixel_total : 17922 time to create 1 rle with old method : 0.02219986915588379 time for calcul the mask position with numpy : 0.02777266502380371 nb_pixel_total : 47907 time to create 1 rle with old method : 0.06792640686035156 time for calcul the mask position with numpy : 0.026958942413330078 nb_pixel_total : 36318 time to create 1 rle with old method : 0.047856807708740234 time for calcul the mask position with numpy : 0.02506422996520996 nb_pixel_total : 29668 time to create 1 rle with old method : 0.03599214553833008 time for calcul the mask position with numpy : 0.02553844451904297 nb_pixel_total : 22526 time to create 1 rle with old method : 0.027502775192260742 time for calcul the mask position with numpy : 0.02572774887084961 nb_pixel_total : 25079 time to create 1 rle with old method : 0.030444860458374023 create new chi : 3.1435790061950684 time to delete rle : 0.0008113384246826172 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 6080 TO DO : save crop sub photo not yet done ! save time : 0.7775940895080566 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 2.690977096557617 time for calcul the mask position with numpy : 0.8748388290405273 nb_pixel_total : 8097607 time to create 1 rle with new method : 0.9839787483215332 time for calcul the mask position with numpy : 0.030461788177490234 nb_pixel_total : 41443 time to create 1 rle with old method : 0.04994535446166992 time for calcul the mask position with numpy : 0.0397031307220459 nb_pixel_total : 40344 time to create 1 rle with old method : 0.04895210266113281 time for calcul the mask position with numpy : 0.04018068313598633 nb_pixel_total : 27920 time to create 1 rle with old method : 0.03362774848937988 time for calcul the mask position with numpy : 0.041252851486206055 nb_pixel_total : 7971 time to create 1 rle with old method : 0.00946950912475586 time for calcul the mask position with numpy : 0.03868532180786133 nb_pixel_total : 42969 time to create 1 rle with old method : 0.05314898490905762 time for calcul the mask position with numpy : 0.03393077850341797 nb_pixel_total : 36146 time to create 1 rle with old method : 0.044350385665893555 create new chi : 2.3624181747436523 time to delete rle : 0.0007939338684082031 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 5060 TO DO : save crop sub photo not yet done ! save time : 0.6905715465545654 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.8123562335968018 time for calcul the mask position with numpy : 0.5387630462646484 nb_pixel_total : 7976893 time to create 1 rle with new method : 1.030775547027588 time for calcul the mask position with numpy : 0.03524136543273926 nb_pixel_total : 72523 time to create 1 rle with old method : 0.08487367630004883 time for calcul the mask position with numpy : 0.023820161819458008 nb_pixel_total : 47028 time to create 1 rle with old method : 0.05435538291931152 time for calcul the mask position with numpy : 0.024419307708740234 nb_pixel_total : 7606 time to create 1 rle with old method : 0.008886098861694336 time for calcul the mask position with numpy : 0.024683713912963867 nb_pixel_total : 34958 time to create 1 rle with old method : 0.042061805725097656 time for calcul the mask position with numpy : 0.024929285049438477 nb_pixel_total : 70909 time to create 1 rle with old method : 0.08322429656982422 time for calcul the mask position with numpy : 0.02468419075012207 nb_pixel_total : 53907 time to create 1 rle with old method : 0.06322193145751953 time for calcul the mask position with numpy : 0.024176359176635742 nb_pixel_total : 30576 time to create 1 rle with old method : 0.0376584529876709 create new chi : 2.1686782836914062 time to delete rle : 0.0011627674102783203 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 5828 TO DO : save crop sub photo not yet done ! save time : 0.7374880313873291 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 2.445328950881958 time for calcul the mask position with numpy : 0.6939566135406494 nb_pixel_total : 8045511 time to create 1 rle with new method : 0.9371674060821533 time for calcul the mask position with numpy : 0.035364627838134766 nb_pixel_total : 17596 time to create 1 rle with old method : 0.02128887176513672 time for calcul the mask position with numpy : 0.024231672286987305 nb_pixel_total : 66177 time to create 1 rle with old method : 0.07712697982788086 time for calcul the mask position with numpy : 0.02458786964416504 nb_pixel_total : 53891 time to create 1 rle with old method : 0.0655210018157959 time for calcul the mask position with numpy : 0.025790929794311523 nb_pixel_total : 85386 time to create 1 rle with old method : 0.10454177856445312 time for calcul the mask position with numpy : 0.027895450592041016 nb_pixel_total : 25839 time to create 1 rle with old method : 0.04580497741699219 create new chi : 2.124807834625244 time to delete rle : 0.001425027847290039 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 5114 TO DO : save crop sub photo not yet done ! save time : 0.685096025466919 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.4793293476104736 time for calcul the mask position with numpy : 0.6031820774078369 nb_pixel_total : 8117039 time to create 1 rle with new method : 0.6740989685058594 time for calcul the mask position with numpy : 0.024351835250854492 nb_pixel_total : 11550 time to create 1 rle with old method : 0.013896942138671875 time for calcul the mask position with numpy : 0.02361011505126953 nb_pixel_total : 12400 time to create 1 rle with old method : 0.014939546585083008 time for calcul the mask position with numpy : 0.02541065216064453 nb_pixel_total : 37654 time to create 1 rle with old method : 0.045561790466308594 time for calcul the mask position with numpy : 0.02794027328491211 nb_pixel_total : 29693 time to create 1 rle with old method : 0.03639626502990723 time for calcul the mask position with numpy : 0.024554729461669922 nb_pixel_total : 26263 time to create 1 rle with old method : 0.031076431274414062 time for calcul the mask position with numpy : 0.025159597396850586 nb_pixel_total : 26497 time to create 1 rle with old method : 0.03133034706115723 time for calcul the mask position with numpy : 0.024308204650878906 nb_pixel_total : 33304 time to create 1 rle with old method : 0.03995823860168457 create new chi : 1.7102348804473877 time to delete rle : 0.0008592605590820312 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 4968 TO DO : save crop sub photo not yet done ! save time : 0.6505281925201416 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.7029242515563965 time for calcul the mask position with numpy : 0.587601900100708 nb_pixel_total : 8160505 time to create 1 rle with new method : 1.0033788681030273 time for calcul the mask position with numpy : 0.04171895980834961 nb_pixel_total : 24002 time to create 1 rle with old method : 0.04004216194152832 time for calcul the mask position with numpy : 0.024657249450683594 nb_pixel_total : 83683 time to create 1 rle with old method : 0.10045003890991211 time for calcul the mask position with numpy : 0.02517223358154297 nb_pixel_total : 16919 time to create 1 rle with old method : 0.020452260971069336 time for calcul the mask position with numpy : 0.028486967086791992 nb_pixel_total : 9291 time to create 1 rle with old method : 0.011242866516113281 create new chi : 1.9331104755401611 time to delete rle : 0.0006632804870605469 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3774 TO DO : save crop sub photo not yet done ! save time : 0.5456087589263916 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 3.719108819961548 time for calcul the mask position with numpy : 0.3575148582458496 nb_pixel_total : 8141527 time to create 1 rle with new method : 1.123762845993042 time for calcul the mask position with numpy : 0.02332329750061035 nb_pixel_total : 21743 time to create 1 rle with old method : 0.026459217071533203 time for calcul the mask position with numpy : 0.025213956832885742 nb_pixel_total : 36864 time to create 1 rle with old method : 0.04500436782836914 time for calcul the mask position with numpy : 0.024669408798217773 nb_pixel_total : 7455 time to create 1 rle with old method : 0.008869409561157227 time for calcul the mask position with numpy : 0.024379253387451172 nb_pixel_total : 19898 time to create 1 rle with old method : 0.023415088653564453 time for calcul the mask position with numpy : 0.023876428604125977 nb_pixel_total : 35085 time to create 1 rle with old method : 0.0405118465423584 time for calcul the mask position with numpy : 0.023774385452270508 nb_pixel_total : 31828 time to create 1 rle with old method : 0.03771519660949707 create new chi : 1.852954387664795 time to delete rle : 0.00070953369140625 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4336 TO DO : save crop sub photo not yet done ! save time : 0.5964195728302002 map_output_result : {1387233555: (0.0, 'Should be the crop_list due to order', 0), 1387233553: (0.0, 'Should be the crop_list due to order', 0), 1387233551: (0.0, 'Should be the crop_list due to order', 0), 1387233550: (0.0, 'Should be the crop_list due to order', 0), 1387233549: (0.0, 'Should be the crop_list due to order', 0), 1387233547: (0.0, 'Should be the crop_list due to order', 0), 1387233540: (0.0, 'Should be the crop_list due to order', 0), 1387233539: (0.0, 'Should be the crop_list due to order', 0), 1387233538: (0.0, 'Should be the crop_list due to order', 0), 1387233537: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1387233555, 1387233553, 1387233551, 1387233550, 1387233549, 1387233547, 1387233540, 1387233539, 1387233538, 1387233537] Looping around the photos to save general results len do output : 10 /1387233555.Didn't retrieve data . /1387233553.Didn't retrieve data . /1387233551.Didn't retrieve data . /1387233550.Didn't retrieve data . /1387233549.Didn't retrieve data . /1387233547.Didn't retrieve data . /1387233540.Didn't retrieve data . /1387233539.Didn't retrieve data . /1387233538.Didn't retrieve data . /1387233537.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233555', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233553', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233551', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233550', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233549', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233547', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233540', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233539', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233538', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233537', None, None, None, None, None, '3812054') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.035069942474365234 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.50466203689575 time spend to save output : 0.035524606704711914 total time spend for step 3 : 68.54018664360046 step4:ventilate_hashtags_in_portfolio Wed Oct 1 21:13:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27417933 get user id for portfolio 27417933 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27417933 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','autre','pet_clair','papier','pehd','carton','pet_fonce','flou','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27417933 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','autre','pet_clair','papier','pehd','carton','pet_fonce','flou','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27417933 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','autre','pet_clair','papier','pehd','carton','pet_fonce','flou','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27418152,27418153,27418154,27418155,27418156,27418157,27418158,27418159,27418160,27418161,27418162?tags=background,environnement,autre,pet_clair,papier,pehd,carton,pet_fonce,flou,metal,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1387233555, 1387233553, 1387233551, 1387233550, 1387233549, 1387233547, 1387233540, 1387233539, 1387233538, 1387233537] Looping around the photos to save general results len do output : 1 /27417933. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233555', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233553', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233551', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233550', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233549', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233547', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233540', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233539', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233538', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233537', None, None, None, None, None, '3812054') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.03727126121520996 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.47409200668335 time spend to save output : 0.03752946853637695 total time spend for step 4 : 5.511621475219727 step5:final Wed Oct 1 21:13:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1387233555: ('0.029785879629629634',), 1387233553: ('0.029785879629629634',), 1387233551: ('0.029785879629629634',), 1387233550: ('0.029785879629629634',), 1387233549: ('0.029785879629629634',), 1387233547: ('0.029785879629629634',), 1387233540: ('0.029785879629629634',), 1387233539: ('0.029785879629629634',), 1387233538: ('0.029785879629629634',), 1387233537: ('0.029785879629629634',)} new output for save of step final : {1387233555: ('0.029785879629629634',), 1387233553: ('0.029785879629629634',), 1387233551: ('0.029785879629629634',), 1387233550: ('0.029785879629629634',), 1387233549: ('0.029785879629629634',), 1387233547: ('0.029785879629629634',), 1387233540: ('0.029785879629629634',), 1387233539: ('0.029785879629629634',), 1387233538: ('0.029785879629629634',), 1387233537: ('0.029785879629629634',)} [1387233555, 1387233553, 1387233551, 1387233550, 1387233549, 1387233547, 1387233540, 1387233539, 1387233538, 1387233537] Looping around the photos to save general results len do output : 10 /1387233555.Didn't retrieve data . /1387233553.Didn't retrieve data . /1387233551.Didn't retrieve data . /1387233550.Didn't retrieve data . /1387233549.Didn't retrieve data . /1387233547.Didn't retrieve data . /1387233540.Didn't retrieve data . /1387233539.Didn't retrieve data . /1387233538.Didn't retrieve data . /1387233537.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233555', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233553', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233551', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233550', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233549', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233547', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233540', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233539', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233538', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233537', None, None, None, None, None, '3812054') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.03803515434265137 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3810555934906006 time spend to save output : 0.03852391242980957 total time spend for step 5 : 0.41957950592041016 step6:blur_detection Wed Oct 1 21:13:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550.jpg resize: (2160, 3840) 1387233555 -6.970398587158354 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551.jpg resize: (2160, 3840) 1387233553 -7.079378045739842 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79.jpg resize: (2160, 3840) 1387233551 -7.13373935836591 treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f.jpg resize: (2160, 3840) 1387233550 -7.155137807788564 treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f.jpg resize: (2160, 3840) 1387233549 -7.068020016342283 treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108.jpg resize: (2160, 3840) 1387233547 -7.1880056527379805 treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3.jpg resize: (2160, 3840) 1387233540 -7.177729776617548 treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923.jpg resize: (2160, 3840) 1387233539 -7.145785380257496 treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209.jpg resize: (2160, 3840) 1387233538 -6.395238557739275 treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4.jpg resize: (2160, 3840) 1387233537 -7.009699819346337 treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912888_0.png resize: (172, 131) 1387252513 -4.6572406693615 treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912890_0.png resize: (131, 121) 1387252515 -3.6318826181198616 treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912889_0.png resize: (133, 127) 1387252516 -2.031344008618489 treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912891_0.png resize: (184, 150) 1387252517 -5.0055523212163395 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912902_0.png resize: (365, 110) 1387252518 -4.282106402053668 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912903_0.png resize: (145, 182) 1387252519 -3.1919922105861303 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912899_0.png resize: (196, 105) 1387252520 -3.6158977695951 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912897_0.png resize: (186, 202) 1387252521 -3.1783739644325237 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912904_0.png resize: (114, 106) 1387252522 -3.8207613155430695 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912898_0.png resize: (118, 151) 1387252523 -4.187403174457936 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912895_0.png resize: (595, 477) 1387252524 -4.395110336889909 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912893_0.png resize: (147, 102) 1387252525 -3.9189702265202135 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912896_0.png resize: (145, 103) 1387252526 -4.139513841587579 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912907_0.png resize: (117, 112) 1387252527 -4.049484234271097 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912913_0.png resize: (129, 167) 1387252528 -3.409696384836121 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912906_0.png resize: (108, 355) 1387252529 -3.366526726664084 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912905_0.png resize: (203, 228) 1387252530 -4.430473651667586 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912910_0.png resize: (169, 194) 1387252531 -4.144403537602382 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912914_0.png resize: (248, 99) 1387252532 -2.5630120589466627 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912911_0.png resize: (209, 254) 1387252533 -4.399405211206507 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912908_0.png resize: (362, 319) 1387252534 -4.405642151376423 treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912918_0.png resize: (363, 158) 1387252538 -3.597241330090949 treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912920_0.png resize: (164, 168) 1387252539 -5.035999741064906 treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912917_0.png resize: (224, 170) 1387252540 -3.5850495215646743 treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912919_0.png resize: (261, 271) 1387252541 -5.06916556206212 treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912926_0.png resize: (381, 178) 1387252542 -3.0795412793389483 treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912922_0.png resize: (223, 251) 1387252543 -4.235876187245855 treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912924_0.png resize: (115, 87) 1387252544 -4.018121453227117 treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912923_0.png resize: (170, 358) 1387252545 -4.670419185809667 treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912925_0.png resize: (192, 208) 1387252546 -4.308528098153843 treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912930_0.png resize: (275, 458) 1387252547 -4.194506497627625 treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912931_0.png resize: (214, 217) 1387252548 -4.097132030360358 treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912932_0.png resize: (120, 92) 1387252550 -3.3591344047497627 treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912938_0.png resize: (332, 316) 1387252551 -5.496734464799658 treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912935_0.png resize: (194, 263) 1387252552 -2.876278542898319 treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912939_0.png resize: (156, 183) 1387252553 -4.307655508825863 treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912943_0.png resize: (221, 206) 1387252554 -2.63653733010534 treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912945_0.png resize: (107, 135) 1387252555 -2.5370228462018583 treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912940_0.png resize: (238, 224) 1387252556 -3.0610865074983944 treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912946_0.png resize: (149, 156) 1387252557 -3.839000507868341 treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912949_0.png resize: (338, 420) 1387252558 -4.748730259010685 treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912948_0.png resize: (130, 180) 1387252559 -3.8957630671034384 treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912950_0.png resize: (198, 172) 1387252560 -4.519813101112514 treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912953_0.png resize: (208, 177) 1387252561 -4.231584361974995 treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912887_0.png resize: (210, 334) 1387252568 -4.460638219069283 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912894_0.png resize: (254, 152) 1387252569 -3.484634733878474 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912892_0.png resize: (233, 204) 1387252570 -3.7912249998360124 treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912915_0.png resize: (176, 220) 1387252571 -3.1094340738209962 treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912916_0.png resize: (194, 149) 1387252572 -3.6487031330719013 treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912927_0.png resize: (210, 261) 1387252573 -3.847452183587491 treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912928_0.png resize: (217, 207) 1387252574 -3.3620366109843247 treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912944_0.png resize: (237, 223) 1387252575 -2.4977969566760416 treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912941_0.png resize: (218, 202) 1387252576 -3.815604837083145 treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912942_0.png resize: (225, 132) 1387252577 -3.017081779683441 treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912951_0.png resize: (215, 212) 1387252578 -3.9542070332430046 treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912952_0.png resize: (227, 267) 1387252579 -4.062314901588525 treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912956_0.png resize: (182, 179) 1387252580 -3.6054903894820813 treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912947_0.png resize: (102, 110) 1387252583 -3.4563422286140826 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912900_0.png resize: (217, 192) 1387252587 -4.665747922761904 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912912_0.png resize: (338, 370) 1387252588 -4.969844109117451 treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912929_0.png resize: (302, 274) 1387252589 -4.559343579258116 treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912933_0.png resize: (242, 339) 1387252590 -4.807915133572785 treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912936_0.png resize: (418, 247) 1387252591 -5.552921631299645 treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912937_0.png resize: (195, 363) 1387252592 -3.7991825494889837 treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912955_0.png resize: (138, 389) 1387252593 -3.6888920990652614 treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912901_0.png resize: (195, 206) 1387252597 -3.632132928183172 treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912909_0.png resize: (153, 295) 1387252598 -4.326128113566653 treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912921_0.png resize: (482, 433) 1387252599 -6.11487173504832 treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912954_0.png resize: (101, 91) 1387252600 -4.689250795560441 treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912934_0.png resize: (334, 294) 1387252603 -5.616795953892291 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 80 time used for this insertion : 0.03984856605529785 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 80 time used for this insertion : 0.038388967514038086 save missing photos in datou_result : time spend for datou_step_exec : 39.704766273498535 time spend to save output : 0.09606194496154785 total time spend for step 6 : 39.80082821846008 step7:brightness Wed Oct 1 21:14:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550.jpg treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551.jpg treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79.jpg treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f.jpg treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f.jpg treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108.jpg treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3.jpg treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923.jpg treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209.jpg treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4.jpg treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912888_0.png treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912890_0.png treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912889_0.png treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912891_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912902_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912903_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912899_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912897_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912904_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912898_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912895_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912893_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912896_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912907_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912913_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912906_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912905_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912910_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912914_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912911_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912908_0.png treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912918_0.png treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912920_0.png treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912917_0.png treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912919_0.png treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912926_0.png treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912922_0.png treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912924_0.png treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912923_0.png treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912925_0.png treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912930_0.png treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912931_0.png treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912932_0.png treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912938_0.png treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912935_0.png treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912939_0.png treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912943_0.png treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912945_0.png treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912940_0.png treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912946_0.png treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912949_0.png treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912948_0.png treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912950_0.png treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912953_0.png treat image : temp/1759345828_3450136_1387233555_c53ecaf6fe359385853969bb3d8aa550_rle_crop_3982912887_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912894_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912892_0.png treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912915_0.png treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912916_0.png treat image : temp/1759345828_3450136_1387233549_930bd44a140195797128eb5ff6978f3f_rle_crop_3982912927_0.png treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912928_0.png treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912944_0.png treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912941_0.png treat image : temp/1759345828_3450136_1387233539_636bc2bf1f6944b674895b8cd0b3c923_rle_crop_3982912942_0.png treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912951_0.png treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912952_0.png treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912956_0.png treat image : temp/1759345828_3450136_1387233538_a4b5d737a8b4392abfb5f1acca1c8209_rle_crop_3982912947_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912900_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912912_0.png treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912929_0.png treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912933_0.png treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912936_0.png treat image : temp/1759345828_3450136_1387233540_b9709eaf8b3af98d557f56b454cf65b3_rle_crop_3982912937_0.png treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912955_0.png treat image : temp/1759345828_3450136_1387233553_c9be74fd7a798088d917f8e4579ee551_rle_crop_3982912901_0.png treat image : temp/1759345828_3450136_1387233551_2bf11de0a13ba3514431e0b5436aac79_rle_crop_3982912909_0.png treat image : temp/1759345828_3450136_1387233550_2e3d5796e793695b28cec32003d55e5f_rle_crop_3982912921_0.png treat image : temp/1759345828_3450136_1387233537_597da315bcf430ade1ed3bf91d635fc4_rle_crop_3982912954_0.png treat image : temp/1759345828_3450136_1387233547_f3eb023f1bc5b7094869cae49c440108_rle_crop_3982912934_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 80 time used for this insertion : 0.039528608322143555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 80 time used for this insertion : 0.03915548324584961 save missing photos in datou_result : time spend for datou_step_exec : 9.977332830429077 time spend to save output : 0.09655213356018066 total time spend for step 7 : 10.073884963989258 step8:velours_tree Wed Oct 1 21:14:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09467196464538574 time spend to save output : 3.981590270996094e-05 total time spend for step 8 : 0.0947117805480957 step9:send_mail_cod Wed Oct 1 21:14:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27417933_01-10-2025_21_14_23.pdf 27418152 imagette274181521759346063 27418154 change filename to text .change filename to text .change filename to text .change filename to text .imagette274181541759346063 27418155 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274181551759346064 27418156 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274181561759346064 27418157 imagette274181571759346067 27418158 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274181581759346067 27418159 change filename to text .imagette274181591759346068 27418160 imagette274181601759346068 27418161 change filename to text .imagette274181611759346068 27418162 imagette274181621759346068 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27417933 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27418152,27418153,27418154,27418155,27418156,27418157,27418158,27418159,27418160,27418161,27418162?tags=background,environnement,autre,pet_clair,papier,pehd,carton,pet_fonce,flou,metal,mal_croppe args[1387233555] : ((1387233555, -6.970398587158354, 492609224), (1387233555, -0.016897846023252505, 2107752395), '0.029785879629629634') We are sending mail with results at report@fotonower.com args[1387233553] : ((1387233553, -7.079378045739842, 492609224), (1387233553, 0.1575667292982375, 2107752395), '0.029785879629629634') We are sending mail with results at report@fotonower.com args[1387233551] : ((1387233551, -7.13373935836591, 492609224), (1387233551, 0.14524600362901058, 2107752395), '0.029785879629629634') We are sending mail with results at report@fotonower.com args[1387233550] : ((1387233550, -7.155137807788564, 492609224), (1387233550, 0.04434716911716367, 2107752395), '0.029785879629629634') We are sending mail with results at report@fotonower.com args[1387233549] : ((1387233549, -7.068020016342283, 492609224), (1387233549, 0.06730359260647398, 2107752395), '0.029785879629629634') We are sending mail with results at report@fotonower.com args[1387233547] : ((1387233547, -7.1880056527379805, 492609224), (1387233547, 0.13872920740253836, 2107752395), '0.029785879629629634') We are sending mail with results at report@fotonower.com args[1387233540] : ((1387233540, -7.177729776617548, 492609224), (1387233540, 0.1313897000179252, 2107752395), '0.029785879629629634') We are sending mail with results at report@fotonower.com args[1387233539] : ((1387233539, -7.145785380257496, 492609224), (1387233539, 0.04063437666608762, 2107752395), '0.029785879629629634') We are sending mail with results at report@fotonower.com args[1387233538] : ((1387233538, -6.395238557739275, 492609224), (1387233538, -0.34486538231595715, 496442774), '0.029785879629629634') We are sending mail with results at report@fotonower.com args[1387233537] : ((1387233537, -7.009699819346337, 492609224), (1387233537, -0.03079063930258181, 2107752395), '0.029785879629629634') We are sending mail with results at report@fotonower.com refus_total : 0.029785879629629634 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27417933 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27417933_01-10-2025_21_14_23.pdf results_Auto_P27417933_01-10-2025_21_14_23.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27417933_01-10-2025_21_14_23.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27417933','results_Auto_P27417933_01-10-2025_21_14_23.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27417933_01-10-2025_21_14_23.pdf','pdf','','0.57','0.029785879629629634') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27417933

https://www.fotonower.com/image?json=false&list_photos_id=1387233555
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387233553
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387233551
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387233550
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387233549
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387233547
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387233540
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387233539
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387233538
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387233537
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 2.98%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/27418154?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27418155?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27418156?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27418158?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27418159?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27418161?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27417933_01-10-2025_21_14_23.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27418152,27418153,27418154,27418155,27418156,27418157,27418158,27418159,27418160,27418161,27418162?tags=background,environnement,autre,pet_clair,papier,pehd,carton,pet_fonce,flou,metal,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 01 Oct 2025 19:14:32 GMT Content-Length: 0 Connection: close X-Message-Id: hsk0QTkMQImby1iEnuHo4Q Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1387233555, 1387233553, 1387233551, 1387233550, 1387233549, 1387233547, 1387233540, 1387233539, 1387233538, 1387233537] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233555', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233553', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233551', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233550', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233549', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233547', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233540', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233539', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233538', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233537', None, None, None, None, None, '3812054') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.03668045997619629 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.275281190872192 time spend to save output : 0.0369114875793457 total time spend for step 9 : 8.312192678451538 step10:split_time_score Wed Oct 1 21:14:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01102025 27417933 Nombre de photos uploadées : 10 / 23040 (0%) 01102025 27417933 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 01102025 27417933 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.2159347534179688e-05 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005657672882080078 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6437954902648926 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.052248550851368605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27387787_01-10-2025_07_37_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27387787 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27387787 AND mptpi.`type`=3726 To do Qualite : 0.04879990079874824 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27387808_01-10-2025_07_31_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27387808 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27387808 AND mptpi.`type`=3726 To do Qualite : 0.021150770851721335 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27387815_01-10-2025_07_22_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27387815 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27387815 AND mptpi.`type`=3726 To do Qualite : 0.10026137993035467 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27409008_01-10-2025_16_17_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27409008 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27409008 AND mptpi.`type`=3726 To do Qualite : 0.03766507046302981 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27394663_01-10-2025_09_46_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27394663 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27394663 AND mptpi.`type`=3726 To do Qualite : 0.015083201898604156 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27403858_01-10-2025_13_47_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27403858 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27403858 AND mptpi.`type`=3726 To do Qualite : 0.10601279846107683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27403865_01-10-2025_13_46_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27403865 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27403865 AND mptpi.`type`=3594 To do Qualite : 0.08618425282921811 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27406524_01-10-2025_15_13_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27406524 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27406524 AND mptpi.`type`=3594 To do Qualite : 0.022117389669311555 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27409022_01-10-2025_16_12_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27409022 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27409022 AND mptpi.`type`=3726 To do Qualite : 0.09705986368312756 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27409027_01-10-2025_16_17_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27409027 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27409027 AND mptpi.`type`=3594 To do Qualite : 0.08946949146412034 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27413291_01-10-2025_18_17_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27413291 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27413291 AND mptpi.`type`=3594 To do Qualite : 0.15237062237276558 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27413332_01-10-2025_18_08_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27413332 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27413332 AND mptpi.`type`=3726 To do Qualite : 0.06836314260223764 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27414376_01-10-2025_18_46_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27414376 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27414376 AND mptpi.`type`=3594 To do Qualite : 0.04014366690925254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27415501_01-10-2025_19_46_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27415501 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27415501 AND mptpi.`type`=3726 To do Qualite : 0.029785879629629634 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27417933_01-10-2025_21_14_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27417933 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27417933 AND mptpi.`type`=3594 To do Qualite : 0.08823316945408423 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27417936_01-10-2025_21_11_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27417936 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27417936 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01102025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1387233555, 1387233553, 1387233551, 1387233550, 1387233549, 1387233547, 1387233540, 1387233539, 1387233538, 1387233537] Looping around the photos to save general results len do output : 1 /27417933Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233555', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233553', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233551', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233550', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233549', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233547', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233540', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233539', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233538', None, None, None, None, None, '3812054') ('3318', None, None, None, None, None, None, None, '3812054') ('3318', '27417933', '1387233537', None, None, None, None, None, '3812054') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.035738468170166016 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.614572525024414 time spend to save output : 0.0360715389251709 total time spend for step 10 : 4.650644063949585 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 95.24user 106.97system 4:12.23elapsed 80%CPU (0avgtext+0avgdata 4363000maxresident)k 535848inputs+75880outputs (394major+9797818minor)pagefaults 0swaps